-- Logs begin at Tue 2021-11-23 11:56:55 UTC, end at Tue 2021-11-23 13:54:03 UTC. -- Nov 23 12:50:13.658910 dv-cinder-818886-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Nov 23 12:50:13.675452 dv-cinder-818886-1-iscsi devstack@n-api.service[86133]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 23 12:50:13.677501 dv-cinder-818886-1-iscsi devstack@n-api.service[86133]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Nov 23 12:50:13 2021] *** Nov 23 12:50:13.677501 dv-cinder-818886-1-iscsi devstack@n-api.service[86133]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 23 12:50:13.677501 dv-cinder-818886-1-iscsi devstack@n-api.service[86133]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 23 12:50:13.677501 dv-cinder-818886-1-iscsi devstack@n-api.service[86133]: nodename: dv-cinder-818886-1-iscsi Nov 23 12:50:13.677501 dv-cinder-818886-1-iscsi devstack@n-api.service[86133]: machine: x86_64 Nov 23 12:50:13.677501 dv-cinder-818886-1-iscsi devstack@n-api.service[86133]: clock source: unix Nov 23 12:50:13.677501 dv-cinder-818886-1-iscsi devstack@n-api.service[86133]: pcre jit disabled Nov 23 12:50:13.677501 dv-cinder-818886-1-iscsi devstack@n-api.service[86133]: detected number of CPU cores: 4 Nov 23 12:50:13.677501 dv-cinder-818886-1-iscsi devstack@n-api.service[86133]: current working directory: / Nov 23 12:50:13.677501 dv-cinder-818886-1-iscsi devstack@n-api.service[86133]: detected binary path: /usr/bin/uwsgi-core Nov 23 12:50:13.677501 dv-cinder-818886-1-iscsi devstack@n-api.service[86133]: your processes number limit is 47680 Nov 23 12:50:13.677501 dv-cinder-818886-1-iscsi devstack@n-api.service[86133]: your memory page size is 4096 bytes Nov 23 12:50:13.677501 dv-cinder-818886-1-iscsi devstack@n-api.service[86133]: detected max file descriptor number: 2048 Nov 23 12:50:13.677501 dv-cinder-818886-1-iscsi devstack@n-api.service[86133]: lock engine: pthread robust mutexes Nov 23 12:50:13.679059 dv-cinder-818886-1-iscsi devstack@n-api.service[86133]: thunder lock: enabled Nov 23 12:50:13.679059 dv-cinder-818886-1-iscsi devstack@n-api.service[86133]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 23 12:50:13.679059 dv-cinder-818886-1-iscsi devstack@n-api.service[86133]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Nov 23 12:50:13.718769 dv-cinder-818886-1-iscsi devstack@n-api.service[86133]: Python main interpreter initialized at 0x555b115de9c0 Nov 23 12:50:13.718769 dv-cinder-818886-1-iscsi devstack@n-api.service[86133]: python threads support enabled Nov 23 12:50:13.718769 dv-cinder-818886-1-iscsi devstack@n-api.service[86133]: your server socket listen backlog is limited to 100 connections Nov 23 12:50:13.718769 dv-cinder-818886-1-iscsi devstack@n-api.service[86133]: your mercy for graceful operations on workers is 90 seconds Nov 23 12:50:13.719373 dv-cinder-818886-1-iscsi devstack@n-api.service[86133]: mapped 403077 bytes (393 KB) for 2 cores Nov 23 12:50:13.719373 dv-cinder-818886-1-iscsi devstack@n-api.service[86133]: *** Operational MODE: preforking *** Nov 23 12:50:13.719759 dv-cinder-818886-1-iscsi devstack@n-api.service[86133]: *** uWSGI is running in multiple interpreter mode *** Nov 23 12:50:13.719759 dv-cinder-818886-1-iscsi devstack@n-api.service[86133]: spawned uWSGI master process (pid: 86133) Nov 23 12:50:13.720051 dv-cinder-818886-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Nov 23 12:50:13.722196 dv-cinder-818886-1-iscsi devstack@n-api.service[86133]: spawned uWSGI worker 1 (pid: 86134, cores: 1) Nov 23 12:50:13.722196 dv-cinder-818886-1-iscsi devstack@n-api.service[86133]: spawned uWSGI worker 2 (pid: 86135, cores: 1) Nov 23 12:50:13.722196 dv-cinder-818886-1-iscsi devstack@n-api.service[86133]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 23 12:50:17.963942 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 23 12:50:17.964791 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 23 12:50:17.964791 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 23 12:50:17.965056 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 23 12:50:17.965277 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 23 12:50:17.965696 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.966020 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.966340 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.966664 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.966993 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.967297 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.967601 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.967922 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.968251 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.968536 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.969062 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.969393 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-818886-1-iscsi {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.969724 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.970107 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.970419 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.970741 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.971043 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.971358 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.971662 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.972160 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.973360 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.973360 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.973360 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.973587 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.973841 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.974152 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.974474 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.974781 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.975105 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.975415 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.976564 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-818886-1-iscsi {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.976564 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.976564 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.977113 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.977478 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.978501 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.978821 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.979142 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.979467 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.979779 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.980114 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.980460 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.980795 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.981115 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.981425 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.981736 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.982053 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.982374 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.982681 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.982986 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.983234 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.983542 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.983865 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.984185 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.984584 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.984835 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.985086 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.985404 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.985721 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.986030 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.986337 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.986644 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.986950 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.987255 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.987568 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.987872 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.988177 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.988530 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.988845 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.988968 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 23 12:50:17.989468 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.989600 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 23 12:50:17.989732 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.989861 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 23 12:50:17.989989 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.990110 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 23 12:50:17.990230 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.60 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.990358 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 23 12:50:17.990488 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.60 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.990617 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.990744 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.990910 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.991035 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.991225 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.991368 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.991535 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.991659 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.991859 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.991985 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.992161 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.992314 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.992511 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.992635 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.992818 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.992944 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.993126 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.993353 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.993353 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.993598 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.993720 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.993839 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.993967 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-818886-1-iscsi {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.994096 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.994269 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.994408 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.994565 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.994689 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.994863 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.994995 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.995174 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.995308 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.995472 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.995613 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.995773 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.995897 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.996069 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.996193 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.996389 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.996601 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.996755 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.996907 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.997041 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.997206 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.997344 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.997509 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.997633 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.997838 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.997975 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.998143 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.998276 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.998445 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.998568 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.998747 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.998885 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.999048 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.999750 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:17.999750 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.000068 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.000314 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.000440 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.000573 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.000701 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-818886-1-iscsi {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.000829 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.000950 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.001081 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.001081 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.001316 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.001437 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.001563 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.001706 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.002540 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.002670 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.002801 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.002923 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.003055 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.003188 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.003311 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.003440 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.003562 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.003683 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.003812 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.003941 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.004067 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.004187 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.004334 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.004471 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.004679 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.004803 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.004924 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.005044 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.005164 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.005301 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.005424 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.005552 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.005673 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.005801 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.005922 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.006059 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.006181 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.006300 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.006421 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.006542 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.006670 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.006800 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.006927 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.007048 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.007168 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.007288 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.007406 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.007629 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.007809 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.007943 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.008068 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.008191 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.008359 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.008494 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.008620 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.008832 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.009019 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.009162 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.009304 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.009436 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.009559 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.009688 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.009820 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.009956 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.010078 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.010285 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.010464 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.010595 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.010727 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.010863 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.011061 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.011240 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.011373 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.011502 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.011704 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.011906 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.012051 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.012178 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.012403 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.012528 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.012649 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.012788 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.012955 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.013088 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.60 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.013296 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.013474 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.60 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.013620 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.013755 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.013889 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.014019 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.014221 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.014404 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.014551 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.014686 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.014809 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.014932 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.015143 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.015321 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.015468 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.015643 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.015829 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.016011 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.016188 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.016395 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.016533 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.016780 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.016957 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.017091 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.017227 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.017431 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.017624 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.017763 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.017871 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.017996 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.018120 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.018253 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.018376 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.018921 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.019101 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.019234 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.019357 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.019493 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.019627 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.019750 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.019871 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.020077 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.020302 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.020459 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.020588 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.020710 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.020846 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.020968 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.021100 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.021237 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.021460 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.021649 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.021782 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.021906 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.022043 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.022157 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.022368 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.022550 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.022663 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.022804 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.022940 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.023071 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.023227 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.023366 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.023562 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.023740 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.023886 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.024018 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.024141 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.024301 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.024428 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.024557 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.024738 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.024878 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.025040 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.025182 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.025376 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.025555 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.025708 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.025835 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.025958 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.026081 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.026210 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.026332 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.026547 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.026740 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.026880 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.027012 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.027150 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.027273 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.027404 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.027535 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.027679 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.027814 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.028028 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.028206 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.028395 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.028527 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.028666 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.028797 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.028926 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.029055 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.029187 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.029318 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.029450 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.029578 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.029723 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.029852 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.030059 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.030238 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.030388 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.030527 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.030661 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.030794 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.030924 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.031061 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.031282 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.031504 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.031769 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.031961 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.032096 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.032221 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.032508 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.032641 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.032783 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.032925 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.033038 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.033260 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:50:18.033395 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.033594 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.033724 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.033911 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.034039 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.034215 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.034344 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.034525 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.034668 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.034821 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.034950 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.035134 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.035263 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.035436 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.035579 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.035705 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.035828 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.036025 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.036148 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.036378 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.036518 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.036679 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.036806 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.036985 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.037112 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.037283 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.037419 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.037572 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.037698 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.037895 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.038023 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.038215 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.038345 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.038521 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.038661 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.038821 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.038950 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.039141 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.039277 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.039430 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.039559 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.039749 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.039875 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.040055 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.040192 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.040387 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.040509 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.040682 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.040824 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.041008 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.041139 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.041310 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.041453 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.041627 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.041755 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.041914 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.042043 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.042222 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.042348 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.042539 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.042677 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.042846 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.042975 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.043154 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.043290 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.043460 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.043598 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.043769 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.043898 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.044073 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.044207 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.044383 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.044522 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.044694 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.044817 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.045000 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.045125 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.045304 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.045438 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.045603 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.045736 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.045900 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.046025 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.046199 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.046326 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.046501 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.046626 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.046835 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.047083 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.047366 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.047550 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.047675 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.047941 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.048067 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.048300 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.048447 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.048641 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.048768 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.048945 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.049070 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.049258 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.049392 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.049565 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.049688 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.049875 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.050000 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.050183 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.050321 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.050488 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.050614 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.050798 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.050923 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.051108 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.051235 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.051413 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.051536 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.051716 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.051839 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.052025 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.052148 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.052349 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.052474 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.052652 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.052785 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.052960 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.053086 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.053264 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.053395 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.053568 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.053700 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.053875 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.054000 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.054186 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.054309 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.054491 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.054665 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.054797 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.054926 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.055107 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.055229 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.055420 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.055553 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.055717 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.055847 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.056036 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.056206 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.056382 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.056502 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.056666 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.056800 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.056961 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.057076 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.057264 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.057404 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.057563 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.057688 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.057863 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.057995 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.058161 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.058306 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.058465 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.058576 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.058760 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.058883 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.059060 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.059185 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.059358 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.059655 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.059804 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.059927 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.060320 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.060576 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.060709 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.060830 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.060951 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.061072 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.061203 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.061325 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.061445 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.061574 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.061695 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.061815 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.062017 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.062143 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.062263 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.062391 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.062520 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.062977 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.063109 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.063363 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.063554 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.063710 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.063968 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.064142 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.064317 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.064480 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.064619 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.064760 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.064904 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.065053 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.065221 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.065367 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.065503 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.065656 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.065792 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.065940 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.066078 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.066219 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.066365 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.066525 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.066662 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.066817 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.066963 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.067135 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.067277 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.067420 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.067577 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.067728 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.067870 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.068020 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.068288 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.068430 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.068620 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.068756 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.068881 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.069013 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.069170 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.069294 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.069428 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.069556 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.069681 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.069806 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.069938 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.070064 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.070210 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.070346 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.070474 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.070599 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.070727 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.071015 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.071173 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.071320 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.071463 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.071603 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.071763 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.071916 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.072060 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.072207 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.072368 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.072540 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.072681 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.072838 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.073015 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.073154 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.073299 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.073435 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.073575 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.073722 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.073850 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.073987 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.074127 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.074263 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.074393 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.074539 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.074678 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.074827 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.074968 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.075110 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.075270 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.075411 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.075554 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.075708 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.075848 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.075985 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.076137 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.076292 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.076450 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.076597 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.076733 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.076897 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.077043 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.077197 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.077345 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.077503 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.077656 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.077799 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.077942 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.078137 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.078286 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.078490 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.078759 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.078914 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.079156 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.079320 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.079456 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.079635 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.079783 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.079929 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.080072 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.080231 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.080423 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.080568 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.080711 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.080854 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.080999 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.081286 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.081443 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.081585 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.081737 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.081894 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.082060 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.082205 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.082357 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.082508 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.082645 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.082786 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.082947 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.083101 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.083252 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.083252 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.083516 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.083660 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.083818 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.083977 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.084120 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.084288 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.084423 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.084581 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.084740 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.084858 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.084984 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.085082 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.085316 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.085422 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.085640 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.085736 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.085963 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.086105 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.086243 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.086368 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.086549 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.086641 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.086844 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.086943 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.087139 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.087240 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.087452 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.087623 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.087759 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.087888 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.088017 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.088170 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.088347 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.088476 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.088640 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.088825 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.088963 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.089119 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.089578 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.089729 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.089870 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.090015 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.090174 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.090303 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.090435 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.090567 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.090704 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.090855 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.091010 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.091152 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.091291 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.091429 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.091574 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.091729 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.091884 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.092022 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.092164 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.092328 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.092454 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.092593 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.092754 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.092894 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.093035 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.093173 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.093681 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.093831 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.093986 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.094130 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.094377 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.094525 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.094525 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.094808 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.094945 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.094945 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.095201 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.095334 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.095466 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.095661 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.095796 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.095931 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.096074 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.096212 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.096373 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.096523 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.096796 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.096942 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.097072 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.097205 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.097339 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.097489 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.097621 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.097752 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.097892 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.098027 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.098171 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.098320 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.098463 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.098601 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.098740 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.098874 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.099021 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.099148 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.099303 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.099450 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.099590 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.099723 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.099859 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.100012 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.100153 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.100319 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.100485 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.100629 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.100774 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.100923 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.101074 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.101214 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.101351 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.101501 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.101673 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.101842 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.101983 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.102135 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.102280 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.102431 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.102571 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.102722 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.102863 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.103010 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.103166 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.103320 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.103492 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.103645 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.103793 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.103933 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.104072 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.104208 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.104411 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.104556 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.104705 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.104853 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.104989 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.105132 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.105291 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.105426 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.105576 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.105709 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.105843 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.105981 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.106128 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.106330 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.106470 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.106608 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.106763 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.107069 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.107334 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.107485 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.107618 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.107763 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.107898 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.108049 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.108194 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.108372 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.108572 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.108713 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.108937 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.109102 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.109396 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.109601 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.109793 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.110050 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.110250 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.110687 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.110902 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.111099 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.111287 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.111513 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.111705 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.111919 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.112111 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.112402 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.112612 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.112814 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.113009 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.113213 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.113408 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.113595 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.113796 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.113991 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.114206 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.114399 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.114587 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.114789 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.114982 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.115183 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.115382 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.115575 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.115760 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.115959 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.116159 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.116478 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.116685 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.116881 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.117067 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.117270 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.117460 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.117667 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.117871 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.118062 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.118263 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.118459 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.118659 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.118875 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.119064 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.119257 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.119436 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.119623 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.119810 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.120010 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.120211 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.120493 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.120679 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.120868 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.121080 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.121290 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.121500 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.121705 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.121910 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.122106 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.122303 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.122514 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.122708 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.122897 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.123092 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.123266 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.123393 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.123525 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.123655 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.123777 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.123901 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.124095 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.124334 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.124532 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.124737 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.124982 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.125180 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.125508 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.125718 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.125718 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.126098 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.126294 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.126493 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.126493 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.126859 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.127052 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.127260 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.127260 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.127632 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.127820 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.128022 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.128298 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.128495 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.128689 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.128880 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.129100 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.129310 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.129310 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.129688 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.129903 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.130117 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.130332 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.130529 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.130731 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.130924 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.131132 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.131316 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.131505 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.131635 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.131804 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.131998 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.132204 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.132466 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.132665 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.132864 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.133070 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.133271 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.133445 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.133631 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.133830 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.134026 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.134227 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.134424 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.134623 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.134830 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.135021 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.135211 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.135400 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.135595 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.135796 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.136009 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.136204 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.136708 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.137100 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.137284 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.137475 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.137690 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.137889 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.138086 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.138278 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.138447 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.138616 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.138819 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.139012 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.139209 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.139401 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.139586 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.139804 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.139994 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.140192 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.140463 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.140762 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.140954 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.141166 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.141369 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.141568 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.141762 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.141957 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.142148 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.142358 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.142559 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.142753 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.142951 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.143149 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.143359 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.143912 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.144104 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.144104 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.144492 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.144677 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.144996 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.145203 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.145394 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.145575 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.145762 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.145959 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.146171 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.146350 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.146590 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.146798 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.147005 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.147193 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.147329 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.147456 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.147660 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.147864 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.148060 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.148226 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.148443 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.148565 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.148700 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.148823 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.148970 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.149102 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.149224 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.149344 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.149477 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.149590 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.149698 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.149818 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.149938 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.150066 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.150199 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.150321 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.150441 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.150561 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.150693 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.150833 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.150955 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.151065 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.151192 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.151313 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.151439 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.151569 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.151691 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.151810 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.151929 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.152047 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.152177 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.152376 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.152497 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.152629 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.152750 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.152877 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.153007 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.153129 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.153248 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.153369 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.153493 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.153621 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.153750 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.153878 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.154006 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.154174 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.154294 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.154430 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.154638 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.154770 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.154899 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.155019 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.155171 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.155302 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.155431 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.155552 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.155671 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.155791 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.155910 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.156038 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.156260 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.156461 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.156461 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.156725 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.156725 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.156962 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.157068 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.157187 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.157348 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.157479 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.157600 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.157728 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.157728 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.157956 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.158075 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.158194 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.158323 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.158444 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.158574 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.158695 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.158815 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.158934 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.159062 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.159191 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.159312 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.159431 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.159551 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.159662 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.159789 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.159911 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.160038 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.160159 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.160315 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.160438 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.160571 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.160699 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.160820 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.160820 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.161046 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.161174 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.161280 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.161399 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.161525 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.161525 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.161762 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.161889 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.162011 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.162129 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.162129 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.162360 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.162489 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.162617 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.162747 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.162866 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.162985 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.163108 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.163227 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.163363 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.163484 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.163602 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.163722 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.163841 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.163964 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.164091 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.164212 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.164363 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.164486 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.164606 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.164741 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.164863 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.164982 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.165101 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.165220 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.165339 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.165489 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.165489 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.165718 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.165837 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.165958 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.166077 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.166209 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.166331 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.166450 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.166569 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.166688 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.166806 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.166944 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.167072 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.167184 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.167301 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.167427 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.167560 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.167681 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.167807 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.167936 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.168058 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.168185 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.168377 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.168501 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.168629 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.168755 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.168875 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.168995 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.169130 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.169292 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.169423 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.169552 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.169679 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.169798 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.169926 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.170054 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.170193 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.170315 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.170433 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.170566 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.170690 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.170818 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.170944 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.171071 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.171190 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.171318 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.171439 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.171559 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.171677 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.171827 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.171984 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.172126 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.172126 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.172377 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.172498 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.172617 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.172753 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.172883 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.173002 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.173126 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.173246 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.173366 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.173493 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.173614 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.173733 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.173854 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.173972 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.174091 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.174091 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.174330 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.174456 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.174575 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.174694 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.174694 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.174929 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.175048 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.175167 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.175287 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.175407 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.175534 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.175655 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.175655 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.175880 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.175880 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.176106 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.176304 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.176429 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.176429 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.176657 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.176788 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.176909 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.177041 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.177170 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.177289 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.177410 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.177529 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.177734 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.177867 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.177988 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.178109 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.178228 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.178355 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.178489 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.178618 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.178746 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.178867 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.178987 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.179107 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.179238 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.179362 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.179481 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.179602 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.179729 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.179850 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.179977 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.180105 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.180250 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.180375 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.180494 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.180636 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.180759 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.180879 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.180998 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.181134 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.181256 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.181385 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.181505 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.181631 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.181754 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.181859 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.181978 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.182128 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.182250 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.182380 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.182501 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.182621 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.182741 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.182925 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.183057 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.183226 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.183380 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.183511 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.183721 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.183848 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.184043 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.184170 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.184391 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.184517 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.184708 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.184840 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.185008 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.185133 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.185323 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.185446 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.185621 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.185745 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.185938 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.186107 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.186265 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.186460 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.186594 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.186797 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.186922 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.187132 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.187256 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.187524 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.187655 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.187864 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.187987 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.188187 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.188523 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.188663 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.188828 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.188962 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.189128 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.189249 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.189438 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.189571 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.189739 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.189863 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.190048 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.190165 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.190355 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.190492 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.190661 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.190785 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.190959 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.191086 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.191275 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.191418 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.191576 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.191702 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.191875 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.192002 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.192187 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.192372 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.192514 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.192637 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.192830 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.192957 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.193133 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.193256 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.193439 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.193562 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.193767 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.193890 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.194082 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.194208 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.194395 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.194646 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.194773 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.194985 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.195124 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.195342 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.195468 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.195627 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.195764 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.195932 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.196056 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.196272 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.196409 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.196587 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.196710 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.196887 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.197012 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.197205 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.197331 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.197510 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.197628 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.197812 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.197950 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.198121 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.198244 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.198425 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.198558 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.198728 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.198851 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.199032 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.199163 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.199347 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.199564 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.199690 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.199875 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.200004 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.200179 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.200313 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.200522 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.200652 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.200862 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.200995 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.201177 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.201302 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.201492 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.201626 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.201951 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.202101 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.202224 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.202692 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.202829 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.202951 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=86134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 23 12:50:18.203127 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.203127 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.203513 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.203921 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.204464 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.204788 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.205092 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.205529 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.205834 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.206152 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.207717 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.207717 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.207717 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.207717 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.207717 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.208698 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.208698 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.208698 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.209169 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.209386 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.209552 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.209855 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.210166 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.210487 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.210812 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.211125 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.211434 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.211803 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.212046 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.212504 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.212768 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.213011 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.213323 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.213627 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.213941 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.214361 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.214562 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.214866 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.215175 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.215525 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.215795 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.216158 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.216457 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.216773 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.217079 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.217393 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.217697 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.218018 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.218327 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.218682 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.218995 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.219547 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.220007 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.220349 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.220923 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.221076 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.221426 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.221738 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.222309 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.222510 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.222733 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.224288 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.224288 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.224288 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.224288 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.224288 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.224726 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.224893 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.225206 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.225519 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.225833 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.226144 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.226453 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.226780 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.227109 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.227423 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.227748 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.228096 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.228478 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.228769 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.229088 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:50:18.229326 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=86135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 23 12:50:18.239589 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG oslo_db.sqlalchemy.engines [None req-b7368b20-dba3-4232-a0cf-c0ad84a79fe4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86134) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Nov 23 12:50:18.263807 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG oslo_db.sqlalchemy.engines [None req-37792a16-4f2b-4640-9eec-00c7953e4c9d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86135) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Nov 23 12:50:18.486260 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.context [None req-b7368b20-dba3-4232-a0cf-c0ad84a79fe4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac(cell1) {{(pid=86134) load_cells /opt/stack/nova/nova/context.py:464}} Nov 23 12:50:18.490450 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG oslo_concurrency.lockutils [None req-b7368b20-dba3-4232-a0cf-c0ad84a79fe4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=86134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:50:18.492116 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG oslo_concurrency.lockutils [None req-b7368b20-dba3-4232-a0cf-c0ad84a79fe4 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=86134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:50:18.492975 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG oslo_concurrency.lockutils [None req-b7368b20-dba3-4232-a0cf-c0ad84a79fe4 None None] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=86134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:50:18.494943 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG oslo_concurrency.lockutils [None req-b7368b20-dba3-4232-a0cf-c0ad84a79fe4 None None] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=86134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:50:18.523004 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG oslo_db.sqlalchemy.engines [None req-b7368b20-dba3-4232-a0cf-c0ad84a79fe4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86134) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Nov 23 12:50:18.524087 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG oslo_db.sqlalchemy.engines [None req-b7368b20-dba3-4232-a0cf-c0ad84a79fe4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86134) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Nov 23 12:50:18.560561 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG oslo_db.sqlalchemy.engines [None req-b7368b20-dba3-4232-a0cf-c0ad84a79fe4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86134) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Nov 23 12:50:18.647522 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.context [None req-37792a16-4f2b-4640-9eec-00c7953e4c9d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac(cell1) {{(pid=86135) load_cells /opt/stack/nova/nova/context.py:464}} Nov 23 12:50:18.651788 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG oslo_concurrency.lockutils [None req-37792a16-4f2b-4640-9eec-00c7953e4c9d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=86135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:50:18.653494 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG oslo_concurrency.lockutils [None req-37792a16-4f2b-4640-9eec-00c7953e4c9d None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=86135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:50:18.654315 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG oslo_concurrency.lockutils [None req-37792a16-4f2b-4640-9eec-00c7953e4c9d None None] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=86135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:50:18.656517 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG oslo_concurrency.lockutils [None req-37792a16-4f2b-4640-9eec-00c7953e4c9d None None] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=86135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:50:18.688182 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG oslo_db.sqlalchemy.engines [None req-37792a16-4f2b-4640-9eec-00c7953e4c9d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86135) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Nov 23 12:50:18.689219 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG oslo_db.sqlalchemy.engines [None req-37792a16-4f2b-4640-9eec-00c7953e4c9d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86135) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Nov 23 12:50:18.729875 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG oslo_db.sqlalchemy.engines [None req-37792a16-4f2b-4640-9eec-00c7953e4c9d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86135) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Nov 23 12:50:18.752740 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: INFO keyring.backend [None req-b7368b20-dba3-4232-a0cf-c0ad84a79fe4 None None] Loading KWallet Nov 23 12:50:18.763022 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: INFO keyring.backend [None req-b7368b20-dba3-4232-a0cf-c0ad84a79fe4 None None] Loading SecretService Nov 23 12:50:18.766693 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 23 12:50:18.766693 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: from cryptography.utils import int_from_bytes Nov 23 12:50:18.766693 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 23 12:50:18.766693 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: from cryptography.utils import int_from_bytes Nov 23 12:50:18.768366 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: INFO keyring.backend [None req-b7368b20-dba3-4232-a0cf-c0ad84a79fe4 None None] Loading Windows Nov 23 12:50:18.770296 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: INFO keyring.backend [None req-b7368b20-dba3-4232-a0cf-c0ad84a79fe4 None None] Loading chainer Nov 23 12:50:18.771190 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: INFO keyring.backend [None req-b7368b20-dba3-4232-a0cf-c0ad84a79fe4 None None] Loading macOS Nov 23 12:50:18.878984 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: INFO keyring.backend [None req-37792a16-4f2b-4640-9eec-00c7953e4c9d None None] Loading KWallet Nov 23 12:50:18.887751 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: INFO keyring.backend [None req-37792a16-4f2b-4640-9eec-00c7953e4c9d None None] Loading SecretService Nov 23 12:50:18.891258 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 23 12:50:18.891258 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: from cryptography.utils import int_from_bytes Nov 23 12:50:18.891560 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 23 12:50:18.891560 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: from cryptography.utils import int_from_bytes Nov 23 12:50:18.892302 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: INFO keyring.backend [None req-37792a16-4f2b-4640-9eec-00c7953e4c9d None None] Loading Windows Nov 23 12:50:18.895701 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: INFO keyring.backend [None req-37792a16-4f2b-4640-9eec-00c7953e4c9d None None] Loading chainer Nov 23 12:50:18.896512 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: INFO keyring.backend [None req-37792a16-4f2b-4640-9eec-00c7953e4c9d None None] Loading macOS Nov 23 12:50:19.131157 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: WARNING keystonemiddleware.auth_token [None req-b7368b20-dba3-4232-a0cf-c0ad84a79fe4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 23 12:50:19.138638 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: WARNING keystonemiddleware.auth_token [None req-b7368b20-dba3-4232-a0cf-c0ad84a79fe4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 23 12:50:19.257966 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: WARNING keystonemiddleware.auth_token [None req-37792a16-4f2b-4640-9eec-00c7953e4c9d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 23 12:50:19.264754 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: WARNING keystonemiddleware.auth_token [None req-37792a16-4f2b-4640-9eec-00c7953e4c9d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 23 12:50:19.356030 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: WARNING keystonemiddleware.auth_token [None req-b7368b20-dba3-4232-a0cf-c0ad84a79fe4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 23 12:50:19.361323 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: WARNING keystonemiddleware.auth_token [None req-b7368b20-dba3-4232-a0cf-c0ad84a79fe4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 23 12:50:19.366767 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x555b115de9c0 pid: 86134 (default app) Nov 23 12:50:19.368921 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi [None req-b7368b20-dba3-4232-a0cf-c0ad84a79fe4 None None] Calling method '>' {{(pid=86134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:50:19.370041 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: INFO nova.api.openstack.requestlog [None req-b7368b20-dba3-4232-a0cf-c0ad84a79fe4 None None] 10.222.0.60 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001727 Nov 23 12:50:19.370458 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: [pid: 86134|app: 0|req: 1/1] 10.222.0.60 () {50 vars in 788 bytes} [Tue Nov 23 12:50:19 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 12:50:19.481093 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: WARNING keystonemiddleware.auth_token [None req-37792a16-4f2b-4640-9eec-00c7953e4c9d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 23 12:50:19.486425 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: WARNING keystonemiddleware.auth_token [None req-37792a16-4f2b-4640-9eec-00c7953e4c9d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 23 12:50:19.491793 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x555b115de9c0 pid: 86135 (default app) Nov 23 12:51:45.034931 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi [None req-b7368b20-dba3-4232-a0cf-c0ad84a79fe4 None None] Calling method '>' {{(pid=86134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:51:45.036611 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: INFO nova.api.openstack.requestlog [None req-b7368b20-dba3-4232-a0cf-c0ad84a79fe4 None None] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002506 Nov 23 12:51:45.037318 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: [pid: 86134|app: 0|req: 2/2] 10.222.0.60 () {54 vars in 930 bytes} [Tue Nov 23 12:51:45 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 12:51:45.568630 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi [None req-96024b01-3281-4110-87ac-4cf71dcf3f31 admin admin] Calling method '>' {{(pid=86135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:51:45.716306 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: INFO nova.api.openstack.requestlog [None req-96024b01-3281-4110-87ac-4cf71dcf3f31 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.666861 Nov 23 12:51:45.716846 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: [pid: 86135|app: 0|req: 1/3] 10.222.0.60 () {60 vars in 1291 bytes} [Tue Nov 23 12:51:45 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 12:51:47.921689 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi [None req-b7368b20-dba3-4232-a0cf-c0ad84a79fe4 None None] Calling method '>' {{(pid=86134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:51:47.922670 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: INFO nova.api.openstack.requestlog [None req-b7368b20-dba3-4232-a0cf-c0ad84a79fe4 None None] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Nov 23 12:51:47.923345 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: [pid: 86134|app: 0|req: 3/4] 10.222.0.60 () {54 vars in 930 bytes} [Tue Nov 23 12:51:47 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 12:51:47.995757 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi [None req-1013a1af-940e-4e26-9c34-f021f8740d01 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "ram": 256, "os-flavor-access:is_public": true, "vcpus": 1, "disk": 1}} {{(pid=86135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 12:51:48.014849 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 12:51:48.014849 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: warnings.warn(msg) Nov 23 12:51:48.047475 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: INFO nova.api.openstack.requestlog [None req-1013a1af-940e-4e26-9c34-f021f8740d01 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.117292 Nov 23 12:51:48.048129 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: [pid: 86135|app: 0|req: 2/5] 10.222.0.60 () {64 vars in 1282 bytes} [Tue Nov 23 12:51:47 2021] POST /compute/v2.1/flavors => generated 407 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 12:51:48.391802 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi [None req-0c9fd7e0-7269-4199-ae21-cabf03ed1d22 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=86134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 12:51:48.394790 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 12:51:48.394790 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: warnings.warn(msg) Nov 23 12:51:48.567289 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: INFO nova.api.openstack.requestlog [None req-0c9fd7e0-7269-4199-ae21-cabf03ed1d22 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.504814 Nov 23 12:51:48.567910 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: [pid: 86134|app: 0|req: 4/6] 10.222.0.60 () {64 vars in 1335 bytes} [Tue Nov 23 12:51:48 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 12:51:50.793998 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi [None req-1013a1af-940e-4e26-9c34-f021f8740d01 admin admin] Calling method '>' {{(pid=86135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:51:50.795744 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: INFO nova.api.openstack.requestlog [None req-1013a1af-940e-4e26-9c34-f021f8740d01 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002068 Nov 23 12:51:50.796382 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: [pid: 86135|app: 0|req: 3/7] 10.222.0.60 () {54 vars in 930 bytes} [Tue Nov 23 12:51:50 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 12:51:50.926771 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi [None req-519fd96a-1f5a-4adb-9b49-30af4e3a7225 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "disk": 5, "id": "d1", "swap": 0, "vcpus": 1, "ram": 512, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=86134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 12:51:50.945379 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 12:51:50.945379 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: warnings.warn(msg) Nov 23 12:51:50.973037 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: INFO nova.api.openstack.requestlog [None req-519fd96a-1f5a-4adb-9b49-30af4e3a7225 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.168627 Nov 23 12:51:50.973508 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: [pid: 86134|app: 0|req: 5/8] 10.222.0.60 () {64 vars in 1282 bytes} [Tue Nov 23 12:51:50 2021] POST /compute/v2.1/flavors => generated 404 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 12:51:50.990221 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi [None req-5bc66d4d-aa57-41b3-86ac-2ac833ac6de0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=86135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 12:51:50.993056 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 12:51:50.993056 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: warnings.warn(msg) Nov 23 12:51:51.042907 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: INFO nova.api.openstack.requestlog [None req-5bc66d4d-aa57-41b3-86ac-2ac833ac6de0 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.060372 Nov 23 12:51:51.043521 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: [pid: 86135|app: 0|req: 4/9] 10.222.0.60 () {64 vars in 1335 bytes} [Tue Nov 23 12:51:50 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 12:51:53.256415 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi [None req-519fd96a-1f5a-4adb-9b49-30af4e3a7225 admin admin] Calling method '>' {{(pid=86134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:51:53.257417 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: INFO nova.api.openstack.requestlog [None req-519fd96a-1f5a-4adb-9b49-30af4e3a7225 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 Nov 23 12:51:53.258070 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: [pid: 86134|app: 0|req: 6/10] 10.222.0.60 () {54 vars in 930 bytes} [Tue Nov 23 12:51:53 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 12:51:53.322014 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi [None req-3e955a15-ad73-4c7b-a4a4-a56fcb15e6cc admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "name": "ds1G", "disk": 10, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=86135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 12:51:53.348534 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: INFO nova.api.openstack.requestlog [None req-3e955a15-ad73-4c7b-a4a4-a56fcb15e6cc admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.083434 Nov 23 12:51:53.349116 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: [pid: 86135|app: 0|req: 5/11] 10.222.0.60 () {64 vars in 1282 bytes} [Tue Nov 23 12:51:53 2021] POST /compute/v2.1/flavors => generated 404 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 12:51:53.361382 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi [None req-8cecc767-e66c-466d-aaa1-6aaa12d92f35 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=86134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 12:51:53.399458 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: INFO nova.api.openstack.requestlog [None req-8cecc767-e66c-466d-aaa1-6aaa12d92f35 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042062 Nov 23 12:51:53.400093 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: [pid: 86134|app: 0|req: 7/12] 10.222.0.60 () {64 vars in 1335 bytes} [Tue Nov 23 12:51:53 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 12:51:55.626038 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi [None req-3e955a15-ad73-4c7b-a4a4-a56fcb15e6cc admin admin] Calling method '>' {{(pid=86135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:51:55.627254 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: INFO nova.api.openstack.requestlog [None req-3e955a15-ad73-4c7b-a4a4-a56fcb15e6cc admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001840 Nov 23 12:51:55.627846 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: [pid: 86135|app: 0|req: 6/13] 10.222.0.60 () {54 vars in 930 bytes} [Tue Nov 23 12:51:55 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 12:51:55.695522 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi [None req-1e4e3dad-8f21-4a6d-90ab-599803ce95b7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 2048, "id": "d3", "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "ds2G", "rxtx_factor": 1.0, "vcpus": 2}} {{(pid=86134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 12:51:55.722648 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: INFO nova.api.openstack.requestlog [None req-1e4e3dad-8f21-4a6d-90ab-599803ce95b7 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.084824 Nov 23 12:51:55.723221 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: [pid: 86134|app: 0|req: 8/14] 10.222.0.60 () {64 vars in 1282 bytes} [Tue Nov 23 12:51:55 2021] POST /compute/v2.1/flavors => generated 404 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 12:51:55.735110 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi [None req-29912c59-fd82-439e-9345-4cb005bfbf85 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=86135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 12:51:55.771886 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: INFO nova.api.openstack.requestlog [None req-29912c59-fd82-439e-9345-4cb005bfbf85 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040569 Nov 23 12:51:55.772548 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: [pid: 86135|app: 0|req: 7/15] 10.222.0.60 () {64 vars in 1335 bytes} [Tue Nov 23 12:51:55 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 12:51:58.035299 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi [None req-1e4e3dad-8f21-4a6d-90ab-599803ce95b7 admin admin] Calling method '>' {{(pid=86134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:51:58.036393 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: INFO nova.api.openstack.requestlog [None req-1e4e3dad-8f21-4a6d-90ab-599803ce95b7 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001559 Nov 23 12:51:58.036815 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: [pid: 86134|app: 0|req: 9/16] 10.222.0.60 () {54 vars in 930 bytes} [Tue Nov 23 12:51:58 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 12:51:58.110840 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi [None req-a1c33e44-e581-4e8b-97f7-dc9ee7379bf7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "swap": 0, "rxtx_factor": 1.0, "id": "d4", "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "disk": 20, "os-flavor-access:is_public": true}} {{(pid=86135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 12:51:58.137355 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: INFO nova.api.openstack.requestlog [None req-a1c33e44-e581-4e8b-97f7-dc9ee7379bf7 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.093112 Nov 23 12:51:58.137943 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: [pid: 86135|app: 0|req: 8/17] 10.222.0.60 () {64 vars in 1282 bytes} [Tue Nov 23 12:51:58 2021] POST /compute/v2.1/flavors => generated 404 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 12:51:58.151695 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi [None req-e97bd3a9-39c3-4864-9e51-1fd5f3f9193d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=86134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 12:51:58.191318 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: INFO nova.api.openstack.requestlog [None req-e97bd3a9-39c3-4864-9e51-1fd5f3f9193d admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044246 Nov 23 12:51:58.191923 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: [pid: 86134|app: 0|req: 10/18] 10.222.0.60 () {64 vars in 1335 bytes} [Tue Nov 23 12:51:58 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 12:52:00.471008 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi [None req-a1c33e44-e581-4e8b-97f7-dc9ee7379bf7 admin admin] Calling method '>' {{(pid=86135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:52:00.472168 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: INFO nova.api.openstack.requestlog [None req-a1c33e44-e581-4e8b-97f7-dc9ee7379bf7 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001621 Nov 23 12:52:00.472693 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: [pid: 86135|app: 0|req: 9/19] 10.222.0.60 () {54 vars in 930 bytes} [Tue Nov 23 12:52:00 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 12:52:00.538649 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi [None req-78a83509-8da3-4fdd-abff-a9c10344f93c admin admin] Calling method '>' {{(pid=86134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:52:00.562661 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: INFO nova.api.openstack.requestlog [None req-78a83509-8da3-4fdd-abff-a9c10344f93c admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.082961 Nov 23 12:52:00.563254 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: [pid: 86134|app: 0|req: 11/20] 10.222.0.60 () {60 vars in 1291 bytes} [Tue Nov 23 12:52:00 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 12:52:02.851589 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi [None req-a1c33e44-e581-4e8b-97f7-dc9ee7379bf7 admin admin] Calling method '>' {{(pid=86135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:52:02.852635 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: INFO nova.api.openstack.requestlog [None req-a1c33e44-e581-4e8b-97f7-dc9ee7379bf7 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Nov 23 12:52:02.853035 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: [pid: 86135|app: 0|req: 10/21] 10.222.0.60 () {54 vars in 930 bytes} [Tue Nov 23 12:52:02 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 12:52:02.918817 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi [None req-393d89f7-96f5-4431-a3fa-3b99354594b0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "1", "disk": 1, "os-flavor-access:is_public": true, "swap": 0, "ram": 512, "name": "m1.tiny", "vcpus": 1}} {{(pid=86134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 12:52:02.946078 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: INFO nova.api.openstack.requestlog [None req-393d89f7-96f5-4431-a3fa-3b99354594b0 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.086569 Nov 23 12:52:02.946681 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: [pid: 86134|app: 0|req: 12/22] 10.222.0.60 () {64 vars in 1282 bytes} [Tue Nov 23 12:52:02 2021] POST /compute/v2.1/flavors => generated 402 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 12:52:02.959423 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi [None req-c7a303f9-6b9f-49b9-975e-205a0fb0a6bd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=86135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 12:52:02.999392 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: INFO nova.api.openstack.requestlog [None req-c7a303f9-6b9f-49b9-975e-205a0fb0a6bd admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044022 Nov 23 12:52:03.000026 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: [pid: 86135|app: 0|req: 11/23] 10.222.0.60 () {64 vars in 1332 bytes} [Tue Nov 23 12:52:02 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 12:52:05.206595 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi [None req-393d89f7-96f5-4431-a3fa-3b99354594b0 admin admin] Calling method '>' {{(pid=86134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:52:05.207552 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: INFO nova.api.openstack.requestlog [None req-393d89f7-96f5-4431-a3fa-3b99354594b0 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Nov 23 12:52:05.207985 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: [pid: 86134|app: 0|req: 13/24] 10.222.0.60 () {54 vars in 930 bytes} [Tue Nov 23 12:52:05 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 12:52:05.275925 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi [None req-6b858c8a-7476-4d6c-bfc7-c46bde12910f admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "m1.small", "disk": 20, "ram": 2048, "vcpus": 1, "os-flavor-access:is_public": true}} {{(pid=86135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 12:52:05.305126 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: INFO nova.api.openstack.requestlog [None req-6b858c8a-7476-4d6c-bfc7-c46bde12910f admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.090438 Nov 23 12:52:05.305692 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: [pid: 86135|app: 0|req: 12/25] 10.222.0.60 () {64 vars in 1282 bytes} [Tue Nov 23 12:52:05 2021] POST /compute/v2.1/flavors => generated 405 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 12:52:05.318953 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi [None req-5b5a00a3-c35c-4060-b9bb-e14466aad41e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=86134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 12:52:05.359870 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: INFO nova.api.openstack.requestlog [None req-5b5a00a3-c35c-4060-b9bb-e14466aad41e admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044591 Nov 23 12:52:05.360788 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: [pid: 86134|app: 0|req: 14/26] 10.222.0.60 () {64 vars in 1332 bytes} [Tue Nov 23 12:52:05 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 12:52:07.619477 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi [None req-6b858c8a-7476-4d6c-bfc7-c46bde12910f admin admin] Calling method '>' {{(pid=86135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:52:07.620581 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: INFO nova.api.openstack.requestlog [None req-6b858c8a-7476-4d6c-bfc7-c46bde12910f admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Nov 23 12:52:07.620989 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: [pid: 86135|app: 0|req: 13/27] 10.222.0.60 () {54 vars in 930 bytes} [Tue Nov 23 12:52:07 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 12:52:07.693587 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi [None req-45842afd-be2b-4e22-a7bf-d7e83d083944 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "swap": 0, "vcpus": 2, "id": "3", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "disk": 40, "os-flavor-access:is_public": true}} {{(pid=86134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 12:52:07.735948 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: INFO nova.api.openstack.requestlog [None req-45842afd-be2b-4e22-a7bf-d7e83d083944 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.107608 Nov 23 12:52:07.736650 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: [pid: 86134|app: 0|req: 15/28] 10.222.0.60 () {64 vars in 1282 bytes} [Tue Nov 23 12:52:07 2021] POST /compute/v2.1/flavors => generated 406 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 12:52:07.757790 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi [None req-0cb37d17-708d-4a13-9a97-537f97bcc648 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=86135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 12:52:07.820275 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: INFO nova.api.openstack.requestlog [None req-0cb37d17-708d-4a13-9a97-537f97bcc648 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.069134 Nov 23 12:52:07.820847 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: [pid: 86135|app: 0|req: 14/29] 10.222.0.60 () {64 vars in 1332 bytes} [Tue Nov 23 12:52:07 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 12:52:10.062547 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi [None req-45842afd-be2b-4e22-a7bf-d7e83d083944 admin admin] Calling method '>' {{(pid=86134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:52:10.064044 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: INFO nova.api.openstack.requestlog [None req-45842afd-be2b-4e22-a7bf-d7e83d083944 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001697 Nov 23 12:52:10.064501 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: [pid: 86134|app: 0|req: 16/30] 10.222.0.60 () {54 vars in 930 bytes} [Tue Nov 23 12:52:10 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 12:52:10.127864 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi [None req-4d2d0191-03ce-4e10-8593-009f6d49a935 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 8192, "os-flavor-access:is_public": true, "name": "m1.large", "id": "4", "swap": 0}} {{(pid=86135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 12:52:10.153545 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: INFO nova.api.openstack.requestlog [None req-4d2d0191-03ce-4e10-8593-009f6d49a935 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.082532 Nov 23 12:52:10.154103 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: [pid: 86135|app: 0|req: 15/31] 10.222.0.60 () {64 vars in 1282 bytes} [Tue Nov 23 12:52:10 2021] POST /compute/v2.1/flavors => generated 405 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 12:52:10.166301 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi [None req-1d645309-987d-41e4-b0b2-25a339859078 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=86134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 12:52:10.204629 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: INFO nova.api.openstack.requestlog [None req-1d645309-987d-41e4-b0b2-25a339859078 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042014 Nov 23 12:52:10.205256 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: [pid: 86134|app: 0|req: 17/32] 10.222.0.60 () {64 vars in 1332 bytes} [Tue Nov 23 12:52:10 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 12:52:12.425392 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi [None req-4d2d0191-03ce-4e10-8593-009f6d49a935 admin admin] Calling method '>' {{(pid=86135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:52:12.426457 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: INFO nova.api.openstack.requestlog [None req-4d2d0191-03ce-4e10-8593-009f6d49a935 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Nov 23 12:52:12.426880 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: [pid: 86135|app: 0|req: 16/33] 10.222.0.60 () {54 vars in 930 bytes} [Tue Nov 23 12:52:12 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 12:52:12.495499 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi [None req-b7372ffb-a489-44dc-b059-3900ade60600 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "os-flavor-access:is_public": true, "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160, "vcpus": 8, "rxtx_factor": 1.0, "name": "m1.xlarge", "swap": 0}} {{(pid=86134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 12:52:12.526896 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: INFO nova.api.openstack.requestlog [None req-b7372ffb-a489-44dc-b059-3900ade60600 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.092831 Nov 23 12:52:12.527472 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: [pid: 86134|app: 0|req: 18/34] 10.222.0.60 () {64 vars in 1282 bytes} [Tue Nov 23 12:52:12 2021] POST /compute/v2.1/flavors => generated 408 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 12:52:12.540342 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi [None req-5f94dd7d-f2aa-41ec-8c4c-1b46ff5e381c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=86135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 12:52:12.581116 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: INFO nova.api.openstack.requestlog [None req-5f94dd7d-f2aa-41ec-8c4c-1b46ff5e381c admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044522 Nov 23 12:52:12.581719 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: [pid: 86135|app: 0|req: 17/35] 10.222.0.60 () {64 vars in 1332 bytes} [Tue Nov 23 12:52:12 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 12:53:21.424642 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi [None req-b7372ffb-a489-44dc-b059-3900ade60600 admin admin] Calling method '>' {{(pid=86134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:53:21.425631 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: INFO nova.api.openstack.requestlog [None req-b7372ffb-a489-44dc-b059-3900ade60600 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Nov 23 12:53:21.426031 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: [pid: 86134|app: 0|req: 19/36] 10.222.0.60 () {54 vars in 930 bytes} [Tue Nov 23 12:53:21 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 12:53:21.489559 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi [None req-6ecfa0c0-5390-4841-9824-dba8b1c1d2ad admin admin] Calling method '>' {{(pid=86135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:53:21.512946 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: INFO nova.api.openstack.requestlog [None req-6ecfa0c0-5390-4841-9824-dba8b1c1d2ad admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.080451 Nov 23 12:53:21.513490 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: [pid: 86135|app: 0|req: 18/37] 10.222.0.60 () {60 vars in 1291 bytes} [Tue Nov 23 12:53:21 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 12:53:22.924193 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi [None req-b7372ffb-a489-44dc-b059-3900ade60600 admin admin] Calling method '>' {{(pid=86134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:53:22.925225 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: INFO nova.api.openstack.requestlog [None req-b7372ffb-a489-44dc-b059-3900ade60600 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001554 Nov 23 12:53:22.925629 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: [pid: 86134|app: 0|req: 20/38] 10.222.0.60 () {56 vars in 1074 bytes} [Tue Nov 23 12:53:22 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 12:53:23.120010 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi [None req-df240da4-3fb8-4a19-bf36-029e91a48577 admin admin] Calling method '>' {{(pid=86135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:53:23.133458 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: INFO nova.api.openstack.wsgi [None req-df240da4-3fb8-4a19-bf36-029e91a48577 admin admin] HTTP exception thrown: Flavor 42 could not be found. Nov 23 12:53:23.134418 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi [None req-df240da4-3fb8-4a19-bf36-029e91a48577 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=86135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Nov 23 12:53:23.134823 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: INFO nova.api.openstack.requestlog [None req-df240da4-3fb8-4a19-bf36-029e91a48577 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.88 time: 0.071498 Nov 23 12:53:23.135364 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: [pid: 86135|app: 0|req: 19/39] 10.222.0.60 () {60 vars in 1190 bytes} [Tue Nov 23 12:53:23 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 23 12:53:23.145935 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi [None req-ef99d55e-7162-40ce-9b4f-ef015e1a9838 admin admin] Calling method '>' {{(pid=86134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:53:23.165950 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: INFO nova.api.openstack.requestlog [None req-ef99d55e-7162-40ce-9b4f-ef015e1a9838 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.023960 Nov 23 12:53:23.166493 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: [pid: 86134|app: 0|req: 21/40] 10.222.0.60 () {60 vars in 1210 bytes} [Tue Nov 23 12:53:23 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 12:53:23.176874 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi [None req-96ce6e94-4044-4c46-bfcb-2fb5728e6ab5 admin admin] Calling method '>' {{(pid=86135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:53:23.197745 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: INFO nova.api.openstack.requestlog [None req-96ce6e94-4044-4c46-bfcb-2fb5728e6ab5 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.024560 Nov 23 12:53:23.198309 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: [pid: 86135|app: 0|req: 20/41] 10.222.0.60 () {60 vars in 1210 bytes} [Tue Nov 23 12:53:23 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 12:53:23.212974 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi [None req-5355bd27-3d15-4b81-bfcb-406beb48aaff admin admin] Calling method '>' {{(pid=86134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:53:23.245837 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: INFO nova.api.openstack.wsgi [None req-5355bd27-3d15-4b81-bfcb-406beb48aaff admin admin] HTTP exception thrown: Flavor 42 could not be found. Nov 23 12:53:23.246893 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi [None req-5355bd27-3d15-4b81-bfcb-406beb48aaff admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=86134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Nov 23 12:53:23.248404 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: INFO nova.api.openstack.requestlog [None req-5355bd27-3d15-4b81-bfcb-406beb48aaff admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.88 time: 0.043444 Nov 23 12:53:23.249393 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: [pid: 86134|app: 0|req: 22/42] 10.222.0.60 () {60 vars in 1190 bytes} [Tue Nov 23 12:53:23 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 23 12:53:24.599853 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi [None req-96ce6e94-4044-4c46-bfcb-2fb5728e6ab5 admin admin] Calling method '>' {{(pid=86135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:53:24.600889 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: INFO nova.api.openstack.requestlog [None req-96ce6e94-4044-4c46-bfcb-2fb5728e6ab5 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001534 Nov 23 12:53:24.601305 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: [pid: 86135|app: 0|req: 21/43] 10.222.0.60 () {56 vars in 1074 bytes} [Tue Nov 23 12:53:24 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 12:53:24.805695 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi [None req-63b75dcf-0422-40c6-b94d-3248dc2defa5 admin admin] Calling method '>' {{(pid=86134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:53:24.818027 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: INFO nova.api.openstack.wsgi [None req-63b75dcf-0422-40c6-b94d-3248dc2defa5 admin admin] HTTP exception thrown: Flavor 84 could not be found. Nov 23 12:53:24.818598 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi [None req-63b75dcf-0422-40c6-b94d-3248dc2defa5 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=86134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Nov 23 12:53:24.819386 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: INFO nova.api.openstack.requestlog [None req-63b75dcf-0422-40c6-b94d-3248dc2defa5 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.88 time: 0.082127 Nov 23 12:53:24.819912 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: [pid: 86134|app: 0|req: 23/44] 10.222.0.60 () {60 vars in 1190 bytes} [Tue Nov 23 12:53:24 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 23 12:53:24.829825 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi [None req-326bb3b7-85cc-45b8-b5f4-512af5e8522c admin admin] Calling method '>' {{(pid=86135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:53:24.850062 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: INFO nova.api.openstack.requestlog [None req-326bb3b7-85cc-45b8-b5f4-512af5e8522c admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.023851 Nov 23 12:53:24.850656 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: [pid: 86135|app: 0|req: 22/45] 10.222.0.60 () {60 vars in 1210 bytes} [Tue Nov 23 12:53:24 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 12:53:24.860726 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi [None req-3973595e-409b-4090-b91e-9ea640b190f1 admin admin] Calling method '>' {{(pid=86134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:53:24.887916 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: INFO nova.api.openstack.requestlog [None req-3973595e-409b-4090-b91e-9ea640b190f1 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.030317 Nov 23 12:53:24.888838 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: [pid: 86134|app: 0|req: 24/46] 10.222.0.60 () {60 vars in 1210 bytes} [Tue Nov 23 12:53:24 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 12:53:24.901241 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi [None req-7af12e44-2e3f-407b-aad1-219c588bc16f admin admin] Calling method '>' {{(pid=86135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:53:24.914194 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: INFO nova.api.openstack.wsgi [None req-7af12e44-2e3f-407b-aad1-219c588bc16f admin admin] HTTP exception thrown: Flavor 84 could not be found. Nov 23 12:53:24.914714 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi [None req-7af12e44-2e3f-407b-aad1-219c588bc16f admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=86135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Nov 23 12:53:24.915526 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: INFO nova.api.openstack.requestlog [None req-7af12e44-2e3f-407b-aad1-219c588bc16f admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.88 time: 0.018131 Nov 23 12:53:24.916693 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: [pid: 86135|app: 0|req: 23/47] 10.222.0.60 () {60 vars in 1190 bytes} [Tue Nov 23 12:53:24 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Nov 23 12:53:26.266681 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi [None req-3973595e-409b-4090-b91e-9ea640b190f1 admin admin] Calling method '>' {{(pid=86134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:53:26.268016 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: INFO nova.api.openstack.requestlog [None req-3973595e-409b-4090-b91e-9ea640b190f1 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001597 Nov 23 12:53:26.268450 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: [pid: 86134|app: 0|req: 25/48] 10.222.0.60 () {56 vars in 1074 bytes} [Tue Nov 23 12:53:26 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 12:53:26.461653 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi [None req-4c464987-92c8-4437-9cc1-07eb8dc9745b admin admin] Calling method '>' {{(pid=86135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:53:26.474379 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: INFO nova.api.openstack.wsgi [None req-4c464987-92c8-4437-9cc1-07eb8dc9745b admin admin] HTTP exception thrown: Flavor 451 could not be found. Nov 23 12:53:26.474957 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi [None req-4c464987-92c8-4437-9cc1-07eb8dc9745b admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=86135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Nov 23 12:53:26.475759 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: INFO nova.api.openstack.requestlog [None req-4c464987-92c8-4437-9cc1-07eb8dc9745b admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.88 time: 0.070828 Nov 23 12:53:26.476304 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: [pid: 86135|app: 0|req: 24/49] 10.222.0.60 () {60 vars in 1193 bytes} [Tue Nov 23 12:53:26 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 23 12:53:26.486372 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi [None req-7decb15e-3405-47bc-80ae-db59f7c33ae2 admin admin] Calling method '>' {{(pid=86134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:53:26.507158 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: INFO nova.api.openstack.requestlog [None req-7decb15e-3405-47bc-80ae-db59f7c33ae2 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.024346 Nov 23 12:53:26.507781 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: [pid: 86134|app: 0|req: 26/50] 10.222.0.60 () {60 vars in 1210 bytes} [Tue Nov 23 12:53:26 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 12:53:26.518140 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi [None req-15cc8d3c-a712-4b13-ae9f-5cedccbab53b admin admin] Calling method '>' {{(pid=86135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:53:26.539420 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: INFO nova.api.openstack.requestlog [None req-15cc8d3c-a712-4b13-ae9f-5cedccbab53b admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.025200 Nov 23 12:53:26.539980 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: [pid: 86135|app: 0|req: 25/51] 10.222.0.60 () {60 vars in 1210 bytes} [Tue Nov 23 12:53:26 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 12:53:26.550346 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi [None req-55e3c8f2-6af5-4fbb-8582-2bcb21a992f5 admin admin] Calling method '>' {{(pid=86134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:53:26.562860 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: INFO nova.api.openstack.wsgi [None req-55e3c8f2-6af5-4fbb-8582-2bcb21a992f5 admin admin] HTTP exception thrown: Flavor 451 could not be found. Nov 23 12:53:26.563428 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi [None req-55e3c8f2-6af5-4fbb-8582-2bcb21a992f5 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=86134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Nov 23 12:53:26.564292 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: INFO nova.api.openstack.requestlog [None req-55e3c8f2-6af5-4fbb-8582-2bcb21a992f5 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.88 time: 0.017811 Nov 23 12:53:26.564993 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: [pid: 86134|app: 0|req: 27/52] 10.222.0.60 () {60 vars in 1193 bytes} [Tue Nov 23 12:53:26 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 23 12:53:27.913857 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi [None req-15cc8d3c-a712-4b13-ae9f-5cedccbab53b admin admin] Calling method '>' {{(pid=86135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:53:27.914896 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: INFO nova.api.openstack.requestlog [None req-15cc8d3c-a712-4b13-ae9f-5cedccbab53b admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001522 Nov 23 12:53:27.915300 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: [pid: 86135|app: 0|req: 26/53] 10.222.0.60 () {56 vars in 1074 bytes} [Tue Nov 23 12:53:27 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 12:53:28.106272 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi [None req-c3f894e3-e495-4c4c-895b-403a3693ddc4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=86134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 12:53:28.136216 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: INFO nova.api.openstack.requestlog [None req-c3f894e3-e495-4c4c-895b-403a3693ddc4 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.88 time: 0.084508 Nov 23 12:53:28.136795 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: [pid: 86134|app: 0|req: 28/54] 10.222.0.60 () {64 vars in 1235 bytes} [Tue Nov 23 12:53:28 2021] POST /compute/v2.1/flavors => generated 404 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 12:53:29.504901 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi [None req-15cc8d3c-a712-4b13-ae9f-5cedccbab53b admin admin] Calling method '>' {{(pid=86135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:53:29.505901 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: INFO nova.api.openstack.requestlog [None req-15cc8d3c-a712-4b13-ae9f-5cedccbab53b admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Nov 23 12:53:29.506275 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: [pid: 86135|app: 0|req: 27/55] 10.222.0.60 () {56 vars in 1074 bytes} [Tue Nov 23 12:53:29 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 12:53:29.710009 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi [None req-9d9dd54e-4537-4b31-bfc5-751791605237 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=86134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 12:53:29.737168 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: INFO nova.api.openstack.requestlog [None req-9d9dd54e-4537-4b31-bfc5-751791605237 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.88 time: 0.083216 Nov 23 12:53:29.737712 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: [pid: 86134|app: 0|req: 29/56] 10.222.0.60 () {64 vars in 1235 bytes} [Tue Nov 23 12:53:29 2021] POST /compute/v2.1/flavors => generated 405 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 12:53:31.079607 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi [None req-15cc8d3c-a712-4b13-ae9f-5cedccbab53b admin admin] Calling method '>' {{(pid=86135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:53:31.080889 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: INFO nova.api.openstack.requestlog [None req-15cc8d3c-a712-4b13-ae9f-5cedccbab53b admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001789 Nov 23 12:53:31.081297 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: [pid: 86135|app: 0|req: 28/57] 10.222.0.60 () {56 vars in 1074 bytes} [Tue Nov 23 12:53:31 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 12:53:31.275069 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi [None req-504640ae-7d2e-4e57-b407-814a8dd867c4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=86134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 12:53:31.310024 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: INFO nova.api.openstack.requestlog [None req-504640ae-7d2e-4e57-b407-814a8dd867c4 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.88 time: 0.090998 Nov 23 12:53:31.310570 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: [pid: 86134|app: 0|req: 30/58] 10.222.0.60 () {64 vars in 1235 bytes} [Tue Nov 23 12:53:31 2021] POST /compute/v2.1/flavors => generated 407 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 12:53:32.651853 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi [None req-15cc8d3c-a712-4b13-ae9f-5cedccbab53b admin admin] Calling method '>' {{(pid=86135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:53:32.652887 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: INFO nova.api.openstack.requestlog [None req-15cc8d3c-a712-4b13-ae9f-5cedccbab53b admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Nov 23 12:53:32.653299 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: [pid: 86135|app: 0|req: 29/59] 10.222.0.60 () {56 vars in 1074 bytes} [Tue Nov 23 12:53:32 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 12:53:32.844653 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi [None req-396aaa06-4660-401d-9ac0-be682874860d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=86134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 12:53:32.871279 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: INFO nova.api.openstack.requestlog [None req-396aaa06-4660-401d-9ac0-be682874860d admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.88 time: 0.079587 Nov 23 12:53:32.871924 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: [pid: 86134|app: 0|req: 31/60] 10.222.0.60 () {64 vars in 1235 bytes} [Tue Nov 23 12:53:32 2021] POST /compute/v2.1/flavors => generated 409 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 12:53:34.228561 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi [None req-15cc8d3c-a712-4b13-ae9f-5cedccbab53b admin admin] Calling method '>' {{(pid=86135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:53:34.229552 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: INFO nova.api.openstack.requestlog [None req-15cc8d3c-a712-4b13-ae9f-5cedccbab53b admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Nov 23 12:53:34.229922 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: [pid: 86135|app: 0|req: 30/61] 10.222.0.60 () {56 vars in 1074 bytes} [Tue Nov 23 12:53:34 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 12:53:34.420438 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi [None req-cedde4a0-057c-4654-99d3-8ae961a58bd0 admin admin] Calling method '>' {{(pid=86134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:53:34.446212 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: INFO nova.api.openstack.requestlog [None req-cedde4a0-057c-4654-99d3-8ae961a58bd0 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.88 time: 0.078947 Nov 23 12:53:34.446662 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: [pid: 86134|app: 0|req: 32/62] 10.222.0.60 () {60 vars in 1202 bytes} [Tue Nov 23 12:53:34 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 12:54:19.968992 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi [None req-15cc8d3c-a712-4b13-ae9f-5cedccbab53b admin admin] Calling method '>' {{(pid=86135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:54:19.970447 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: INFO nova.api.openstack.requestlog [None req-15cc8d3c-a712-4b13-ae9f-5cedccbab53b admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001718 Nov 23 12:54:19.970982 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: [pid: 86135|app: 0|req: 31/63] 10.222.0.60 () {56 vars in 1074 bytes} [Tue Nov 23 12:54:19 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 12:54:20.174887 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi [None req-e3a53137-75ab-462d-a0b2-3500bd3d3284 admin admin] Calling method '>' {{(pid=86134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:54:20.201567 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: INFO nova.api.openstack.requestlog [None req-e3a53137-75ab-462d-a0b2-3500bd3d3284 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.88 time: 0.085024 Nov 23 12:54:20.202134 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: [pid: 86134|app: 0|req: 33/64] 10.222.0.60 () {60 vars in 1202 bytes} [Tue Nov 23 12:54:20 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 12:55:44.176361 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi [None req-ad789357-faa3-40c4-b724-a9a304f6d971 tempest-verify_tempest_config-88205174 tempest-verify_tempest_config-88205174-project] Calling method '>' {{(pid=86135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:55:44.178399 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: INFO nova.api.openstack.requestlog [None req-ad789357-faa3-40c4-b724-a9a304f6d971 tempest-verify_tempest_config-88205174 tempest-verify_tempest_config-88205174-project] 10.222.0.60 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.129527 Nov 23 12:55:44.179035 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: [pid: 86135|app: 0|req: 32/65] 10.222.0.60 () {58 vars in 1133 bytes} [Tue Nov 23 12:55:44 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 12:57:13.865829 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi [None req-e3a53137-75ab-462d-a0b2-3500bd3d3284 admin admin] Calling method '>' {{(pid=86134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:57:13.866859 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: INFO nova.api.openstack.requestlog [None req-e3a53137-75ab-462d-a0b2-3500bd3d3284 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Nov 23 12:57:13.867288 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: [pid: 86134|app: 0|req: 34/66] 10.222.0.60 () {56 vars in 1074 bytes} [Tue Nov 23 12:57:13 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 12:57:14.135672 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi [None req-eeafb5a2-c300-482d-afdc-c52f148f9eeb admin admin] Calling method '>' {{(pid=86135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:57:14.137224 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 12:57:14.137224 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: warnings.warn(msg) Nov 23 12:57:14.139942 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG oslo_concurrency.lockutils [None req-eeafb5a2-c300-482d-afdc-c52f148f9eeb admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=86135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:57:14.140583 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG oslo_concurrency.lockutils [None req-eeafb5a2-c300-482d-afdc-c52f148f9eeb admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=86135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:57:14.141684 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG oslo_concurrency.lockutils [None req-eeafb5a2-c300-482d-afdc-c52f148f9eeb admin admin] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=86135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:57:14.142188 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG oslo_concurrency.lockutils [None req-eeafb5a2-c300-482d-afdc-c52f148f9eeb admin admin] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=86135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:57:14.177604 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: INFO nova.api.openstack.requestlog [None req-eeafb5a2-c300-482d-afdc-c52f148f9eeb admin admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.88 time: 0.173282 Nov 23 12:57:14.178175 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: [pid: 86135|app: 0|req: 33/67] 10.222.0.60 () {60 vars in 1193 bytes} [Tue Nov 23 12:57:14 2021] GET /compute/v2.1/os-services => generated 791 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 12:57:15.576177 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi [None req-e3a53137-75ab-462d-a0b2-3500bd3d3284 admin admin] Calling method '>' {{(pid=86134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:57:15.577518 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: INFO nova.api.openstack.requestlog [None req-e3a53137-75ab-462d-a0b2-3500bd3d3284 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002008 Nov 23 12:57:15.578079 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: [pid: 86134|app: 0|req: 35/68] 10.222.0.60 () {56 vars in 1074 bytes} [Tue Nov 23 12:57:15 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 12:57:15.774463 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi [None req-db53e95b-5a3a-428a-921b-03509b63f441 admin admin] Calling method '>' {{(pid=86135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:57:15.775617 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 12:57:15.775617 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: warnings.warn(msg) Nov 23 12:57:15.777151 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG oslo_concurrency.lockutils [None req-db53e95b-5a3a-428a-921b-03509b63f441 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=86135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:57:15.777582 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG oslo_concurrency.lockutils [None req-db53e95b-5a3a-428a-921b-03509b63f441 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=86135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:57:15.778354 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG oslo_concurrency.lockutils [None req-db53e95b-5a3a-428a-921b-03509b63f441 admin admin] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=86135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:57:15.778775 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG oslo_concurrency.lockutils [None req-db53e95b-5a3a-428a-921b-03509b63f441 admin admin] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=86135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:57:15.801815 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: INFO nova.api.openstack.requestlog [None req-db53e95b-5a3a-428a-921b-03509b63f441 admin admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.88 time: 0.086084 Nov 23 12:57:15.802584 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: [pid: 86135|app: 0|req: 34/69] 10.222.0.60 () {60 vars in 1193 bytes} [Tue Nov 23 12:57:15 2021] GET /compute/v2.1/os-services => generated 791 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 12:57:27.593084 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi [None req-e3a53137-75ab-462d-a0b2-3500bd3d3284 admin admin] Calling method '>' {{(pid=86134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:57:27.594025 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: INFO nova.api.openstack.requestlog [None req-e3a53137-75ab-462d-a0b2-3500bd3d3284 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001509 Nov 23 12:57:27.594490 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: [pid: 86134|app: 0|req: 36/70] 10.222.0.60 () {56 vars in 1074 bytes} [Tue Nov 23 12:57:27 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 12:57:27.787732 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi [None req-fba9516c-c729-4b4f-b6ed-f59adac21663 admin admin] Calling method '>' {{(pid=86135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:57:27.788941 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 12:57:27.788941 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: warnings.warn(msg) Nov 23 12:57:27.790443 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG oslo_concurrency.lockutils [None req-fba9516c-c729-4b4f-b6ed-f59adac21663 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=86135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:57:27.790876 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG oslo_concurrency.lockutils [None req-fba9516c-c729-4b4f-b6ed-f59adac21663 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=86135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:57:27.791656 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG oslo_concurrency.lockutils [None req-fba9516c-c729-4b4f-b6ed-f59adac21663 admin admin] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=86135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:57:27.792080 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG oslo_concurrency.lockutils [None req-fba9516c-c729-4b4f-b6ed-f59adac21663 admin admin] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=86135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:57:27.821531 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: INFO nova.api.openstack.requestlog [None req-fba9516c-c729-4b4f-b6ed-f59adac21663 admin admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.88 time: 0.088922 Nov 23 12:57:27.822005 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: [pid: 86135|app: 0|req: 35/71] 10.222.0.60 () {60 vars in 1193 bytes} [Tue Nov 23 12:57:27 2021] GET /compute/v2.1/os-services => generated 1011 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 12:57:29.192273 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: DEBUG nova.api.openstack.wsgi [None req-e3a53137-75ab-462d-a0b2-3500bd3d3284 admin admin] Calling method '>' {{(pid=86134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:57:29.193343 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: INFO nova.api.openstack.requestlog [None req-e3a53137-75ab-462d-a0b2-3500bd3d3284 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001624 Nov 23 12:57:29.193772 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: [pid: 86134|app: 0|req: 37/72] 10.222.0.60 () {56 vars in 1074 bytes} [Tue Nov 23 12:57:29 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 12:57:29.408629 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG nova.api.openstack.wsgi [None req-4458f106-ceb7-4fdc-916c-e5f74b753fee admin admin] Calling method '>' {{(pid=86135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:57:29.409776 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 12:57:29.409776 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: warnings.warn(msg) Nov 23 12:57:29.411311 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG oslo_concurrency.lockutils [None req-4458f106-ceb7-4fdc-916c-e5f74b753fee admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=86135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:57:29.411752 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG oslo_concurrency.lockutils [None req-4458f106-ceb7-4fdc-916c-e5f74b753fee admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=86135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:57:29.412554 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG oslo_concurrency.lockutils [None req-4458f106-ceb7-4fdc-916c-e5f74b753fee admin admin] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=86135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:57:29.412976 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: DEBUG oslo_concurrency.lockutils [None req-4458f106-ceb7-4fdc-916c-e5f74b753fee admin admin] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=86135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:57:29.438820 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: INFO nova.api.openstack.requestlog [None req-4458f106-ceb7-4fdc-916c-e5f74b753fee admin admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.88 time: 0.102490 Nov 23 12:57:29.439105 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: [pid: 86135|app: 0|req: 36/73] 10.222.0.60 () {60 vars in 1193 bytes} [Tue Nov 23 12:57:29 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 12:58:27.466248 dv-cinder-818886-1-iscsi devstack@n-api.service[86133]: Tue Nov 23 12:58:27 2021 - graceful shutdown triggered... Nov 23 12:58:27.466823 dv-cinder-818886-1-iscsi devstack@n-api.service[86134]: Gracefully killing worker 1 (pid: 86134)... Nov 23 12:58:27.467200 dv-cinder-818886-1-iscsi devstack@n-api.service[86135]: Gracefully killing worker 2 (pid: 86135)... Nov 23 12:58:27.468359 dv-cinder-818886-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Nov 23 12:58:28.467327 dv-cinder-818886-1-iscsi devstack@n-api.service[86133]: worker 1 buried after 1 seconds Nov 23 12:58:28.467327 dv-cinder-818886-1-iscsi devstack@n-api.service[86133]: worker 2 buried after 1 seconds Nov 23 12:58:28.467327 dv-cinder-818886-1-iscsi devstack@n-api.service[86133]: goodbye to uWSGI. Nov 23 12:58:28.469219 dv-cinder-818886-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Nov 23 12:58:28.469792 dv-cinder-818886-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Nov 23 12:58:28.472675 dv-cinder-818886-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Nov 23 12:58:28.484762 dv-cinder-818886-1-iscsi devstack@n-api.service[100956]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 23 12:58:28.486906 dv-cinder-818886-1-iscsi devstack@n-api.service[100956]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Nov 23 12:58:28 2021] *** Nov 23 12:58:28.486906 dv-cinder-818886-1-iscsi devstack@n-api.service[100956]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 23 12:58:28.486906 dv-cinder-818886-1-iscsi devstack@n-api.service[100956]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 23 12:58:28.486906 dv-cinder-818886-1-iscsi devstack@n-api.service[100956]: nodename: dv-cinder-818886-1-iscsi Nov 23 12:58:28.486906 dv-cinder-818886-1-iscsi devstack@n-api.service[100956]: machine: x86_64 Nov 23 12:58:28.486906 dv-cinder-818886-1-iscsi devstack@n-api.service[100956]: clock source: unix Nov 23 12:58:28.486906 dv-cinder-818886-1-iscsi devstack@n-api.service[100956]: pcre jit disabled Nov 23 12:58:28.486906 dv-cinder-818886-1-iscsi devstack@n-api.service[100956]: detected number of CPU cores: 4 Nov 23 12:58:28.486906 dv-cinder-818886-1-iscsi devstack@n-api.service[100956]: current working directory: / Nov 23 12:58:28.486906 dv-cinder-818886-1-iscsi devstack@n-api.service[100956]: detected binary path: /usr/bin/uwsgi-core Nov 23 12:58:28.486906 dv-cinder-818886-1-iscsi devstack@n-api.service[100956]: your processes number limit is 47680 Nov 23 12:58:28.486906 dv-cinder-818886-1-iscsi devstack@n-api.service[100956]: your memory page size is 4096 bytes Nov 23 12:58:28.486906 dv-cinder-818886-1-iscsi devstack@n-api.service[100956]: detected max file descriptor number: 2048 Nov 23 12:58:28.486906 dv-cinder-818886-1-iscsi devstack@n-api.service[100956]: lock engine: pthread robust mutexes Nov 23 12:58:28.487990 dv-cinder-818886-1-iscsi devstack@n-api.service[100956]: thunder lock: enabled Nov 23 12:58:28.487990 dv-cinder-818886-1-iscsi devstack@n-api.service[100956]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 23 12:58:28.487990 dv-cinder-818886-1-iscsi devstack@n-api.service[100956]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Nov 23 12:58:28.530066 dv-cinder-818886-1-iscsi devstack@n-api.service[100956]: Python main interpreter initialized at 0x56390cf4c9c0 Nov 23 12:58:28.530066 dv-cinder-818886-1-iscsi devstack@n-api.service[100956]: python threads support enabled Nov 23 12:58:28.530066 dv-cinder-818886-1-iscsi devstack@n-api.service[100956]: your server socket listen backlog is limited to 100 connections Nov 23 12:58:28.530066 dv-cinder-818886-1-iscsi devstack@n-api.service[100956]: your mercy for graceful operations on workers is 90 seconds Nov 23 12:58:28.530529 dv-cinder-818886-1-iscsi devstack@n-api.service[100956]: mapped 403077 bytes (393 KB) for 2 cores Nov 23 12:58:28.530529 dv-cinder-818886-1-iscsi devstack@n-api.service[100956]: *** Operational MODE: preforking *** Nov 23 12:58:28.530801 dv-cinder-818886-1-iscsi devstack@n-api.service[100956]: *** uWSGI is running in multiple interpreter mode *** Nov 23 12:58:28.530801 dv-cinder-818886-1-iscsi devstack@n-api.service[100956]: spawned uWSGI master process (pid: 100956) Nov 23 12:58:28.531013 dv-cinder-818886-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Nov 23 12:58:28.531649 dv-cinder-818886-1-iscsi devstack@n-api.service[100956]: spawned uWSGI worker 1 (pid: 100973, cores: 1) Nov 23 12:58:28.532272 dv-cinder-818886-1-iscsi devstack@n-api.service[100956]: spawned uWSGI worker 2 (pid: 100974, cores: 1) Nov 23 12:58:28.532272 dv-cinder-818886-1-iscsi devstack@n-api.service[100956]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 23 12:58:32.570802 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 23 12:58:32.571646 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 23 12:58:32.571646 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 23 12:58:32.572895 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 23 12:58:32.572895 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 23 12:58:32.572895 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.572895 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.573363 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.573568 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.574056 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.574480 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.574797 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.575131 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.575488 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.575713 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.576064 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.576417 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-818886-1-iscsi {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.576744 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.577054 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.577366 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.577691 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.577993 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.578314 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.578620 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.579115 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.580872 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.580872 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.581087 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 23 12:58:32.581576 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.581672 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 23 12:58:32.581757 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.581840 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 23 12:58:32.581918 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.582001 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 23 12:58:32.582078 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.582162 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 23 12:58:32.582239 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.582316 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.582387 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.582463 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.582543 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.582543 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.582693 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.582774 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-818886-1-iscsi {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.582851 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.582943 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.583031 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.583458 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.583672 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.583895 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.584119 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.584119 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.584559 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.584777 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.584988 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.585208 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.585447 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.585663 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.585888 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.586103 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-818886-1-iscsi {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.586307 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.586524 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.586737 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.586942 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.587149 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.587356 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.587569 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.587789 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.588006 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.588215 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.588438 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.588672 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.588865 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.589059 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.589335 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.589335 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.589626 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.589798 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.590052 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.590799 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.590960 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.591107 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.591265 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.591482 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.591713 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.592446 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.592607 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.592767 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.592767 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.593066 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.593222 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.593374 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.593534 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.593534 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.593829 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.593986 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.594127 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.594265 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.594415 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.594553 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.594709 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-818886-1-iscsi {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.594856 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.595004 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.595142 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.595286 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.595433 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.595595 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.595745 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.595890 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.596040 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.596180 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.596409 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.596561 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.596706 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.596856 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.596996 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.597144 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.597294 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.597449 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.597588 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.597726 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.597871 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.598016 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.598166 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.598306 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.598445 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.60 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.598589 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.598734 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.60 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.598891 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.599031 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.599174 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.599174 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.599459 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.599607 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.599761 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.599910 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.600053 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.600192 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.600784 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.601016 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.601177 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.601329 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.601474 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.601619 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.601776 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.601951 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.602288 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.602631 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.602788 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.602933 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.603082 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.603235 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.603385 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.603536 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.603684 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.603841 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.603991 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.604139 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.604320 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.604465 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.604613 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.604806 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.605036 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.605187 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.605334 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.605479 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.605618 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.605762 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.605920 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.606060 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.606206 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.606344 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.606488 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.606668 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.606825 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.606972 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.607120 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.607269 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.607417 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.607562 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.607788 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.607946 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.608092 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.608260 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.60 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.608416 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.608569 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.60 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.608708 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.608855 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.609000 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.609137 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.609275 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.609275 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.609562 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.609701 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.609848 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.609991 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.610137 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.610289 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.610663 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.610965 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.611215 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.611370 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.611511 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.611662 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.611813 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.611951 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.612100 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.612441 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.612787 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.612942 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.613082 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.613220 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.613375 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.613516 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.613654 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.613792 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.613936 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.614083 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.614227 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.614383 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.614522 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.614666 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.614815 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.614962 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.615101 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.615245 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.615393 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.615538 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.616226 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.616373 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.616465 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.616551 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.616631 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.616715 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.616797 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.616882 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.616964 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.617037 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.617114 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.617114 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.617263 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.617342 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.617419 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.617492 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.617569 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.617653 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.617733 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.617804 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.617886 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.617964 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.618045 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.618128 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.618209 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.618280 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.618355 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.618434 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.618505 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.618587 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.618587 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.618721 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.618799 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.618870 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.618940 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.619026 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.619107 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.619186 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.619268 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.619348 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.619428 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.619428 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.619577 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.619668 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.619749 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.619829 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.619902 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.619978 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.620059 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.620140 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.620219 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.620407 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.620553 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.620650 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.620732 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.620817 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.620908 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.620985 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.621057 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.621144 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.621237 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.621328 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.621408 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.621486 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.621564 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.621564 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.621785 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.621899 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.622017 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.622134 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.622258 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.622368 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.622491 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.622601 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.622728 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.622845 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.622954 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.623062 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.623183 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.623297 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.623414 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.623539 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.623656 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 12:58:32.623910 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.624075 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.624260 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.624427 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.624579 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.624721 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.624877 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.625020 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.625162 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.625303 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.625461 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.625603 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.625776 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.626004 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.626151 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.626293 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.626442 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.627329 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.627486 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.627645 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.627798 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.627948 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.628116 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.628290 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.628457 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.628601 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.628742 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.628892 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.629034 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.629187 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.629340 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.629496 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.629687 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.629883 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.630104 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.630303 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.630491 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.630669 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.630852 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.631028 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.631218 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.631396 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.631590 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.631775 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.632306 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.632488 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.632634 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.632785 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.632939 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.633088 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.633230 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.633371 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.633515 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.633670 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.633826 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.633972 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.634121 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.634273 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.634415 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.634572 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.634714 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.634873 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.635023 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.635174 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.635321 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.635472 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.635632 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.635786 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.635980 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.636216 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.636614 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.636761 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.637012 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.637294 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.637555 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.637785 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.637943 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.638104 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.638255 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.638413 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.638564 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.638564 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.638855 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.639005 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.639147 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.639298 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.639298 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.639606 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.639761 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.639761 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.640045 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.640195 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.640361 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.640522 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.640665 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.640814 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.640957 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.641113 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.641258 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.641420 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.641573 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.641764 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.641924 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.642074 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.642223 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.642375 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.642518 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.642662 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.642811 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.642954 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.643103 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.643254 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.643254 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.643543 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.643686 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.643827 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.643983 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.644124 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.644335 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.644491 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.644635 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.644785 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.644946 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.645105 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.645267 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.645418 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.645418 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.645687 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.645838 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.645988 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.646140 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.646282 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.646431 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.646581 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.646732 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.646874 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.647040 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.647295 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.647561 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.647827 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.648075 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.648247 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.648409 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.648553 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.648704 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.648861 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.649013 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.649156 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.649306 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.649456 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.649617 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.649770 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.649913 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.650062 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.650212 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.650355 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.650505 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.650657 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.650799 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.650940 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.651096 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.651243 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.651399 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.651624 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.651777 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.651920 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.652070 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.652214 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.652470 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.652616 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.652772 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.652922 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.653071 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.653215 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.653367 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.653530 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.653673 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.653823 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.653974 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.654116 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.654116 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.654402 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.654543 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.654693 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.654836 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.654986 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.655130 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.655278 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.655432 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.655574 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.655725 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.655876 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.656019 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.656160 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.656345 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.656491 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.656644 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.656796 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.656938 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.657078 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.657220 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.657466 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.657729 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.657991 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.658241 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.658398 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.658542 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.658694 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.658851 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.659004 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.659155 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.659298 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.659440 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.659582 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.659747 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.659898 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.660048 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.660198 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.660426 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.660601 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.660763 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.660915 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.661064 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.661216 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.661358 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.661499 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.661664 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.661819 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.661961 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.662103 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.662244 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.662402 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.662545 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.662686 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.662836 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.662985 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.663134 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.663290 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.663432 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.663583 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.663726 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.663875 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.664026 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.664182 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.664370 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.664522 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.664664 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.664805 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.664958 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.665109 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.665251 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.665392 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.665557 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.665700 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.665916 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.666151 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.666382 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.666529 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.666679 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.666828 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.666828 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.667231 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.667385 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.667631 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.667885 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.668301 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.668640 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.668794 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.669003 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.669158 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.669309 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.669309 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.669590 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.669741 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.669883 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.670024 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.670175 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.670342 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.670853 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.671015 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.671174 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.671174 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.671459 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.671614 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.671756 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.671912 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.672062 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.672205 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.672374 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.672535 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.672695 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.672839 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.672980 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.673137 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.673283 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.673437 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.673587 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.673729 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.673876 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.674033 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.674190 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.674341 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.674483 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.674642 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.674796 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.674947 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.675108 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.675259 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.675402 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.675551 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.675691 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.675840 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.675996 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.676830 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.676990 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.677146 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.677299 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.677442 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.677603 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.677846 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.678118 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.678407 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.678407 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.678817 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.678976 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.679126 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.679269 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.679422 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.679585 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.679737 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.679879 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.680021 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.680171 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.680353 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.680497 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.680640 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.680783 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.680924 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.681079 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.681221 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.681385 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.681532 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.681683 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.681683 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.681991 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.682144 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.682286 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.682436 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.682586 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.682738 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.683146 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.683352 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.683549 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.683714 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.683858 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.684061 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.684286 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.684448 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.684592 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.684741 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.684893 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.685049 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.685205 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.685348 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.685497 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.685660 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.685823 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.685965 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.686114 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.686262 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.686410 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.686567 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.686723 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.686879 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.687029 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.687176 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.687323 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.687479 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.687661 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.688038 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.688580 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.688780 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.689122 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.689347 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.689347 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.689646 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.689795 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.689959 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.690120 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.690276 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.690432 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.690587 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.690761 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.690919 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.691082 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.691233 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.691396 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.691546 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.691684 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.691835 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.691977 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.692150 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.692365 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.692516 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.692677 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.692826 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.692972 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.693135 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.693274 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.693370 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.693463 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.693568 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.693663 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.693759 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.693855 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.693949 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.694042 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.694185 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.694315 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.694461 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.694590 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.694725 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.694867 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.694966 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.695061 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.695160 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.695160 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.695328 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.695421 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.695514 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.695606 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.695700 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.695799 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.695893 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.695979 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.696062 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.696062 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.696247 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.696351 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.696439 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.696535 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.696628 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.696718 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.696817 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.696911 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.697005 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.697099 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.697192 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.697277 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.697369 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.697462 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.697554 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.697647 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.697749 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.697835 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.697928 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.697928 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.698151 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.698246 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.698339 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.698511 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.698676 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.698776 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.698870 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.698956 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.699048 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.699147 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.699233 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.699354 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.699527 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.699616 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.699708 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.699807 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.699900 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.699993 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.700078 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.700171 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.700318 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.700419 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.700515 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.700602 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.700686 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.700686 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.700844 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.700942 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.701044 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.701129 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.701220 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.701305 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.701402 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.701489 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.701581 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.701666 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.701666 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.701834 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.701934 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.702020 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.702111 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.702204 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.702299 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.702396 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.702496 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.702660 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.702749 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.702833 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.702915 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.702999 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.702999 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.703178 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.703264 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.703348 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.703502 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.703615 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.703813 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.703915 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.704115 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.704210 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.704440 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.704619 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.704760 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.704891 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.705073 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.705178 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.705377 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.705486 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.705695 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.705836 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.706013 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.706153 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.706332 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.706466 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.706632 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.706778 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.706939 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.707085 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.707266 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.707398 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.707539 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.707709 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.707845 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.708034 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.708136 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.708378 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.708499 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.708713 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.708865 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.708999 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.709161 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.709323 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.709480 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.709634 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.709791 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.709953 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.710099 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.710374 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.710475 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.710696 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.710800 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.710994 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.711095 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.711314 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.711415 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.711624 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.711720 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.711925 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.712027 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.712270 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.712379 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.712538 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.712627 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.712846 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.712947 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.713149 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.713256 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.713551 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.713655 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.713866 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.713960 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.714262 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.714365 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.714591 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.714881 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.715021 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.715228 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.715324 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.715544 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.715637 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.715863 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.715957 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.716178 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.716298 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.716509 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.716604 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.716884 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.716984 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.717226 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.717325 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.717624 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.717727 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.717934 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.718029 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.718271 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.718366 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.718580 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.718937 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.719270 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.719452 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.719609 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.719782 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.719942 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.720108 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.720309 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.720480 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.720639 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.720796 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.720946 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.721104 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.721541 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.721709 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.721709 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.722010 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.722172 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.722331 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.722640 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.722820 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.722980 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.723137 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.723297 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.723446 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.723596 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.723744 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.723906 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.724055 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.724212 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.724488 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.724642 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.724797 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.724946 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.725093 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.725251 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.725357 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.725445 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.725530 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.725601 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.725671 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.725751 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.725830 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.725924 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.726092 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.726186 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.726396 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.726509 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.726709 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.726803 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.727052 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.727154 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.727361 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.727462 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.727726 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.727837 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.728018 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.728113 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.728404 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.728544 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.728680 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.728918 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.729027 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.729489 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.729673 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.729757 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.729845 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.730276 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.730373 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.730472 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.730671 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.730775 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.731030 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.731143 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.731343 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.731491 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.731651 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.731807 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.731964 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.732118 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.732301 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.732482 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.732615 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.732792 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.732921 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.733106 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.733229 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.733420 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.733522 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.733734 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.733851 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.734041 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.734149 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.734346 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.734468 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.734670 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.734772 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.734978 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.735179 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.735303 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.735431 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.735600 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.735703 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.735921 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.736028 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.736286 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.736383 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.736564 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.736657 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.736885 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.736996 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.737196 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.737299 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.737504 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.737606 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.737806 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.737904 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.738110 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.738206 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.738456 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.738604 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.738747 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.738839 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.739070 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.739161 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.739388 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.739495 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.739701 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.739808 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.740012 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.740104 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.740358 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.740493 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.740676 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.740779 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.740991 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.741094 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.741304 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.741398 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.741621 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.741717 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.741926 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.742201 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.742307 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.742533 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.742626 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.742838 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.742933 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.743141 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.743245 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.743445 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.743540 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.743753 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.743855 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.744057 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.744157 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.744391 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.744494 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.744696 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.744809 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.745027 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.745150 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.745474 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.745581 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.745910 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.746014 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.746343 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.746444 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.746657 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.746759 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.746969 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.747085 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.747283 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.747384 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.747633 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.747735 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.747938 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.748056 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.748275 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.748388 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.748621 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.748731 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.748922 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.749016 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.749247 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.749352 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.749561 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.749665 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.749879 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.749982 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.750196 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.750295 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.750510 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.750613 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.750824 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.750918 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.751138 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.751227 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.751448 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.751537 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.751763 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.751866 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.752072 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.752164 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.752404 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.752513 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.752717 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.752808 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.753089 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.753194 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.753387 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.753491 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.754234 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.754234 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.754375 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.754448 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.754517 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.754851 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.754946 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.755332 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.755450 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.755829 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.755927 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.756012 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.756085 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.756155 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.756475 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.756564 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.756650 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.756724 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.756796 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.756871 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.757564 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.757664 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.757812 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.757894 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.758139 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.758229 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.758401 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.758492 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.758756 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.758862 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.759053 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.759149 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.759365 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.759470 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.759698 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.759791 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.759989 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.760084 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.760384 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.760519 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.760814 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.760965 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.761114 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.761242 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.761775 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.761876 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.762047 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.762146 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.762429 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.762536 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.762723 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.762815 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.763033 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.763129 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.763353 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.763449 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.763670 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.763765 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.763984 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.764077 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.764352 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.764460 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.764644 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.764795 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.764975 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.765123 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.765440 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.765600 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.765974 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.766146 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.766296 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.766452 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.766606 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.766765 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.766911 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.767064 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.767209 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.767362 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.767524 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.767524 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.767817 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.767981 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.768133 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.768308 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.768467 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.768629 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.768776 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.768953 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.769099 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.769244 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.769398 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.769552 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.769705 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.769859 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.770023 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.770169 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.770328 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.770481 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.770629 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.770784 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.770936 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.771090 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.771244 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.771400 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.771555 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.771700 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.771846 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.772352 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.772521 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.772669 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.772814 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.772960 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.773105 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.773266 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.773421 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.773577 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.773723 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.773876 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.774023 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.774181 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.774339 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.774485 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.774637 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.774792 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.774939 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.775099 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.775263 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.775546 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.775706 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.776049 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.776213 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.776213 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.776862 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.777068 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.777245 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.777414 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.777575 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.777723 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.777868 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.778014 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.778167 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.778315 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.778476 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.778624 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.778769 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.778966 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.779114 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.779261 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.779500 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.779712 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.779862 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.780032 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.780180 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.780461 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.780617 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.780772 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.780920 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.781073 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.781231 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.781387 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.781534 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.781685 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.781848 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.781997 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.782141 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.782309 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.782459 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.782606 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.782752 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.782897 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.783057 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.783215 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.783362 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.783508 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.783508 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.783799 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.783992 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.784140 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.784302 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.784469 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.784616 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.784770 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.784928 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.785088 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.785235 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.785380 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.785380 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.785756 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.785913 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.786283 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.786431 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.786585 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.786732 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.786887 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.787042 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.787197 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.787359 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.787505 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.787667 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.787828 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.787828 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.788119 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.788119 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.788462 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.788462 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.788906 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.788906 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.789247 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.789414 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.789560 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.789705 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.789861 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.790642 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.790792 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.791092 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.791249 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.791412 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.791412 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.791704 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.791852 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.791997 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.792179 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.796335 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.796532 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.796701 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.796867 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.797033 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.797187 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.797359 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.797514 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.797711 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.797877 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.798025 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.798189 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.798365 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.798515 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.798702 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.798863 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.799020 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.799183 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.799183 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.799473 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.799627 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.799788 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.799940 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.800135 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.800330 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.800482 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.800629 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.800787 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.800948 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.801110 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.801266 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.801429 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.801582 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.801730 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.801897 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.802045 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.802198 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.802365 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.802521 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.802724 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.802724 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.803082 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.803082 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.803384 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.803539 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.803695 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.803923 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.804072 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.804227 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.804451 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.804604 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.804767 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.804977 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.805134 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.805464 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.805625 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.805791 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.806023 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.806194 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.806416 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.806568 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.806568 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.806897 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.807059 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.807221 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.807420 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.807578 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.807813 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.807975 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.808134 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.808366 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.808524 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.808717 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.808920 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.809085 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.809299 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.809461 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.809614 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.809760 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.809914 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.810070 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.810225 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.810408 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.810637 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.810798 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.810954 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.811112 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.811282 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.811282 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.811611 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.811758 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.811904 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.812068 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.812219 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.812538 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.812693 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.812849 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.813006 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.813154 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.813300 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.813465 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.813622 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.813770 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.813926 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.814073 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.814218 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.814365 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.814510 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.814667 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.814667 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.814966 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.815120 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.815277 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.815424 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.815424 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.815711 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.815857 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.816030 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.816331 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.816576 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.816746 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=100974) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 23 12:58:32.816896 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.816896 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.816896 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.816896 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.816896 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.816896 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.816896 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.816896 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.818024 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.818024 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.818024 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.818024 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.818024 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.818024 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.818024 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.818024 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.819110 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.819110 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.819110 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.819110 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.819110 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.819110 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.819110 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.819110 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.820274 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.820274 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.820274 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.820274 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.820274 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.820274 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.820274 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.820274 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.821503 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.821503 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.821503 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.821503 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.822071 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.822071 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.822357 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.822678 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.822937 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 12:58:32.823181 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=100973) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 23 12:58:32.847617 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_db.sqlalchemy.engines [None req-39bcf003-8da1-4420-a40c-97d4200acdc6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100974) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Nov 23 12:58:32.862038 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_db.sqlalchemy.engines [None req-2d2cd63f-15b7-4325-a525-8cdd3f450b08 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100973) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Nov 23 12:58:33.098710 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.context [None req-39bcf003-8da1-4420-a40c-97d4200acdc6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac(cell1) {{(pid=100974) load_cells /opt/stack/nova/nova/context.py:464}} Nov 23 12:58:33.103009 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-39bcf003-8da1-4420-a40c-97d4200acdc6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:58:33.104756 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-39bcf003-8da1-4420-a40c-97d4200acdc6 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:58:33.105864 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-39bcf003-8da1-4420-a40c-97d4200acdc6 None None] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:58:33.107876 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-39bcf003-8da1-4420-a40c-97d4200acdc6 None None] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:58:33.112976 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.context [None req-2d2cd63f-15b7-4325-a525-8cdd3f450b08 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac(cell1) {{(pid=100973) load_cells /opt/stack/nova/nova/context.py:464}} Nov 23 12:58:33.117458 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-2d2cd63f-15b7-4325-a525-8cdd3f450b08 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:58:33.119786 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-2d2cd63f-15b7-4325-a525-8cdd3f450b08 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:58:33.120133 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-2d2cd63f-15b7-4325-a525-8cdd3f450b08 None None] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:58:33.122393 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-2d2cd63f-15b7-4325-a525-8cdd3f450b08 None None] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:58:33.137289 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_db.sqlalchemy.engines [None req-39bcf003-8da1-4420-a40c-97d4200acdc6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100974) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Nov 23 12:58:33.138175 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_db.sqlalchemy.engines [None req-39bcf003-8da1-4420-a40c-97d4200acdc6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100974) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Nov 23 12:58:33.147887 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_db.sqlalchemy.engines [None req-2d2cd63f-15b7-4325-a525-8cdd3f450b08 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100973) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Nov 23 12:58:33.157456 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_db.sqlalchemy.engines [None req-2d2cd63f-15b7-4325-a525-8cdd3f450b08 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100973) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Nov 23 12:58:33.168363 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_db.sqlalchemy.engines [None req-39bcf003-8da1-4420-a40c-97d4200acdc6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100974) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Nov 23 12:58:33.181487 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_db.sqlalchemy.engines [None req-2d2cd63f-15b7-4325-a525-8cdd3f450b08 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100973) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Nov 23 12:58:33.412786 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO keyring.backend [None req-39bcf003-8da1-4420-a40c-97d4200acdc6 None None] Loading KWallet Nov 23 12:58:33.422112 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO keyring.backend [None req-39bcf003-8da1-4420-a40c-97d4200acdc6 None None] Loading SecretService Nov 23 12:58:33.425570 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 23 12:58:33.425570 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: from cryptography.utils import int_from_bytes Nov 23 12:58:33.425876 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 23 12:58:33.425876 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: from cryptography.utils import int_from_bytes Nov 23 12:58:33.426241 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO keyring.backend [None req-2d2cd63f-15b7-4325-a525-8cdd3f450b08 None None] Loading KWallet Nov 23 12:58:33.426651 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO keyring.backend [None req-39bcf003-8da1-4420-a40c-97d4200acdc6 None None] Loading Windows Nov 23 12:58:33.428583 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO keyring.backend [None req-39bcf003-8da1-4420-a40c-97d4200acdc6 None None] Loading chainer Nov 23 12:58:33.429379 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO keyring.backend [None req-39bcf003-8da1-4420-a40c-97d4200acdc6 None None] Loading macOS Nov 23 12:58:33.435419 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO keyring.backend [None req-2d2cd63f-15b7-4325-a525-8cdd3f450b08 None None] Loading SecretService Nov 23 12:58:33.438821 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 23 12:58:33.438821 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: from cryptography.utils import int_from_bytes Nov 23 12:58:33.439152 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 23 12:58:33.439152 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: from cryptography.utils import int_from_bytes Nov 23 12:58:33.439882 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO keyring.backend [None req-2d2cd63f-15b7-4325-a525-8cdd3f450b08 None None] Loading Windows Nov 23 12:58:33.441855 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO keyring.backend [None req-2d2cd63f-15b7-4325-a525-8cdd3f450b08 None None] Loading chainer Nov 23 12:58:33.442638 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO keyring.backend [None req-2d2cd63f-15b7-4325-a525-8cdd3f450b08 None None] Loading macOS Nov 23 12:58:33.681354 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: WARNING keystonemiddleware.auth_token [None req-39bcf003-8da1-4420-a40c-97d4200acdc6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 23 12:58:33.688072 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: WARNING keystonemiddleware.auth_token [None req-39bcf003-8da1-4420-a40c-97d4200acdc6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 23 12:58:33.697585 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: WARNING keystonemiddleware.auth_token [None req-2d2cd63f-15b7-4325-a525-8cdd3f450b08 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 23 12:58:33.704670 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: WARNING keystonemiddleware.auth_token [None req-2d2cd63f-15b7-4325-a525-8cdd3f450b08 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 23 12:58:33.908368 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: WARNING keystonemiddleware.auth_token [None req-39bcf003-8da1-4420-a40c-97d4200acdc6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 23 12:58:33.914086 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: WARNING keystonemiddleware.auth_token [None req-39bcf003-8da1-4420-a40c-97d4200acdc6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 23 12:58:33.920394 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56390cf4c9c0 pid: 100974 (default app) Nov 23 12:58:33.944013 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: WARNING keystonemiddleware.auth_token [None req-2d2cd63f-15b7-4325-a525-8cdd3f450b08 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 23 12:58:33.949247 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: WARNING keystonemiddleware.auth_token [None req-2d2cd63f-15b7-4325-a525-8cdd3f450b08 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 23 12:58:33.954605 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56390cf4c9c0 pid: 100973 (default app) Nov 23 12:59:19.238089 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-fc6016ef-e34d-43cf-8fa3-7e01eebafd73 tempest-VolumesSnapshotsTestJSON-694893183 tempest-VolumesSnapshotsTestJSON-694893183-project] Action: 'create', calling method: .version_select at 0x7f1871a09d30>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-2069938906"}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 12:59:20.295887 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-54603cf6-230f-49a2-82ea-546928910ff6 tempest-VolumesNegativeTest-1195383660 tempest-VolumesNegativeTest-1195383660-project] Action: 'create', calling method: .version_select at 0x7f1871a0bd30>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1818172467", "metadata": {"Type": "work"}}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 12:59:20.298633 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-54603cf6-230f-49a2-82ea-546928910ff6 tempest-VolumesNegativeTest-1195383660 tempest-VolumesNegativeTest-1195383660-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=100973) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Nov 23 12:59:20.299659 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-54603cf6-230f-49a2-82ea-546928910ff6 tempest-VolumesNegativeTest-1195383660 tempest-VolumesNegativeTest-1195383660-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.350727 Nov 23 12:59:20.305935 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1/1] 10.222.0.60 () {60 vars in 1155 bytes} [Tue Nov 23 12:59:18 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 1359 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 23 12:59:20.320119 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-47846bfa-f85d-40a8-b653-da118ad22ee9 tempest-VolumesNegativeTest-1195383660 tempest-VolumesNegativeTest-1195383660-project] Action: 'create', calling method: .version_select at 0x7f1871979790>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1175084602", "metadata": {"Type": "work"}}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 12:59:20.321850 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-47846bfa-f85d-40a8-b653-da118ad22ee9 tempest-VolumesNegativeTest-1195383660 tempest-VolumesNegativeTest-1195383660-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=100973) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Nov 23 12:59:20.328274 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-47846bfa-f85d-40a8-b653-da118ad22ee9 tempest-VolumesNegativeTest-1195383660 tempest-VolumesNegativeTest-1195383660-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.019538 Nov 23 12:59:20.335544 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 2/2] 10.222.0.60 () {60 vars in 1155 bytes} [Tue Nov 23 12:59:20 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 23 12:59:20.349460 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-33f42ae9-3a63-445b-b034-f20a50bc58f9 tempest-VolumesNegativeTest-1195383660 tempest-VolumesNegativeTest-1195383660-project] Action: 'create', calling method: .version_select at 0x7f1871a0bd30>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-402911901", "metadata": {"Type": "work"}}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 12:59:20.351869 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-33f42ae9-3a63-445b-b034-f20a50bc58f9 tempest-VolumesNegativeTest-1195383660 tempest-VolumesNegativeTest-1195383660-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=100973) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Nov 23 12:59:20.355421 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-33f42ae9-3a63-445b-b034-f20a50bc58f9 tempest-VolumesNegativeTest-1195383660 tempest-VolumesNegativeTest-1195383660-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.013861 Nov 23 12:59:20.357002 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 3/3] 10.222.0.60 () {60 vars in 1155 bytes} [Tue Nov 23 12:59:20 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 23 12:59:20.367629 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-2a39ea4a-a49b-4999-a204-07593580ef8c tempest-VolumesNegativeTest-1195383660 tempest-VolumesNegativeTest-1195383660-project] Calling method '.version_select at 0x7f18719e4280>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:59:21.757933 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.wsgi [None req-2a39ea4a-a49b-4999-a204-07593580ef8c tempest-VolumesNegativeTest-1195383660 tempest-VolumesNegativeTest-1195383660-project] HTTP exception thrown: Volume tempest-invalid-1062639752 could not be found. Nov 23 12:59:21.758886 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-2a39ea4a-a49b-4999-a204-07593580ef8c tempest-VolumesNegativeTest-1195383660 tempest-VolumesNegativeTest-1195383660-project] Returning 404 to user: Volume tempest-invalid-1062639752 could not be found. {{(pid=100973) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Nov 23 12:59:21.761045 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-2a39ea4a-a49b-4999-a204-07593580ef8c tempest-VolumesNegativeTest-1195383660 tempest-VolumesNegativeTest-1195383660-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1062639752" status: 404 len: 99 microversion: 2.1 time: 1.397682 Nov 23 12:59:21.762167 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 4/4] 10.222.0.60 () {58 vars in 1217 bytes} [Tue Nov 23 12:59:20 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-1062639752 => generated 99 bytes in 1400 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Nov 23 12:59:21.775708 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-961854de-f57f-49c8-9f4a-547f2cbb0349 tempest-VolumesNegativeTest-1195383660 tempest-VolumesNegativeTest-1195383660-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006606 Nov 23 12:59:21.778988 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 5/5] 10.222.0.60 () {58 vars in 1139 bytes} [Tue Nov 23 12:59:21 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 11 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Nov 23 12:59:21.789056 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-bef1f506-6c0f-4d1f-9fd0-fcf65cf3ef60 tempest-VolumesNegativeTest-1195383660 tempest-VolumesNegativeTest-1195383660-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005857 Nov 23 12:59:21.791857 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 6/6] 10.222.0.60 () {58 vars in 1136 bytes} [Tue Nov 23 12:59:21 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 23 12:59:21.799232 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-332d1acc-b115-4528-8645-087fa3dea233 tempest-VolumesNegativeTest-1195383660 tempest-VolumesNegativeTest-1195383660-project] Calling method '.version_select at 0x7f1871979f70>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:59:21.911441 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-fc6016ef-e34d-43cf-8fa3-7e01eebafd73 tempest-VolumesSnapshotsTestJSON-694893183 tempest-VolumesSnapshotsTestJSON-694893183-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 4.416718 Nov 23 12:59:21.912543 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1/7] 10.222.0.60 () {60 vars in 1154 bytes} [Tue Nov 23 12:59:17 2021] POST /compute/v2.1/os-volumes => generated 345 bytes in 4420 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Nov 23 12:59:21.929632 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-2816f050-e870-4946-8a97-912ff814121c tempest-VolumesSnapshotsTestJSON-694893183 tempest-VolumesSnapshotsTestJSON-694893183-project] Calling method '.version_select at 0x7f18718f2040>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:59:22.043435 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.wsgi [None req-332d1acc-b115-4528-8645-087fa3dea233 tempest-VolumesNegativeTest-1195383660 tempest-VolumesNegativeTest-1195383660-project] HTTP exception thrown: Volume 3c1bd894-7e3e-4b32-af78-eb74ac04fe8e could not be found. Nov 23 12:59:22.045178 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-332d1acc-b115-4528-8645-087fa3dea233 tempest-VolumesNegativeTest-1195383660 tempest-VolumesNegativeTest-1195383660-project] Returning 404 to user: Volume 3c1bd894-7e3e-4b32-af78-eb74ac04fe8e could not be found. {{(pid=100973) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Nov 23 12:59:22.046062 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-332d1acc-b115-4528-8645-087fa3dea233 tempest-VolumesNegativeTest-1195383660 tempest-VolumesNegativeTest-1195383660-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/3c1bd894-7e3e-4b32-af78-eb74ac04fe8e" status: 404 len: 109 microversion: 2.1 time: 0.250775 Nov 23 12:59:22.047100 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 7/8] 10.222.0.60 () {58 vars in 1247 bytes} [Tue Nov 23 12:59:21 2021] DELETE /compute/v2.1/os-volumes/3c1bd894-7e3e-4b32-af78-eb74ac04fe8e => generated 109 bytes in 252 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 23 12:59:22.058346 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-508172c9-02c3-42d4-a9aa-39f6e99c0d80 tempest-VolumesNegativeTest-1195383660 tempest-VolumesNegativeTest-1195383660-project] Calling method '.version_select at 0x7f1871901790>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:59:22.201475 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.wsgi [None req-508172c9-02c3-42d4-a9aa-39f6e99c0d80 tempest-VolumesNegativeTest-1195383660 tempest-VolumesNegativeTest-1195383660-project] HTTP exception thrown: Volume 2e66eb4c-691c-42c0-b286-7ad43e66d92d could not be found. Nov 23 12:59:22.202424 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-508172c9-02c3-42d4-a9aa-39f6e99c0d80 tempest-VolumesNegativeTest-1195383660 tempest-VolumesNegativeTest-1195383660-project] Returning 404 to user: Volume 2e66eb4c-691c-42c0-b286-7ad43e66d92d could not be found. {{(pid=100973) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Nov 23 12:59:22.203888 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-508172c9-02c3-42d4-a9aa-39f6e99c0d80 tempest-VolumesNegativeTest-1195383660 tempest-VolumesNegativeTest-1195383660-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/2e66eb4c-691c-42c0-b286-7ad43e66d92d" status: 404 len: 109 microversion: 2.1 time: 0.150852 Nov 23 12:59:22.205013 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 8/9] 10.222.0.60 () {58 vars in 1244 bytes} [Tue Nov 23 12:59:22 2021] GET /compute/v2.1/os-volumes/2e66eb4c-691c-42c0-b286-7ad43e66d92d => generated 109 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 12:59:22.292384 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-2816f050-e870-4946-8a97-912ff814121c tempest-VolumesSnapshotsTestJSON-694893183 tempest-VolumesSnapshotsTestJSON-694893183-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/9f0150ba-fadc-4bae-a5ee-7c8d2cf28f24" status: 200 len: 345 microversion: 2.1 time: 0.371235 Nov 23 12:59:22.298257 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 2/10] 10.222.0.60 () {58 vars in 1244 bytes} [Tue Nov 23 12:59:21 2021] GET /compute/v2.1/os-volumes/9f0150ba-fadc-4bae-a5ee-7c8d2cf28f24 => generated 345 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 12:59:22.642475 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-5001798d-a554-4b36-9a13-4f084f952de9 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-898624812", "imageRef": "d01e1b62-4f14-4f64-9d63-d155732e33e8", "flavorRef": "452", "networks": [{"uuid": "4d4f91c5-0970-4bbf-899b-51f980de1478"}]}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 12:59:22.808428 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.network.neutron [None req-5001798d-a554-4b36-9a13-4f084f952de9 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] validate_networks() for [('4d4f91c5-0970-4bbf-899b-51f980de1478', None, None, None)] {{(pid=100973) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Nov 23 12:59:23.309098 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-0b0b702a-738c-4ec1-93b7-bf389ae2f223 tempest-VolumesSnapshotsTestJSON-694893183 tempest-VolumesSnapshotsTestJSON-694893183-project] Calling method '.version_select at 0x7f18718f28b0>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:59:23.535209 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-0b0b702a-738c-4ec1-93b7-bf389ae2f223 tempest-VolumesSnapshotsTestJSON-694893183 tempest-VolumesSnapshotsTestJSON-694893183-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/9f0150ba-fadc-4bae-a5ee-7c8d2cf28f24" status: 200 len: 346 microversion: 2.1 time: 0.233567 Nov 23 12:59:23.536102 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 3/11] 10.222.0.60 () {58 vars in 1244 bytes} [Tue Nov 23 12:59:23 2021] GET /compute/v2.1/os-volumes/9f0150ba-fadc-4bae-a5ee-7c8d2cf28f24 => generated 346 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 12:59:23.548957 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-2ceca1a6-51ab-421e-b9f6-ee544b8427f8 tempest-VolumesSnapshotsTestJSON-694893183 tempest-VolumesSnapshotsTestJSON-694893183-project] Action: 'create', calling method: .version_select at 0x7f18718f2f70>, body: {"snapshot": {"volume_id": "9f0150ba-fadc-4bae-a5ee-7c8d2cf28f24", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-376619997"}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 12:59:24.177435 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-2ceca1a6-51ab-421e-b9f6-ee544b8427f8 tempest-VolumesSnapshotsTestJSON-694893183 tempest-VolumesSnapshotsTestJSON-694893183-project] 10.222.0.60 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.633170 Nov 23 12:59:24.178028 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 4/12] 10.222.0.60 () {60 vars in 1161 bytes} [Tue Nov 23 12:59:23 2021] POST /compute/v2.1/os-snapshots => generated 286 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 12:59:24.457378 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-b555e01b-8b0e-49d2-93d1-35c261df018d tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-968684146", "imageRef": "d01e1b62-4f14-4f64-9d63-d155732e33e8", "flavorRef": "452", "networks": [{"uuid": "bf33958f-9165-410d-8036-71326a5124b6"}]}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 12:59:24.592154 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.network.neutron [None req-b555e01b-8b0e-49d2-93d1-35c261df018d tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] validate_networks() for [('bf33958f-9165-410d-8036-71326a5124b6', None, None, None)] {{(pid=100974) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Nov 23 12:59:24.618031 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.virt.hardware [None req-5001798d-a554-4b36-9a13-4f084f952de9 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Flavor limits 0:0:0 {{(pid=100973) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 23 12:59:24.618584 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.virt.hardware [None req-5001798d-a554-4b36-9a13-4f084f952de9 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Image limits 0:0:0 {{(pid=100973) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 23 12:59:24.619333 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.virt.hardware [None req-5001798d-a554-4b36-9a13-4f084f952de9 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Flavor pref 0:0:0 {{(pid=100973) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 23 12:59:24.620131 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.virt.hardware [None req-5001798d-a554-4b36-9a13-4f084f952de9 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Image pref 0:0:0 {{(pid=100973) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 23 12:59:24.620782 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.virt.hardware [None req-5001798d-a554-4b36-9a13-4f084f952de9 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100973) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 23 12:59:24.641873 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5001798d-a554-4b36-9a13-4f084f952de9 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:59:24.644027 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5001798d-a554-4b36-9a13-4f084f952de9 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:59:24.648294 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5001798d-a554-4b36-9a13-4f084f952de9 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:59:24.651228 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5001798d-a554-4b36-9a13-4f084f952de9 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:59:24.710719 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.quota [None req-5001798d-a554-4b36-9a13-4f084f952de9 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Getting quotas for project 7d153c67e84449bb8eb36b752ec41896. Resources: {'ram', 'cores', 'instances'} {{(pid=100973) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 12:59:24.724075 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.quota [None req-5001798d-a554-4b36-9a13-4f084f952de9 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Getting quotas for user bb7adc68cc5d47fea458da9232672087 and project 7d153c67e84449bb8eb36b752ec41896. Resources: {'ram', 'cores', 'instances'} {{(pid=100973) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 12:59:24.760671 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-5001798d-a554-4b36-9a13-4f084f952de9 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Going to run 1 instances... {{(pid=100973) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Nov 23 12:59:24.767956 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-5001798d-a554-4b36-9a13-4f084f952de9 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] [instance: 851d1bac-67b3-4477-8109-c37791c90f1b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d01e1b62-4f14-4f64-9d63-d155732e33e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100973) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Nov 23 12:59:24.952378 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-5001798d-a554-4b36-9a13-4f084f952de9 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.390742 Nov 23 12:59:24.953044 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 9/13] 10.222.0.60 () {60 vars in 1146 bytes} [Tue Nov 23 12:59:22 2021] POST /compute/v2.1/servers => generated 380 bytes in 2392 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 23 12:59:24.967663 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-ba5209f7-54d4-4771-a59f-d1be22ee2d3b tempest-VolumesSnapshotsTestJSON-694893183 tempest-VolumesSnapshotsTestJSON-694893183-project] Calling method '.version_select at 0x7f1871843820>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:59:25.122686 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-ba5209f7-54d4-4771-a59f-d1be22ee2d3b tempest-VolumesSnapshotsTestJSON-694893183 tempest-VolumesSnapshotsTestJSON-694893183-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/fab52147-01f3-4dcc-aec4-ba778e824c67" status: 200 len: 286 microversion: 2.1 time: 0.168403 Nov 23 12:59:25.123459 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 10/14] 10.222.0.60 () {58 vars in 1250 bytes} [Tue Nov 23 12:59:24 2021] GET /compute/v2.1/os-snapshots/fab52147-01f3-4dcc-aec4-ba778e824c67 => generated 286 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 12:59:25.128412 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-fef11ffb-e3f5-42cc-a8a8-cc376ecc3619 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:59:25.129389 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-fef11ffb-e3f5-42cc-a8a8-cc376ecc3619 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] [instance: 851d1bac-67b3-4477-8109-c37791c90f1b] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 12:59:25.322445 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-fef11ffb-e3f5-42cc-a8a8-cc376ecc3619 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7adc68cc5d47fea458da9232672087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d153c67e84449bb8eb36b752ec41896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 12:59:25.363943 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-fef11ffb-e3f5-42cc-a8a8-cc376ecc3619 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] 10.222.0.60 "GET /compute/v2.1/servers/851d1bac-67b3-4477-8109-c37791c90f1b" status: 200 len: 1214 microversion: 2.1 time: 0.239175 Nov 23 12:59:25.374318 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 11/15] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 12:59:25 2021] GET /compute/v2.1/servers/851d1bac-67b3-4477-8109-c37791c90f1b => generated 1214 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 12:59:25.374318 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-0dc95b01-9458-4387-b01d-3bd2723af5a6 tempest-VolumesSnapshotsTestJSON-694893183 tempest-VolumesSnapshotsTestJSON-694893183-project] Calling method '.version_select at 0x7f18717dfdc0>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:59:25.504155 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-0dc95b01-9458-4387-b01d-3bd2723af5a6 tempest-VolumesSnapshotsTestJSON-694893183 tempest-VolumesSnapshotsTestJSON-694893183-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.137974 Nov 23 12:59:25.504863 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 12/16] 10.222.0.60 () {58 vars in 1139 bytes} [Tue Nov 23 12:59:25 2021] GET /compute/v2.1/os-snapshots => generated 289 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 12:59:25.518756 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-40830fad-c253-4210-85a0-e532b104d7c9 tempest-VolumesSnapshotsTestJSON-694893183 tempest-VolumesSnapshotsTestJSON-694893183-project] Calling method '.version_select at 0x7f18717fa0d0>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:59:25.642915 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-40830fad-c253-4210-85a0-e532b104d7c9 tempest-VolumesSnapshotsTestJSON-694893183 tempest-VolumesSnapshotsTestJSON-694893183-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/fab52147-01f3-4dcc-aec4-ba778e824c67" status: 200 len: 286 microversion: 2.1 time: 0.127920 Nov 23 12:59:25.647350 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 13/17] 10.222.0.60 () {58 vars in 1250 bytes} [Tue Nov 23 12:59:25 2021] GET /compute/v2.1/os-snapshots/fab52147-01f3-4dcc-aec4-ba778e824c67 => generated 286 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 12:59:26.386696 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-27a702c7-c71c-4dcd-9eb3-7c8a426469e0 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:59:26.389320 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-27a702c7-c71c-4dcd-9eb3-7c8a426469e0 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] [instance: 851d1bac-67b3-4477-8109-c37791c90f1b] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 12:59:26.642650 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-27a702c7-c71c-4dcd-9eb3-7c8a426469e0 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7adc68cc5d47fea458da9232672087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d153c67e84449bb8eb36b752ec41896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 12:59:26.668990 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-27a702c7-c71c-4dcd-9eb3-7c8a426469e0 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] 10.222.0.60 "GET /compute/v2.1/servers/851d1bac-67b3-4477-8109-c37791c90f1b" status: 200 len: 1214 microversion: 2.1 time: 0.289838 Nov 23 12:59:26.671833 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 14/18] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 12:59:26 2021] GET /compute/v2.1/servers/851d1bac-67b3-4477-8109-c37791c90f1b => generated 1214 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 12:59:26.689667 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-64d9116a-9df1-47d7-9ee1-30a958c3ca54 tempest-VolumesSnapshotsTestJSON-694893183 tempest-VolumesSnapshotsTestJSON-694893183-project] Calling method '.version_select at 0x7f18717f00d0>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:59:26.846085 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-64d9116a-9df1-47d7-9ee1-30a958c3ca54 tempest-VolumesSnapshotsTestJSON-694893183 tempest-VolumesSnapshotsTestJSON-694893183-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/fab52147-01f3-4dcc-aec4-ba778e824c67" status: 200 len: 286 microversion: 2.1 time: 0.170250 Nov 23 12:59:26.849026 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 15/19] 10.222.0.60 () {58 vars in 1250 bytes} [Tue Nov 23 12:59:26 2021] GET /compute/v2.1/os-snapshots/fab52147-01f3-4dcc-aec4-ba778e824c67 => generated 286 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 12:59:27.557478 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.virt.hardware [None req-b555e01b-8b0e-49d2-93d1-35c261df018d tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Flavor limits 0:0:0 {{(pid=100974) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 23 12:59:27.558052 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.virt.hardware [None req-b555e01b-8b0e-49d2-93d1-35c261df018d tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Image limits 0:0:0 {{(pid=100974) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 23 12:59:27.558551 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.virt.hardware [None req-b555e01b-8b0e-49d2-93d1-35c261df018d tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Flavor pref 0:0:0 {{(pid=100974) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 23 12:59:27.559032 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.virt.hardware [None req-b555e01b-8b0e-49d2-93d1-35c261df018d tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Image pref 0:0:0 {{(pid=100974) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 23 12:59:27.559933 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.virt.hardware [None req-b555e01b-8b0e-49d2-93d1-35c261df018d tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100974) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 23 12:59:27.585265 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b555e01b-8b0e-49d2-93d1-35c261df018d tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:59:27.586132 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b555e01b-8b0e-49d2-93d1-35c261df018d tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:59:27.591297 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b555e01b-8b0e-49d2-93d1-35c261df018d tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:59:27.596702 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b555e01b-8b0e-49d2-93d1-35c261df018d tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:59:27.659626 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.quota [None req-b555e01b-8b0e-49d2-93d1-35c261df018d tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Getting quotas for project 9a31364455dc442f8df299a8ad758a4e. Resources: {'ram', 'cores', 'instances'} {{(pid=100974) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 12:59:27.667792 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.quota [None req-b555e01b-8b0e-49d2-93d1-35c261df018d tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Getting quotas for user c023f89fd3da4bc8b38963bed4e5cc63 and project 9a31364455dc442f8df299a8ad758a4e. Resources: {'ram', 'cores', 'instances'} {{(pid=100974) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 12:59:27.700174 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-b555e01b-8b0e-49d2-93d1-35c261df018d tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Going to run 1 instances... {{(pid=100974) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Nov 23 12:59:27.703631 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-0349a881-598b-48b5-a229-040ba9e3ec5f tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:59:27.704200 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-b555e01b-8b0e-49d2-93d1-35c261df018d tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: a3b02d0f-db9d-4996-a245-7237e989670d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d01e1b62-4f14-4f64-9d63-d155732e33e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100974) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Nov 23 12:59:27.704359 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-0349a881-598b-48b5-a229-040ba9e3ec5f tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] [instance: 851d1bac-67b3-4477-8109-c37791c90f1b] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 12:59:27.724904 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0349a881-598b-48b5-a229-040ba9e3ec5f tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:59:27.725436 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0349a881-598b-48b5-a229-040ba9e3ec5f tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:59:27.726169 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0349a881-598b-48b5-a229-040ba9e3ec5f tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:59:27.726648 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0349a881-598b-48b5-a229-040ba9e3ec5f tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:59:27.880267 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-b555e01b-8b0e-49d2-93d1-35c261df018d tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.700947 Nov 23 12:59:27.885770 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 5/20] 10.222.0.60 () {60 vars in 1146 bytes} [Tue Nov 23 12:59:24 2021] POST /compute/v2.1/servers => generated 380 bytes in 3707 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 23 12:59:27.895606 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-5ed2afab-d13b-4e58-9cc9-fc21a008e838 tempest-VolumesSnapshotsTestJSON-694893183 tempest-VolumesSnapshotsTestJSON-694893183-project] Calling method '.version_select at 0x7f187183adc0>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:59:28.035404 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-5ed2afab-d13b-4e58-9cc9-fc21a008e838 tempest-VolumesSnapshotsTestJSON-694893183 tempest-VolumesSnapshotsTestJSON-694893183-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/fab52147-01f3-4dcc-aec4-ba778e824c67" status: 200 len: 286 microversion: 2.1 time: 0.145789 Nov 23 12:59:28.035977 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 6/21] 10.222.0.60 () {58 vars in 1250 bytes} [Tue Nov 23 12:59:27 2021] GET /compute/v2.1/os-snapshots/fab52147-01f3-4dcc-aec4-ba778e824c67 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 12:59:28.040713 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-99862005-33af-46a0-b080-90d4904dd449 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:59:28.041427 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-99862005-33af-46a0-b080-90d4904dd449 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: a3b02d0f-db9d-4996-a245-7237e989670d] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 12:59:28.060049 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-0349a881-598b-48b5-a229-040ba9e3ec5f tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7adc68cc5d47fea458da9232672087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d153c67e84449bb8eb36b752ec41896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 12:59:28.075385 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-0349a881-598b-48b5-a229-040ba9e3ec5f tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] 10.222.0.60 "GET /compute/v2.1/servers/851d1bac-67b3-4477-8109-c37791c90f1b" status: 200 len: 1218 microversion: 2.1 time: 0.381388 Nov 23 12:59:28.082142 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 16/22] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 12:59:27 2021] GET /compute/v2.1/servers/851d1bac-67b3-4477-8109-c37791c90f1b => generated 1218 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 12:59:28.276664 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-51525944-cda5-4193-81a7-851aa28b449b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'create', calling method: .version_select at 0x7f1870f73d30>, body: {"keypair": {"name": "tempest-keypair-1733058349"}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 12:59:28.289482 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-99862005-33af-46a0-b080-90d4904dd449 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c023f89fd3da4bc8b38963bed4e5cc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a31364455dc442f8df299a8ad758a4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 12:59:28.307341 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-99862005-33af-46a0-b080-90d4904dd449 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/a3b02d0f-db9d-4996-a245-7237e989670d" status: 200 len: 1217 microversion: 2.1 time: 0.270233 Nov 23 12:59:28.313376 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 7/23] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 12:59:28 2021] GET /compute/v2.1/servers/a3b02d0f-db9d-4996-a245-7237e989670d => generated 1217 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 12:59:28.345299 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.quota [None req-51525944-cda5-4193-81a7-851aa28b449b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Getting quotas for project d3e13e13e1e54f208b7be1c18e3ab703. Resources: {'key_pairs'} {{(pid=100973) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 12:59:28.374398 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.quota [None req-51525944-cda5-4193-81a7-851aa28b449b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Getting quotas for user 4540fb62ff264ba4929a567b548de846 and project d3e13e13e1e54f208b7be1c18e3ab703. Resources: {'key_pairs'} {{(pid=100973) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 12:59:28.816766 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.quota [None req-51525944-cda5-4193-81a7-851aa28b449b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Getting quotas for project d3e13e13e1e54f208b7be1c18e3ab703. Resources: {'key_pairs'} {{(pid=100973) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 12:59:28.822215 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.quota [None req-51525944-cda5-4193-81a7-851aa28b449b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Getting quotas for user 4540fb62ff264ba4929a567b548de846 and project d3e13e13e1e54f208b7be1c18e3ab703. Resources: {'key_pairs'} {{(pid=100973) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 12:59:28.870651 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-51525944-cda5-4193-81a7-851aa28b449b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 0.786325 Nov 23 12:59:28.871304 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 17/24] 10.222.0.60 () {62 vars in 1198 bytes} [Tue Nov 23 12:59:28 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 788 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Nov 23 12:59:29.048730 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-2c9ed36f-7c46-46a3-8ae7-d829c2886672 tempest-VolumesSnapshotsTestJSON-694893183 tempest-VolumesSnapshotsTestJSON-694893183-project] Calling method '.version_select at 0x7f18717d9670>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:59:29.092628 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-446c9219-1a8e-44f8-919f-927ff03057a2 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:59:29.093250 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-446c9219-1a8e-44f8-919f-927ff03057a2 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] [instance: 851d1bac-67b3-4477-8109-c37791c90f1b] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 12:59:29.111937 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-446c9219-1a8e-44f8-919f-927ff03057a2 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:59:29.112484 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-446c9219-1a8e-44f8-919f-927ff03057a2 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:59:29.113205 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-446c9219-1a8e-44f8-919f-927ff03057a2 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:59:29.113634 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-446c9219-1a8e-44f8-919f-927ff03057a2 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:59:29.161479 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-2c9ed36f-7c46-46a3-8ae7-d829c2886672 tempest-VolumesSnapshotsTestJSON-694893183 tempest-VolumesSnapshotsTestJSON-694893183-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/fab52147-01f3-4dcc-aec4-ba778e824c67" status: 200 len: 286 microversion: 2.1 time: 0.116506 Nov 23 12:59:29.162442 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 8/25] 10.222.0.60 () {58 vars in 1250 bytes} [Tue Nov 23 12:59:29 2021] GET /compute/v2.1/os-snapshots/fab52147-01f3-4dcc-aec4-ba778e824c67 => generated 286 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 12:59:29.330326 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-a456c7fd-e214-45b5-b981-c37eaa166c62 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:59:29.331118 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-a456c7fd-e214-45b5-b981-c37eaa166c62 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: a3b02d0f-db9d-4996-a245-7237e989670d] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 12:59:29.351069 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a456c7fd-e214-45b5-b981-c37eaa166c62 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:59:29.354835 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a456c7fd-e214-45b5-b981-c37eaa166c62 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:59:29.360821 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a456c7fd-e214-45b5-b981-c37eaa166c62 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:59:29.362631 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a456c7fd-e214-45b5-b981-c37eaa166c62 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:59:29.444770 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-446c9219-1a8e-44f8-919f-927ff03057a2 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7adc68cc5d47fea458da9232672087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d153c67e84449bb8eb36b752ec41896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 12:59:29.454204 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-446c9219-1a8e-44f8-919f-927ff03057a2 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] 10.222.0.60 "GET /compute/v2.1/servers/851d1bac-67b3-4477-8109-c37791c90f1b" status: 200 len: 1218 microversion: 2.1 time: 0.365241 Nov 23 12:59:29.454785 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 18/26] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 12:59:29 2021] GET /compute/v2.1/servers/851d1bac-67b3-4477-8109-c37791c90f1b => generated 1218 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 12:59:29.704388 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-a456c7fd-e214-45b5-b981-c37eaa166c62 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c023f89fd3da4bc8b38963bed4e5cc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a31364455dc442f8df299a8ad758a4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 12:59:29.724025 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-a456c7fd-e214-45b5-b981-c37eaa166c62 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/a3b02d0f-db9d-4996-a245-7237e989670d" status: 200 len: 1221 microversion: 2.1 time: 0.397452 Nov 23 12:59:29.735135 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 9/27] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 12:59:29 2021] GET /compute/v2.1/servers/a3b02d0f-db9d-4996-a245-7237e989670d => generated 1221 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 12:59:30.174446 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-ca6e3ad6-ccfe-47a1-9eef-0247c50dc12e tempest-VolumesSnapshotsTestJSON-694893183 tempest-VolumesSnapshotsTestJSON-694893183-project] Calling method '.version_select at 0x7f1870f07940>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:59:30.245615 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-ca6e3ad6-ccfe-47a1-9eef-0247c50dc12e tempest-VolumesSnapshotsTestJSON-694893183 tempest-VolumesSnapshotsTestJSON-694893183-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/fab52147-01f3-4dcc-aec4-ba778e824c67" status: 200 len: 287 microversion: 2.1 time: 0.073868 Nov 23 12:59:30.251320 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 19/28] 10.222.0.60 () {58 vars in 1250 bytes} [Tue Nov 23 12:59:30 2021] GET /compute/v2.1/os-snapshots/fab52147-01f3-4dcc-aec4-ba778e824c67 => generated 287 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 12:59:30.256778 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-7586b9b3-c322-4a2e-816e-6d31610a9625 tempest-VolumesSnapshotsTestJSON-694893183 tempest-VolumesSnapshotsTestJSON-694893183-project] Calling method '.version_select at 0x7f1870f77d30>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:59:30.398043 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-7586b9b3-c322-4a2e-816e-6d31610a9625 tempest-VolumesSnapshotsTestJSON-694893183 tempest-VolumesSnapshotsTestJSON-694893183-project] 10.222.0.60 "DELETE /compute/v2.1/os-snapshots/fab52147-01f3-4dcc-aec4-ba778e824c67" status: 202 len: 0 microversion: 2.1 time: 0.146107 Nov 23 12:59:30.403312 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 10/29] 10.222.0.60 () {58 vars in 1253 bytes} [Tue Nov 23 12:59:30 2021] DELETE /compute/v2.1/os-snapshots/fab52147-01f3-4dcc-aec4-ba778e824c67 => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 12:59:30.407093 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-6774ff35-8130-4ec2-93a9-bdba8c35b9a5 tempest-VolumesSnapshotsTestJSON-694893183 tempest-VolumesSnapshotsTestJSON-694893183-project] Calling method '.version_select at 0x7f1870f0cc10>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:59:30.471911 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-3967befd-9827-4973-ad1f-fb217113cf7d tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:59:30.472965 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-3967befd-9827-4973-ad1f-fb217113cf7d tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] [instance: 851d1bac-67b3-4477-8109-c37791c90f1b] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 12:59:30.503378 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3967befd-9827-4973-ad1f-fb217113cf7d tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:59:30.504297 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3967befd-9827-4973-ad1f-fb217113cf7d tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:59:30.508265 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3967befd-9827-4973-ad1f-fb217113cf7d tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:59:30.512935 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3967befd-9827-4973-ad1f-fb217113cf7d tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:59:30.568626 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-6774ff35-8130-4ec2-93a9-bdba8c35b9a5 tempest-VolumesSnapshotsTestJSON-694893183 tempest-VolumesSnapshotsTestJSON-694893183-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/fab52147-01f3-4dcc-aec4-ba778e824c67" status: 200 len: 286 microversion: 2.1 time: 0.165072 Nov 23 12:59:30.572292 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 20/30] 10.222.0.60 () {58 vars in 1250 bytes} [Tue Nov 23 12:59:30 2021] GET /compute/v2.1/os-snapshots/fab52147-01f3-4dcc-aec4-ba778e824c67 => generated 286 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 12:59:30.744277 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-0684a861-bb93-4225-acc4-b63e00ef3ab8 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:59:30.745130 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-0684a861-bb93-4225-acc4-b63e00ef3ab8 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: a3b02d0f-db9d-4996-a245-7237e989670d] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 12:59:30.762861 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0684a861-bb93-4225-acc4-b63e00ef3ab8 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:59:30.763375 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0684a861-bb93-4225-acc4-b63e00ef3ab8 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:59:30.764113 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0684a861-bb93-4225-acc4-b63e00ef3ab8 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:59:30.764580 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0684a861-bb93-4225-acc4-b63e00ef3ab8 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:59:30.792917 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-3967befd-9827-4973-ad1f-fb217113cf7d tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7adc68cc5d47fea458da9232672087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d153c67e84449bb8eb36b752ec41896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 12:59:30.807295 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-3967befd-9827-4973-ad1f-fb217113cf7d tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] 10.222.0.60 "GET /compute/v2.1/servers/851d1bac-67b3-4477-8109-c37791c90f1b" status: 200 len: 1266 microversion: 2.1 time: 0.339513 Nov 23 12:59:30.810490 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 11/31] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 12:59:30 2021] GET /compute/v2.1/servers/851d1bac-67b3-4477-8109-c37791c90f1b => generated 1266 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 12:59:30.977539 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-0684a861-bb93-4225-acc4-b63e00ef3ab8 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c023f89fd3da4bc8b38963bed4e5cc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a31364455dc442f8df299a8ad758a4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 12:59:30.987823 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-0684a861-bb93-4225-acc4-b63e00ef3ab8 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/a3b02d0f-db9d-4996-a245-7237e989670d" status: 200 len: 1213 microversion: 2.1 time: 0.248499 Nov 23 12:59:30.991883 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 21/32] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 12:59:30 2021] GET /compute/v2.1/servers/a3b02d0f-db9d-4996-a245-7237e989670d => generated 1213 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 12:59:31.582745 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-c6c590d7-26e2-479e-baa1-dc3213f9fdde tempest-VolumesSnapshotsTestJSON-694893183 tempest-VolumesSnapshotsTestJSON-694893183-project] Calling method '.version_select at 0x7f1870fad3a0>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:59:31.672884 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-c6c590d7-26e2-479e-baa1-dc3213f9fdde tempest-VolumesSnapshotsTestJSON-694893183 tempest-VolumesSnapshotsTestJSON-694893183-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/fab52147-01f3-4dcc-aec4-ba778e824c67" status: 200 len: 286 microversion: 2.1 time: 0.095337 Nov 23 12:59:31.673957 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 12/33] 10.222.0.60 () {58 vars in 1250 bytes} [Tue Nov 23 12:59:31 2021] GET /compute/v2.1/os-snapshots/fab52147-01f3-4dcc-aec4-ba778e824c67 => generated 286 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 12:59:31.826386 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-a4adc948-7f54-4423-8601-eda9066c462b tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:59:31.826989 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-a4adc948-7f54-4423-8601-eda9066c462b tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] [instance: 851d1bac-67b3-4477-8109-c37791c90f1b] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 12:59:31.846769 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a4adc948-7f54-4423-8601-eda9066c462b tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:59:31.848850 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a4adc948-7f54-4423-8601-eda9066c462b tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:59:31.849640 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a4adc948-7f54-4423-8601-eda9066c462b tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:59:31.852924 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a4adc948-7f54-4423-8601-eda9066c462b tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:59:32.023816 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-b0675472-e63a-42d1-9e6b-6c552e1aba12 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:59:32.024613 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-b0675472-e63a-42d1-9e6b-6c552e1aba12 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: a3b02d0f-db9d-4996-a245-7237e989670d] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 12:59:32.035259 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b0675472-e63a-42d1-9e6b-6c552e1aba12 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:59:32.035985 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b0675472-e63a-42d1-9e6b-6c552e1aba12 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:59:32.037951 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b0675472-e63a-42d1-9e6b-6c552e1aba12 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:59:32.038711 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b0675472-e63a-42d1-9e6b-6c552e1aba12 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:59:32.095317 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-a4adc948-7f54-4423-8601-eda9066c462b tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7adc68cc5d47fea458da9232672087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d153c67e84449bb8eb36b752ec41896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 12:59:32.110673 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-a4adc948-7f54-4423-8601-eda9066c462b tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] 10.222.0.60 "GET /compute/v2.1/servers/851d1bac-67b3-4477-8109-c37791c90f1b" status: 200 len: 1266 microversion: 2.1 time: 0.288026 Nov 23 12:59:32.111563 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 22/34] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 12:59:31 2021] GET /compute/v2.1/servers/851d1bac-67b3-4477-8109-c37791c90f1b => generated 1266 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 12:59:32.373134 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-b0675472-e63a-42d1-9e6b-6c552e1aba12 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c023f89fd3da4bc8b38963bed4e5cc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a31364455dc442f8df299a8ad758a4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 12:59:32.390458 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-b0675472-e63a-42d1-9e6b-6c552e1aba12 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/a3b02d0f-db9d-4996-a245-7237e989670d" status: 200 len: 1213 microversion: 2.1 time: 0.384050 Nov 23 12:59:32.393651 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 13/35] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 12:59:32 2021] GET /compute/v2.1/servers/a3b02d0f-db9d-4996-a245-7237e989670d => generated 1213 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 12:59:32.691187 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-1d74a515-e9fd-4133-b5ac-a1cb804fa1cc tempest-VolumesSnapshotsTestJSON-694893183 tempest-VolumesSnapshotsTestJSON-694893183-project] Calling method '.version_select at 0x7f1870f42700>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:59:32.843013 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-1d74a515-e9fd-4133-b5ac-a1cb804fa1cc tempest-VolumesSnapshotsTestJSON-694893183 tempest-VolumesSnapshotsTestJSON-694893183-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/fab52147-01f3-4dcc-aec4-ba778e824c67" status: 200 len: 286 microversion: 2.1 time: 0.161830 Nov 23 12:59:32.847265 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 23/36] 10.222.0.60 () {58 vars in 1250 bytes} [Tue Nov 23 12:59:32 2021] GET /compute/v2.1/os-snapshots/fab52147-01f3-4dcc-aec4-ba778e824c67 => generated 286 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 12:59:33.130479 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-1eb21a9d-554c-4a62-8841-02a1b430b8e4 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:59:33.133699 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-1eb21a9d-554c-4a62-8841-02a1b430b8e4 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] [instance: 851d1bac-67b3-4477-8109-c37791c90f1b] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 12:59:33.146857 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1eb21a9d-554c-4a62-8841-02a1b430b8e4 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:59:33.147540 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1eb21a9d-554c-4a62-8841-02a1b430b8e4 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:59:33.149468 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1eb21a9d-554c-4a62-8841-02a1b430b8e4 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:59:33.150489 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1eb21a9d-554c-4a62-8841-02a1b430b8e4 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:59:33.324545 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-5ffc362d-a92c-49ef-91ad-75230f5591dd tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-28295726", "imageRef": "d01e1b62-4f14-4f64-9d63-d155732e33e8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "46c00580-7af0-47cf-b859-90a9d5ad1c01"}], "security_groups": [{"name": "tempest-securitygroup--2025081591"}], "key_name": "tempest-keypair-1733058349", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 12:59:33.373885 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-1eb21a9d-554c-4a62-8841-02a1b430b8e4 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7adc68cc5d47fea458da9232672087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d153c67e84449bb8eb36b752ec41896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 12:59:33.386330 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-1eb21a9d-554c-4a62-8841-02a1b430b8e4 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] 10.222.0.60 "GET /compute/v2.1/servers/851d1bac-67b3-4477-8109-c37791c90f1b" status: 200 len: 1266 microversion: 2.1 time: 0.261077 Nov 23 12:59:33.386926 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 14/37] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 12:59:33 2021] GET /compute/v2.1/servers/851d1bac-67b3-4477-8109-c37791c90f1b => generated 1266 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 12:59:33.424656 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-cd12bb64-49e4-40c1-998c-827b6b54b40a tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:59:33.425515 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-cd12bb64-49e4-40c1-998c-827b6b54b40a tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: a3b02d0f-db9d-4996-a245-7237e989670d] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 12:59:33.436308 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-cd12bb64-49e4-40c1-998c-827b6b54b40a tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:59:33.438942 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-cd12bb64-49e4-40c1-998c-827b6b54b40a tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:59:33.440895 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-cd12bb64-49e4-40c1-998c-827b6b54b40a tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:59:33.441437 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-cd12bb64-49e4-40c1-998c-827b6b54b40a tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:59:33.515463 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.network.neutron [None req-5ffc362d-a92c-49ef-91ad-75230f5591dd tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] validate_networks() for [('46c00580-7af0-47cf-b859-90a9d5ad1c01', None, None, None)] {{(pid=100973) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Nov 23 12:59:33.761675 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-cd12bb64-49e4-40c1-998c-827b6b54b40a tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c023f89fd3da4bc8b38963bed4e5cc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a31364455dc442f8df299a8ad758a4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 12:59:33.778271 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-cd12bb64-49e4-40c1-998c-827b6b54b40a tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/a3b02d0f-db9d-4996-a245-7237e989670d" status: 200 len: 1213 microversion: 2.1 time: 0.363628 Nov 23 12:59:33.793671 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 15/38] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 12:59:33 2021] GET /compute/v2.1/servers/a3b02d0f-db9d-4996-a245-7237e989670d => generated 1213 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 12:59:33.856117 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-e81a1973-3b4e-4ce2-a256-0d817ad2efc4 tempest-VolumesSnapshotsTestJSON-694893183 tempest-VolumesSnapshotsTestJSON-694893183-project] Calling method '.version_select at 0x7f1870fad1f0>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:59:33.952205 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-e81a1973-3b4e-4ce2-a256-0d817ad2efc4 tempest-VolumesSnapshotsTestJSON-694893183 tempest-VolumesSnapshotsTestJSON-694893183-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/fab52147-01f3-4dcc-aec4-ba778e824c67" status: 200 len: 286 microversion: 2.1 time: 0.101085 Nov 23 12:59:33.953095 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 16/39] 10.222.0.60 () {58 vars in 1250 bytes} [Tue Nov 23 12:59:33 2021] GET /compute/v2.1/os-snapshots/fab52147-01f3-4dcc-aec4-ba778e824c67 => generated 286 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 12:59:34.462002 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.virt.hardware [None req-5ffc362d-a92c-49ef-91ad-75230f5591dd tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Flavor limits 0:0:0 {{(pid=100973) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 23 12:59:34.462452 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.virt.hardware [None req-5ffc362d-a92c-49ef-91ad-75230f5591dd tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Image limits 0:0:0 {{(pid=100973) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 23 12:59:34.462924 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.virt.hardware [None req-5ffc362d-a92c-49ef-91ad-75230f5591dd tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Flavor pref 0:0:0 {{(pid=100973) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 23 12:59:34.463697 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.virt.hardware [None req-5ffc362d-a92c-49ef-91ad-75230f5591dd tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Image pref 0:0:0 {{(pid=100973) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 23 12:59:34.464036 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.virt.hardware [None req-5ffc362d-a92c-49ef-91ad-75230f5591dd tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100973) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 23 12:59:34.475788 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5ffc362d-a92c-49ef-91ad-75230f5591dd tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:59:34.476203 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5ffc362d-a92c-49ef-91ad-75230f5591dd tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:59:34.477045 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5ffc362d-a92c-49ef-91ad-75230f5591dd tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:59:34.477475 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5ffc362d-a92c-49ef-91ad-75230f5591dd tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:59:34.519279 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.quota [None req-5ffc362d-a92c-49ef-91ad-75230f5591dd tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Getting quotas for project d3e13e13e1e54f208b7be1c18e3ab703. Resources: {'ram', 'cores', 'instances'} {{(pid=100973) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 12:59:34.529102 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.quota [None req-5ffc362d-a92c-49ef-91ad-75230f5591dd tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Getting quotas for user 4540fb62ff264ba4929a567b548de846 and project d3e13e13e1e54f208b7be1c18e3ab703. Resources: {'ram', 'cores', 'instances'} {{(pid=100973) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 12:59:34.561250 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-5ffc362d-a92c-49ef-91ad-75230f5591dd tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Going to run 1 instances... {{(pid=100973) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Nov 23 12:59:34.565337 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-5ffc362d-a92c-49ef-91ad-75230f5591dd tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d01e1b62-4f14-4f64-9d63-d155732e33e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100973) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Nov 23 12:59:34.681193 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-5ffc362d-a92c-49ef-91ad-75230f5591dd tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.361114 Nov 23 12:59:34.682465 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 24/40] 10.222.0.60 () {62 vars in 1187 bytes} [Tue Nov 23 12:59:33 2021] POST /compute/v2.1/servers => generated 402 bytes in 1364 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 23 12:59:34.693755 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-0b505388-d40e-4283-9271-63179690c72c tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:59:34.695146 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-0b505388-d40e-4283-9271-63179690c72c tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] [instance: 851d1bac-67b3-4477-8109-c37791c90f1b] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 12:59:34.714494 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0b505388-d40e-4283-9271-63179690c72c tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:59:34.721431 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0b505388-d40e-4283-9271-63179690c72c tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:59:34.722272 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0b505388-d40e-4283-9271-63179690c72c tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:59:34.722716 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0b505388-d40e-4283-9271-63179690c72c tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:59:35.106472 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-0b505388-d40e-4283-9271-63179690c72c tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7adc68cc5d47fea458da9232672087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d153c67e84449bb8eb36b752ec41896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 12:59:35.119735 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-10b86581-408c-4878-83a0-5b7c08fa62b6 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-282197445", "imageRef": "d01e1b62-4f14-4f64-9d63-d155732e33e8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "59045e15-b578-47ca-abc6-4d73d6cc6fc2"}]}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 12:59:35.133267 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-0b505388-d40e-4283-9271-63179690c72c tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] 10.222.0.60 "GET /compute/v2.1/servers/851d1bac-67b3-4477-8109-c37791c90f1b" status: 200 len: 1274 microversion: 2.1 time: 0.449412 Nov 23 12:59:35.133889 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 25/41] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 12:59:34 2021] GET /compute/v2.1/servers/851d1bac-67b3-4477-8109-c37791c90f1b => generated 1274 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 12:59:35.169389 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-357dda2c-933d-4f5a-b532-803b490ae9d0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:59:35.170535 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-357dda2c-933d-4f5a-b532-803b490ae9d0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 12:59:35.299038 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-357dda2c-933d-4f5a-b532-803b490ae9d0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 12:59:35.312788 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.network.neutron [None req-10b86581-408c-4878-83a0-5b7c08fa62b6 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] validate_networks() for [('59045e15-b578-47ca-abc6-4d73d6cc6fc2', None, None, None)] {{(pid=100974) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Nov 23 12:59:35.318682 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-357dda2c-933d-4f5a-b532-803b490ae9d0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 12:59:35.320215 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-357dda2c-933d-4f5a-b532-803b490ae9d0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 12:59:35.322796 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-357dda2c-933d-4f5a-b532-803b490ae9d0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1280 microversion: 2.20 time: 0.187753 Nov 23 12:59:35.325130 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 26/42] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 12:59:35 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1280 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 12:59:35.333486 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-e5ed44ca-9f11-41d8-832d-e9b110565158 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:59:35.337353 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-e5ed44ca-9f11-41d8-832d-e9b110565158 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: a3b02d0f-db9d-4996-a245-7237e989670d] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 12:59:35.359133 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e5ed44ca-9f11-41d8-832d-e9b110565158 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:59:35.362202 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e5ed44ca-9f11-41d8-832d-e9b110565158 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:59:35.363210 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e5ed44ca-9f11-41d8-832d-e9b110565158 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:59:35.363794 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e5ed44ca-9f11-41d8-832d-e9b110565158 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:59:35.682231 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-e5ed44ca-9f11-41d8-832d-e9b110565158 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c023f89fd3da4bc8b38963bed4e5cc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a31364455dc442f8df299a8ad758a4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 12:59:35.705098 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-e5ed44ca-9f11-41d8-832d-e9b110565158 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/a3b02d0f-db9d-4996-a245-7237e989670d" status: 200 len: 1277 microversion: 2.1 time: 0.378546 Nov 23 12:59:35.706375 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 27/43] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 12:59:35 2021] GET /compute/v2.1/servers/a3b02d0f-db9d-4996-a245-7237e989670d => generated 1277 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 12:59:35.720482 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-e87c52b4-72fa-4c3b-a2c8-f74b588221d4 tempest-VolumesSnapshotsTestJSON-694893183 tempest-VolumesSnapshotsTestJSON-694893183-project] Calling method '.version_select at 0x7f1870f42ee0>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:59:35.837714 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.wsgi [None req-e87c52b4-72fa-4c3b-a2c8-f74b588221d4 tempest-VolumesSnapshotsTestJSON-694893183 tempest-VolumesSnapshotsTestJSON-694893183-project] HTTP exception thrown: Snapshot fab52147-01f3-4dcc-aec4-ba778e824c67 could not be found. Nov 23 12:59:35.838529 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-e87c52b4-72fa-4c3b-a2c8-f74b588221d4 tempest-VolumesSnapshotsTestJSON-694893183 tempest-VolumesSnapshotsTestJSON-694893183-project] Returning 404 to user: Snapshot fab52147-01f3-4dcc-aec4-ba778e824c67 could not be found. {{(pid=100973) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Nov 23 12:59:35.839737 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-e87c52b4-72fa-4c3b-a2c8-f74b588221d4 tempest-VolumesSnapshotsTestJSON-694893183 tempest-VolumesSnapshotsTestJSON-694893183-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/fab52147-01f3-4dcc-aec4-ba778e824c67" status: 404 len: 111 microversion: 2.1 time: 0.132156 Nov 23 12:59:35.840800 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 28/44] 10.222.0.60 () {58 vars in 1250 bytes} [Tue Nov 23 12:59:35 2021] GET /compute/v2.1/os-snapshots/fab52147-01f3-4dcc-aec4-ba778e824c67 => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 12:59:35.849336 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-ba35b35b-5ee7-44e4-ab2c-8e77f96ffbdd tempest-VolumesSnapshotsTestJSON-694893183 tempest-VolumesSnapshotsTestJSON-694893183-project] Calling method '.version_select at 0x7f18706a15e0>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:59:36.085890 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-ba35b35b-5ee7-44e4-ab2c-8e77f96ffbdd tempest-VolumesSnapshotsTestJSON-694893183 tempest-VolumesSnapshotsTestJSON-694893183-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/9f0150ba-fadc-4bae-a5ee-7c8d2cf28f24" status: 202 len: 0 microversion: 2.1 time: 0.240936 Nov 23 12:59:36.091180 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 29/45] 10.222.0.60 () {58 vars in 1247 bytes} [Tue Nov 23 12:59:35 2021] DELETE /compute/v2.1/os-volumes/9f0150ba-fadc-4bae-a5ee-7c8d2cf28f24 => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 23 12:59:36.099458 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-486cdcb2-2278-4374-914a-2cb9a2861f29 tempest-VolumesSnapshotsTestJSON-694893183 tempest-VolumesSnapshotsTestJSON-694893183-project] Calling method '.version_select at 0x7f1870f42d30>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:59:36.421157 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-486cdcb2-2278-4374-914a-2cb9a2861f29 tempest-VolumesSnapshotsTestJSON-694893183 tempest-VolumesSnapshotsTestJSON-694893183-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/9f0150ba-fadc-4bae-a5ee-7c8d2cf28f24" status: 200 len: 345 microversion: 2.1 time: 0.325520 Nov 23 12:59:36.421778 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 30/46] 10.222.0.60 () {58 vars in 1244 bytes} [Tue Nov 23 12:59:36 2021] GET /compute/v2.1/os-volumes/9f0150ba-fadc-4bae-a5ee-7c8d2cf28f24 => generated 345 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 12:59:36.426503 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-a19896d3-f251-4dc9-8c87-6450199ebd66 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:59:36.427125 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-a19896d3-f251-4dc9-8c87-6450199ebd66 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] [instance: 851d1bac-67b3-4477-8109-c37791c90f1b] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 12:59:36.464498 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a19896d3-f251-4dc9-8c87-6450199ebd66 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:59:36.465273 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a19896d3-f251-4dc9-8c87-6450199ebd66 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:59:36.466264 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a19896d3-f251-4dc9-8c87-6450199ebd66 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:59:36.466705 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a19896d3-f251-4dc9-8c87-6450199ebd66 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:59:36.728597 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-a19896d3-f251-4dc9-8c87-6450199ebd66 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7adc68cc5d47fea458da9232672087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d153c67e84449bb8eb36b752ec41896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 12:59:36.745317 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-a19896d3-f251-4dc9-8c87-6450199ebd66 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] 10.222.0.60 "GET /compute/v2.1/servers/851d1bac-67b3-4477-8109-c37791c90f1b" status: 200 len: 1272 microversion: 2.1 time: 0.322013 Nov 23 12:59:36.746656 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 31/47] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 12:59:36 2021] GET /compute/v2.1/servers/851d1bac-67b3-4477-8109-c37791c90f1b => generated 1272 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 12:59:36.753279 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-e5b9b6ba-e6f8-4c41-9adc-ae897c80dd6b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:59:36.754228 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-e5b9b6ba-e6f8-4c41-9adc-ae897c80dd6b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 12:59:36.779112 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e5b9b6ba-e6f8-4c41-9adc-ae897c80dd6b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:59:36.779842 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e5b9b6ba-e6f8-4c41-9adc-ae897c80dd6b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:59:36.781293 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e5b9b6ba-e6f8-4c41-9adc-ae897c80dd6b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:59:36.781951 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e5b9b6ba-e6f8-4c41-9adc-ae897c80dd6b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:59:37.203264 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-e5b9b6ba-e6f8-4c41-9adc-ae897c80dd6b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 12:59:37.231665 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-e5b9b6ba-e6f8-4c41-9adc-ae897c80dd6b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 12:59:37.233743 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-e5b9b6ba-e6f8-4c41-9adc-ae897c80dd6b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 12:59:37.238723 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-e5b9b6ba-e6f8-4c41-9adc-ae897c80dd6b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1340 microversion: 2.20 time: 0.490557 Nov 23 12:59:37.244622 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 32/48] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 12:59:36 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1340 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 12:59:37.265327 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-7fafd03e-404d-4084-b246-dd3a26cb3970 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:59:37.272966 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-7fafd03e-404d-4084-b246-dd3a26cb3970 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: a3b02d0f-db9d-4996-a245-7237e989670d] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 12:59:37.309315 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-7fafd03e-404d-4084-b246-dd3a26cb3970 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:59:37.310000 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-7fafd03e-404d-4084-b246-dd3a26cb3970 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:59:37.312883 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-7fafd03e-404d-4084-b246-dd3a26cb3970 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:59:37.313337 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-7fafd03e-404d-4084-b246-dd3a26cb3970 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:59:38.303932 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-7fafd03e-404d-4084-b246-dd3a26cb3970 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c023f89fd3da4bc8b38963bed4e5cc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a31364455dc442f8df299a8ad758a4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 12:59:38.323448 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-7fafd03e-404d-4084-b246-dd3a26cb3970 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/a3b02d0f-db9d-4996-a245-7237e989670d" status: 200 len: 1317 microversion: 2.1 time: 1.075993 Nov 23 12:59:38.325040 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 33/49] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 12:59:37 2021] GET /compute/v2.1/servers/a3b02d0f-db9d-4996-a245-7237e989670d => generated 1317 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 12:59:38.347643 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-825f1cb6-7a3d-4136-ab4a-b29d5bc5163f tempest-VolumesSnapshotsTestJSON-694893183 tempest-VolumesSnapshotsTestJSON-694893183-project] Calling method '.version_select at 0x7f1870f7eee0>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:59:38.581969 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.wsgi [None req-825f1cb6-7a3d-4136-ab4a-b29d5bc5163f tempest-VolumesSnapshotsTestJSON-694893183 tempest-VolumesSnapshotsTestJSON-694893183-project] HTTP exception thrown: Volume 9f0150ba-fadc-4bae-a5ee-7c8d2cf28f24 could not be found. Nov 23 12:59:38.583146 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-825f1cb6-7a3d-4136-ab4a-b29d5bc5163f tempest-VolumesSnapshotsTestJSON-694893183 tempest-VolumesSnapshotsTestJSON-694893183-project] Returning 404 to user: Volume 9f0150ba-fadc-4bae-a5ee-7c8d2cf28f24 could not be found. {{(pid=100973) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Nov 23 12:59:38.584206 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-825f1cb6-7a3d-4136-ab4a-b29d5bc5163f tempest-VolumesSnapshotsTestJSON-694893183 tempest-VolumesSnapshotsTestJSON-694893183-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/9f0150ba-fadc-4bae-a5ee-7c8d2cf28f24" status: 404 len: 109 microversion: 2.1 time: 0.254201 Nov 23 12:59:38.584960 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 34/50] 10.222.0.60 () {58 vars in 1244 bytes} [Tue Nov 23 12:59:38 2021] GET /compute/v2.1/os-volumes/9f0150ba-fadc-4bae-a5ee-7c8d2cf28f24 => generated 109 bytes in 257 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 12:59:38.592870 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-28ebd5fd-5b7b-4648-9835-808a5363d997 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:59:38.596578 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-28ebd5fd-5b7b-4648-9835-808a5363d997 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] [instance: 851d1bac-67b3-4477-8109-c37791c90f1b] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 12:59:38.641293 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-28ebd5fd-5b7b-4648-9835-808a5363d997 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:59:38.645002 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-28ebd5fd-5b7b-4648-9835-808a5363d997 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:59:38.645973 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-28ebd5fd-5b7b-4648-9835-808a5363d997 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:59:38.647152 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-28ebd5fd-5b7b-4648-9835-808a5363d997 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:59:39.048091 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-28ebd5fd-5b7b-4648-9835-808a5363d997 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7adc68cc5d47fea458da9232672087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d153c67e84449bb8eb36b752ec41896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 12:59:39.057989 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-28ebd5fd-5b7b-4648-9835-808a5363d997 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] 10.222.0.60 "GET /compute/v2.1/servers/851d1bac-67b3-4477-8109-c37791c90f1b" status: 200 len: 1272 microversion: 2.1 time: 0.471681 Nov 23 12:59:39.070234 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 35/51] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 12:59:38 2021] GET /compute/v2.1/servers/851d1bac-67b3-4477-8109-c37791c90f1b => generated 1272 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 12:59:39.080866 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-565b0677-03c9-40c6-9d22-d3cae99c2239 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:59:39.084134 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-565b0677-03c9-40c6-9d22-d3cae99c2239 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 12:59:39.099830 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-565b0677-03c9-40c6-9d22-d3cae99c2239 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:59:39.100554 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-565b0677-03c9-40c6-9d22-d3cae99c2239 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:59:39.101491 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-565b0677-03c9-40c6-9d22-d3cae99c2239 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:59:39.106808 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-565b0677-03c9-40c6-9d22-d3cae99c2239 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:59:39.179231 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.virt.hardware [None req-10b86581-408c-4878-83a0-5b7c08fa62b6 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Flavor limits 0:0:0 {{(pid=100974) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 23 12:59:39.179705 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.virt.hardware [None req-10b86581-408c-4878-83a0-5b7c08fa62b6 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Image limits 0:0:0 {{(pid=100974) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 23 12:59:39.180123 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.virt.hardware [None req-10b86581-408c-4878-83a0-5b7c08fa62b6 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Flavor pref 0:0:0 {{(pid=100974) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 23 12:59:39.180599 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.virt.hardware [None req-10b86581-408c-4878-83a0-5b7c08fa62b6 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Image pref 0:0:0 {{(pid=100974) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 23 12:59:39.181464 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.virt.hardware [None req-10b86581-408c-4878-83a0-5b7c08fa62b6 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100974) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 23 12:59:39.207909 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-10b86581-408c-4878-83a0-5b7c08fa62b6 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:59:39.208388 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-10b86581-408c-4878-83a0-5b7c08fa62b6 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:59:39.209206 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-10b86581-408c-4878-83a0-5b7c08fa62b6 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:59:39.209671 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-10b86581-408c-4878-83a0-5b7c08fa62b6 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:59:39.269653 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.quota [None req-10b86581-408c-4878-83a0-5b7c08fa62b6 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Getting quotas for project 9bd7c1ce491e474c970f1a7cc5effe19. Resources: {'ram', 'cores', 'instances'} {{(pid=100974) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 12:59:39.296872 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.quota [None req-10b86581-408c-4878-83a0-5b7c08fa62b6 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Getting quotas for user 9285e1edf7ed42029c54bcc4f86abda7 and project 9bd7c1ce491e474c970f1a7cc5effe19. Resources: {'ram', 'cores', 'instances'} {{(pid=100974) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 12:59:39.339008 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-10b86581-408c-4878-83a0-5b7c08fa62b6 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Going to run 1 instances... {{(pid=100974) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Nov 23 12:59:39.348869 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-10b86581-408c-4878-83a0-5b7c08fa62b6 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: 53633a05-ad06-454a-b540-5fc01821ae45] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d01e1b62-4f14-4f64-9d63-d155732e33e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100974) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Nov 23 12:59:39.486590 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-10b86581-408c-4878-83a0-5b7c08fa62b6 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.118412 Nov 23 12:59:39.499948 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 17/52] 10.222.0.60 () {60 vars in 1146 bytes} [Tue Nov 23 12:59:34 2021] POST /compute/v2.1/servers => generated 383 bytes in 5130 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 23 12:59:39.505811 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-37c6eac0-452f-4ac6-8b91-c68c29841072 tempest-VolumesSnapshotsTestJSON-694893183 tempest-VolumesSnapshotsTestJSON-694893183-project] Calling method '.version_select at 0x7f1871effd30>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:59:39.567323 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-565b0677-03c9-40c6-9d22-d3cae99c2239 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 12:59:39.579097 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-565b0677-03c9-40c6-9d22-d3cae99c2239 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 12:59:39.580642 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-565b0677-03c9-40c6-9d22-d3cae99c2239 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 12:59:39.581732 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-565b0677-03c9-40c6-9d22-d3cae99c2239 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1338 microversion: 2.20 time: 0.510216 Nov 23 12:59:39.582308 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 36/53] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 12:59:39 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1338 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 12:59:39.618026 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-492085fa-08bc-4812-9240-cf2c7a146a0f tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:59:39.625355 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-492085fa-08bc-4812-9240-cf2c7a146a0f tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: a3b02d0f-db9d-4996-a245-7237e989670d] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 12:59:39.648682 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-492085fa-08bc-4812-9240-cf2c7a146a0f tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:59:39.653083 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-492085fa-08bc-4812-9240-cf2c7a146a0f tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:59:39.653942 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-492085fa-08bc-4812-9240-cf2c7a146a0f tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:59:39.654378 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-492085fa-08bc-4812-9240-cf2c7a146a0f tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:59:39.817403 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.wsgi [None req-37c6eac0-452f-4ac6-8b91-c68c29841072 tempest-VolumesSnapshotsTestJSON-694893183 tempest-VolumesSnapshotsTestJSON-694893183-project] HTTP exception thrown: Volume 9f0150ba-fadc-4bae-a5ee-7c8d2cf28f24 could not be found. Nov 23 12:59:39.818003 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-37c6eac0-452f-4ac6-8b91-c68c29841072 tempest-VolumesSnapshotsTestJSON-694893183 tempest-VolumesSnapshotsTestJSON-694893183-project] Returning 404 to user: Volume 9f0150ba-fadc-4bae-a5ee-7c8d2cf28f24 could not be found. {{(pid=100974) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Nov 23 12:59:39.819024 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-37c6eac0-452f-4ac6-8b91-c68c29841072 tempest-VolumesSnapshotsTestJSON-694893183 tempest-VolumesSnapshotsTestJSON-694893183-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/9f0150ba-fadc-4bae-a5ee-7c8d2cf28f24" status: 404 len: 109 microversion: 2.1 time: 0.317506 Nov 23 12:59:39.820335 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 18/54] 10.222.0.60 () {58 vars in 1247 bytes} [Tue Nov 23 12:59:39 2021] DELETE /compute/v2.1/os-volumes/9f0150ba-fadc-4bae-a5ee-7c8d2cf28f24 => generated 109 bytes in 319 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 12:59:39.826389 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-52e149e8-3f7d-4cb8-85ab-b1f7b944212f tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:59:39.838117 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-52e149e8-3f7d-4cb8-85ab-b1f7b944212f tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: 53633a05-ad06-454a-b540-5fc01821ae45] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 12:59:40.530343 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-52e149e8-3f7d-4cb8-85ab-b1f7b944212f tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 12:59:40.558585 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-52e149e8-3f7d-4cb8-85ab-b1f7b944212f tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45" status: 200 len: 1221 microversion: 2.1 time: 0.735855 Nov 23 12:59:40.563231 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 19/55] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 12:59:39 2021] GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45 => generated 1221 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 12:59:40.577275 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-3d02d6f0-bcc7-4e40-b8dc-294c2a68e365 tempest-VolumesSnapshotsTestJSON-694893183 tempest-VolumesSnapshotsTestJSON-694893183-project] Calling method '.version_select at 0x7f1870fad700>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:59:40.850569 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.wsgi [None req-3d02d6f0-bcc7-4e40-b8dc-294c2a68e365 tempest-VolumesSnapshotsTestJSON-694893183 tempest-VolumesSnapshotsTestJSON-694893183-project] HTTP exception thrown: Volume 9f0150ba-fadc-4bae-a5ee-7c8d2cf28f24 could not be found. Nov 23 12:59:40.851853 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-3d02d6f0-bcc7-4e40-b8dc-294c2a68e365 tempest-VolumesSnapshotsTestJSON-694893183 tempest-VolumesSnapshotsTestJSON-694893183-project] Returning 404 to user: Volume 9f0150ba-fadc-4bae-a5ee-7c8d2cf28f24 could not be found. {{(pid=100974) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Nov 23 12:59:40.853069 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-3d02d6f0-bcc7-4e40-b8dc-294c2a68e365 tempest-VolumesSnapshotsTestJSON-694893183 tempest-VolumesSnapshotsTestJSON-694893183-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/9f0150ba-fadc-4bae-a5ee-7c8d2cf28f24" status: 404 len: 109 microversion: 2.1 time: 0.287878 Nov 23 12:59:40.854604 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 20/56] 10.222.0.60 () {58 vars in 1244 bytes} [Tue Nov 23 12:59:40 2021] GET /compute/v2.1/os-volumes/9f0150ba-fadc-4bae-a5ee-7c8d2cf28f24 => generated 109 bytes in 291 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 12:59:40.876147 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-b82f9970-faec-4035-bf92-2ee79cb213e6 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:59:40.876838 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-b82f9970-faec-4035-bf92-2ee79cb213e6 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] [instance: 851d1bac-67b3-4477-8109-c37791c90f1b] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 12:59:40.919563 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b82f9970-faec-4035-bf92-2ee79cb213e6 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:59:40.920860 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b82f9970-faec-4035-bf92-2ee79cb213e6 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:59:40.923576 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b82f9970-faec-4035-bf92-2ee79cb213e6 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:59:40.924314 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b82f9970-faec-4035-bf92-2ee79cb213e6 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:59:41.709382 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-492085fa-08bc-4812-9240-cf2c7a146a0f tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c023f89fd3da4bc8b38963bed4e5cc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a31364455dc442f8df299a8ad758a4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 12:59:41.724980 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-492085fa-08bc-4812-9240-cf2c7a146a0f tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/a3b02d0f-db9d-4996-a245-7237e989670d" status: 200 len: 1317 microversion: 2.1 time: 2.117676 Nov 23 12:59:41.726545 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 37/57] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 12:59:39 2021] GET /compute/v2.1/servers/a3b02d0f-db9d-4996-a245-7237e989670d => generated 1317 bytes in 2144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 12:59:41.734576 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-b68a759d-ba82-4261-87f8-271cfcde1b7c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:59:41.749161 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-b68a759d-ba82-4261-87f8-271cfcde1b7c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 12:59:41.772448 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b68a759d-ba82-4261-87f8-271cfcde1b7c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:59:41.789425 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b68a759d-ba82-4261-87f8-271cfcde1b7c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:59:41.790925 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b68a759d-ba82-4261-87f8-271cfcde1b7c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:59:41.817082 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b68a759d-ba82-4261-87f8-271cfcde1b7c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:59:42.696194 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-b68a759d-ba82-4261-87f8-271cfcde1b7c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 12:59:42.707433 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-b68a759d-ba82-4261-87f8-271cfcde1b7c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 12:59:42.732682 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-b68a759d-ba82-4261-87f8-271cfcde1b7c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 12:59:42.735125 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-b68a759d-ba82-4261-87f8-271cfcde1b7c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1338 microversion: 2.20 time: 1.005625 Nov 23 12:59:42.757935 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 38/58] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 12:59:41 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1338 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 12:59:42.771164 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-eed4362f-5df2-44ab-819c-748c35de7d2b tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-885641665", "imageRef": "d01e1b62-4f14-4f64-9d63-d155732e33e8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "59045e15-b578-47ca-abc6-4d73d6cc6fc2"}]}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 12:59:42.915660 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.network.neutron [None req-eed4362f-5df2-44ab-819c-748c35de7d2b tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] validate_networks() for [('59045e15-b578-47ca-abc6-4d73d6cc6fc2', None, None, None)] {{(pid=100973) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Nov 23 12:59:44.283750 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-b82f9970-faec-4035-bf92-2ee79cb213e6 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7adc68cc5d47fea458da9232672087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d153c67e84449bb8eb36b752ec41896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 12:59:44.308503 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-b82f9970-faec-4035-bf92-2ee79cb213e6 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] 10.222.0.60 "GET /compute/v2.1/servers/851d1bac-67b3-4477-8109-c37791c90f1b" status: 200 len: 1314 microversion: 2.1 time: 3.451749 Nov 23 12:59:44.312661 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 21/59] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 12:59:40 2021] GET /compute/v2.1/servers/851d1bac-67b3-4477-8109-c37791c90f1b => generated 1314 bytes in 3457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 12:59:44.337774 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-dd65e739-6f29-4dea-9c76-dc39c97a65e4 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:59:44.339338 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-dd65e739-6f29-4dea-9c76-dc39c97a65e4 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: a3b02d0f-db9d-4996-a245-7237e989670d] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 12:59:44.356765 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-dd65e739-6f29-4dea-9c76-dc39c97a65e4 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:59:44.370159 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-dd65e739-6f29-4dea-9c76-dc39c97a65e4 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:59:44.373257 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-dd65e739-6f29-4dea-9c76-dc39c97a65e4 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:59:44.373968 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-dd65e739-6f29-4dea-9c76-dc39c97a65e4 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:59:44.389326 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.virt.hardware [None req-eed4362f-5df2-44ab-819c-748c35de7d2b tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Flavor limits 0:0:0 {{(pid=100973) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 23 12:59:44.390337 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.virt.hardware [None req-eed4362f-5df2-44ab-819c-748c35de7d2b tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Image limits 0:0:0 {{(pid=100973) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 23 12:59:44.390997 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.virt.hardware [None req-eed4362f-5df2-44ab-819c-748c35de7d2b tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Flavor pref 0:0:0 {{(pid=100973) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 23 12:59:44.391584 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.virt.hardware [None req-eed4362f-5df2-44ab-819c-748c35de7d2b tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Image pref 0:0:0 {{(pid=100973) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 23 12:59:44.392134 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.virt.hardware [None req-eed4362f-5df2-44ab-819c-748c35de7d2b tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100973) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 23 12:59:44.406000 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-eed4362f-5df2-44ab-819c-748c35de7d2b tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:59:44.408323 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-eed4362f-5df2-44ab-819c-748c35de7d2b tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:59:44.409425 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-eed4362f-5df2-44ab-819c-748c35de7d2b tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:59:44.411399 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-eed4362f-5df2-44ab-819c-748c35de7d2b tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:59:44.463806 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.quota [None req-eed4362f-5df2-44ab-819c-748c35de7d2b tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Getting quotas for project 9bd7c1ce491e474c970f1a7cc5effe19. Resources: {'ram', 'cores', 'instances'} {{(pid=100973) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 12:59:44.470136 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.quota [None req-eed4362f-5df2-44ab-819c-748c35de7d2b tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Getting quotas for user 9285e1edf7ed42029c54bcc4f86abda7 and project 9bd7c1ce491e474c970f1a7cc5effe19. Resources: {'ram', 'cores', 'instances'} {{(pid=100973) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 12:59:44.482791 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-eed4362f-5df2-44ab-819c-748c35de7d2b tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Going to run 1 instances... {{(pid=100973) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Nov 23 12:59:44.485689 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-eed4362f-5df2-44ab-819c-748c35de7d2b tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: bc54276f-764d-49ee-b58e-552822acc211] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d01e1b62-4f14-4f64-9d63-d155732e33e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100973) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Nov 23 12:59:44.614746 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-eed4362f-5df2-44ab-819c-748c35de7d2b tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.854310 Nov 23 12:59:44.622891 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 39/60] 10.222.0.60 () {60 vars in 1146 bytes} [Tue Nov 23 12:59:42 2021] POST /compute/v2.1/servers => generated 383 bytes in 1864 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 23 12:59:44.929189 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [req-7a335535-53a3-4b5e-aadc-1140f7edd292 req-cad3e0a5-5687-49cf-9fd0-7e5eed652d79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3b02d0f-db9d-4996-a245-7237e989670d", "tag": "2c117b14-8ae9-4517-8547-e104cbcb9a21"}]} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 12:59:44.931776 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 12:59:44.931776 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: warnings.warn(msg) Nov 23 12:59:44.959858 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [req-7a335535-53a3-4b5e-aadc-1140f7edd292 req-cad3e0a5-5687-49cf-9fd0-7e5eed652d79 service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:59:44.961915 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [req-7a335535-53a3-4b5e-aadc-1140f7edd292 req-cad3e0a5-5687-49cf-9fd0-7e5eed652d79 service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:59:45.040948 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.compute.server_external_events [req-7a335535-53a3-4b5e-aadc-1140f7edd292 req-cad3e0a5-5687-49cf-9fd0-7e5eed652d79 service nova] Creating event network-changed:2c117b14-8ae9-4517-8547-e104cbcb9a21 for instance a3b02d0f-db9d-4996-a245-7237e989670d on hv-cinder-81888 Nov 23 12:59:45.043732 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [req-7a335535-53a3-4b5e-aadc-1140f7edd292 req-cad3e0a5-5687-49cf-9fd0-7e5eed652d79 service nova] Acquired lock "compute-rpcapi-router" {{(pid=100973) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Nov 23 12:59:45.052305 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-02c0f377-3682-4f0d-82c6-4ada9c374eaa None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:59:45.056815 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-02c0f377-3682-4f0d-82c6-4ada9c374eaa None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:59:45.058811 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-02c0f377-3682-4f0d-82c6-4ada9c374eaa None None] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:59:45.059253 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-02c0f377-3682-4f0d-82c6-4ada9c374eaa None None] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:59:45.112703 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.compute.rpcapi [None req-02c0f377-3682-4f0d-82c6-4ada9c374eaa None None] Automatically selected compute RPC version 6.0 from minimum service version 56 Nov 23 12:59:45.115745 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-02c0f377-3682-4f0d-82c6-4ada9c374eaa None None] Releasing lock "compute-rpcapi-router" {{(pid=100973) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Nov 23 12:59:45.223088 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-02c0f377-3682-4f0d-82c6-4ada9c374eaa None None] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.598656 Nov 23 12:59:45.224073 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 40/61] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Nov 23 12:59:44 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 12:59:45.240105 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-fafb3ac5-c636-4e51-bad3-c52a940bd078 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:59:45.244138 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-fafb3ac5-c636-4e51-bad3-c52a940bd078 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 12:59:45.268406 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-fafb3ac5-c636-4e51-bad3-c52a940bd078 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:59:45.270045 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-fafb3ac5-c636-4e51-bad3-c52a940bd078 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:59:45.274141 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-fafb3ac5-c636-4e51-bad3-c52a940bd078 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:59:45.275380 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-fafb3ac5-c636-4e51-bad3-c52a940bd078 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:59:45.991561 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-fafb3ac5-c636-4e51-bad3-c52a940bd078 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 12:59:46.006362 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-fafb3ac5-c636-4e51-bad3-c52a940bd078 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 12:59:46.007927 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-fafb3ac5-c636-4e51-bad3-c52a940bd078 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 12:59:46.009678 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-fafb3ac5-c636-4e51-bad3-c52a940bd078 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1406 microversion: 2.20 time: 0.783761 Nov 23 12:59:46.010597 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 41/62] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 12:59:45 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1406 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 12:59:46.021309 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-8f4f415d-16f2-49ca-a157-708d31a036db tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:59:46.059081 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-8f4f415d-16f2-49ca-a157-708d31a036db tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: bc54276f-764d-49ee-b58e-552822acc211] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 12:59:46.085521 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8f4f415d-16f2-49ca-a157-708d31a036db tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:59:46.090612 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8f4f415d-16f2-49ca-a157-708d31a036db tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:59:46.091320 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8f4f415d-16f2-49ca-a157-708d31a036db tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:59:46.091762 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8f4f415d-16f2-49ca-a157-708d31a036db tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:59:46.360768 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-8f4f415d-16f2-49ca-a157-708d31a036db tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 12:59:46.379042 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-8f4f415d-16f2-49ca-a157-708d31a036db tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211" status: 200 len: 1217 microversion: 2.1 time: 0.367161 Nov 23 12:59:46.382924 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 42/63] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 12:59:46 2021] GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211 => generated 1217 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 12:59:46.403491 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-294bb912-9bac-410e-a04c-76eb2c1ffe98 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:59:46.407201 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-294bb912-9bac-410e-a04c-76eb2c1ffe98 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] [instance: 851d1bac-67b3-4477-8109-c37791c90f1b] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 12:59:46.447526 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-294bb912-9bac-410e-a04c-76eb2c1ffe98 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:59:46.448470 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-294bb912-9bac-410e-a04c-76eb2c1ffe98 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:59:46.451517 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-294bb912-9bac-410e-a04c-76eb2c1ffe98 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:59:46.452016 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-294bb912-9bac-410e-a04c-76eb2c1ffe98 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:59:47.172128 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-dd65e739-6f29-4dea-9c76-dc39c97a65e4 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c023f89fd3da4bc8b38963bed4e5cc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a31364455dc442f8df299a8ad758a4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 12:59:47.183309 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-dd65e739-6f29-4dea-9c76-dc39c97a65e4 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/a3b02d0f-db9d-4996-a245-7237e989670d" status: 200 len: 1317 microversion: 2.1 time: 2.866954 Nov 23 12:59:47.201506 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 22/64] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 12:59:44 2021] GET /compute/v2.1/servers/a3b02d0f-db9d-4996-a245-7237e989670d => generated 1317 bytes in 2888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 12:59:47.209719 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-baa257fa-2253-40d8-9676-d897be930699 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:59:47.210334 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-baa257fa-2253-40d8-9676-d897be930699 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 12:59:47.262491 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-baa257fa-2253-40d8-9676-d897be930699 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:59:47.263705 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-baa257fa-2253-40d8-9676-d897be930699 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:59:47.266228 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-baa257fa-2253-40d8-9676-d897be930699 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:59:47.269140 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-baa257fa-2253-40d8-9676-d897be930699 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:59:47.416603 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-294bb912-9bac-410e-a04c-76eb2c1ffe98 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7adc68cc5d47fea458da9232672087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d153c67e84449bb8eb36b752ec41896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 12:59:47.448218 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-294bb912-9bac-410e-a04c-76eb2c1ffe98 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] 10.222.0.60 "GET /compute/v2.1/servers/851d1bac-67b3-4477-8109-c37791c90f1b" status: 200 len: 1314 microversion: 2.1 time: 1.058506 Nov 23 12:59:47.457296 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 43/65] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 12:59:46 2021] GET /compute/v2.1/servers/851d1bac-67b3-4477-8109-c37791c90f1b => generated 1314 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 12:59:47.477678 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-a2b5c9cf-2647-485a-9344-89bc9b685a70 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:59:47.481034 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-a2b5c9cf-2647-485a-9344-89bc9b685a70 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: bc54276f-764d-49ee-b58e-552822acc211] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 12:59:47.513693 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a2b5c9cf-2647-485a-9344-89bc9b685a70 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:59:47.514589 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a2b5c9cf-2647-485a-9344-89bc9b685a70 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:59:47.518864 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a2b5c9cf-2647-485a-9344-89bc9b685a70 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:59:47.519583 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a2b5c9cf-2647-485a-9344-89bc9b685a70 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:59:47.857019 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-a2b5c9cf-2647-485a-9344-89bc9b685a70 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 12:59:47.874220 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-a2b5c9cf-2647-485a-9344-89bc9b685a70 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211" status: 200 len: 1273 microversion: 2.1 time: 0.414125 Nov 23 12:59:47.885985 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 44/66] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 12:59:47 2021] GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211 => generated 1273 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 12:59:48.204974 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-5c8fbe2b-61f0-4482-8d10-1a802c2a70e2 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:59:48.205592 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-5c8fbe2b-61f0-4482-8d10-1a802c2a70e2 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: a3b02d0f-db9d-4996-a245-7237e989670d] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 12:59:48.221541 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5c8fbe2b-61f0-4482-8d10-1a802c2a70e2 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:59:48.221989 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5c8fbe2b-61f0-4482-8d10-1a802c2a70e2 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:59:48.222943 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5c8fbe2b-61f0-4482-8d10-1a802c2a70e2 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:59:48.223471 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5c8fbe2b-61f0-4482-8d10-1a802c2a70e2 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:59:48.726063 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-5c8fbe2b-61f0-4482-8d10-1a802c2a70e2 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c023f89fd3da4bc8b38963bed4e5cc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a31364455dc442f8df299a8ad758a4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 12:59:48.745312 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-5c8fbe2b-61f0-4482-8d10-1a802c2a70e2 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/a3b02d0f-db9d-4996-a245-7237e989670d" status: 200 len: 1317 microversion: 2.1 time: 0.544467 Nov 23 12:59:48.760350 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 45/67] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 12:59:48 2021] GET /compute/v2.1/servers/a3b02d0f-db9d-4996-a245-7237e989670d => generated 1317 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 12:59:48.760350 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-a2bc50cb-635f-47da-a467-2f853b780f79 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:59:48.760350 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-a2bc50cb-635f-47da-a467-2f853b780f79 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] [instance: 851d1bac-67b3-4477-8109-c37791c90f1b] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 12:59:48.763661 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a2bc50cb-635f-47da-a467-2f853b780f79 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:59:48.764778 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a2bc50cb-635f-47da-a467-2f853b780f79 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:59:48.765870 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a2bc50cb-635f-47da-a467-2f853b780f79 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:59:48.779148 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a2bc50cb-635f-47da-a467-2f853b780f79 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:59:48.956880 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-baa257fa-2253-40d8-9676-d897be930699 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 12:59:48.974047 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-baa257fa-2253-40d8-9676-d897be930699 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 12:59:49.007712 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-baa257fa-2253-40d8-9676-d897be930699 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 12:59:49.011021 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-baa257fa-2253-40d8-9676-d897be930699 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1406 microversion: 2.20 time: 1.808335 Nov 23 12:59:49.029017 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 23/68] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 12:59:47 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1406 bytes in 1827 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 12:59:49.048826 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-eb8bcfcc-2d14-4e7f-8c09-448d766d2e03 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:59:49.052536 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-eb8bcfcc-2d14-4e7f-8c09-448d766d2e03 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: bc54276f-764d-49ee-b58e-552822acc211] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 12:59:49.076691 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-eb8bcfcc-2d14-4e7f-8c09-448d766d2e03 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:59:49.077171 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-eb8bcfcc-2d14-4e7f-8c09-448d766d2e03 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:59:49.080936 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-eb8bcfcc-2d14-4e7f-8c09-448d766d2e03 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:59:49.082012 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-eb8bcfcc-2d14-4e7f-8c09-448d766d2e03 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:59:49.286513 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-a2bc50cb-635f-47da-a467-2f853b780f79 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7adc68cc5d47fea458da9232672087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d153c67e84449bb8eb36b752ec41896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 12:59:49.297142 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-a2bc50cb-635f-47da-a467-2f853b780f79 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] 10.222.0.60 "GET /compute/v2.1/servers/851d1bac-67b3-4477-8109-c37791c90f1b" status: 200 len: 1314 microversion: 2.1 time: 0.549231 Nov 23 12:59:49.297733 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 46/69] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 12:59:48 2021] GET /compute/v2.1/servers/851d1bac-67b3-4477-8109-c37791c90f1b => generated 1314 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 12:59:49.672699 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [req-17fef169-9669-4d11-9663-e34c1f4159b5 req-c3244f3a-90ec-4838-995d-41a6cda83e3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "851d1bac-67b3-4477-8109-c37791c90f1b", "tag": "e47ad125-0726-4518-a3bc-ae85b21ef184"}]} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 12:59:49.674421 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 12:59:49.674421 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: warnings.warn(msg) Nov 23 12:59:49.706515 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [req-17fef169-9669-4d11-9663-e34c1f4159b5 req-c3244f3a-90ec-4838-995d-41a6cda83e3a service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:59:49.706958 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [req-17fef169-9669-4d11-9663-e34c1f4159b5 req-c3244f3a-90ec-4838-995d-41a6cda83e3a service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:59:49.733634 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-eb8bcfcc-2d14-4e7f-8c09-448d766d2e03 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 12:59:49.744630 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-eb8bcfcc-2d14-4e7f-8c09-448d766d2e03 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211" status: 200 len: 1273 microversion: 2.1 time: 0.714214 Nov 23 12:59:49.755340 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 24/70] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 12:59:49 2021] GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211 => generated 1273 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 12:59:49.768686 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.compute.server_external_events [req-17fef169-9669-4d11-9663-e34c1f4159b5 req-c3244f3a-90ec-4838-995d-41a6cda83e3a service nova] Creating event network-changed:e47ad125-0726-4518-a3bc-ae85b21ef184 for instance 851d1bac-67b3-4477-8109-c37791c90f1b on hv-cinder-81888 Nov 23 12:59:49.778121 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-d390e6cd-36cf-4c84-9424-65932ceed6d1 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:59:49.779874 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-d390e6cd-36cf-4c84-9424-65932ceed6d1 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: a3b02d0f-db9d-4996-a245-7237e989670d] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 12:59:49.789048 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d390e6cd-36cf-4c84-9424-65932ceed6d1 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:59:49.790081 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d390e6cd-36cf-4c84-9424-65932ceed6d1 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:59:49.791407 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d390e6cd-36cf-4c84-9424-65932ceed6d1 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:59:49.792062 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d390e6cd-36cf-4c84-9424-65932ceed6d1 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:59:49.830192 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [req-17fef169-9669-4d11-9663-e34c1f4159b5 req-c3244f3a-90ec-4838-995d-41a6cda83e3a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.528413 Nov 23 12:59:49.830808 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 47/71] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Nov 23 12:59:49 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 12:59:50.033929 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-de9c5959-45a9-4945-a63f-fd9b35b47a00 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:59:50.034640 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-de9c5959-45a9-4945-a63f-fd9b35b47a00 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 12:59:50.044164 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-de9c5959-45a9-4945-a63f-fd9b35b47a00 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:59:50.044656 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-de9c5959-45a9-4945-a63f-fd9b35b47a00 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:59:50.045480 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-de9c5959-45a9-4945-a63f-fd9b35b47a00 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:59:50.046071 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-de9c5959-45a9-4945-a63f-fd9b35b47a00 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:59:50.249713 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-d390e6cd-36cf-4c84-9424-65932ceed6d1 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c023f89fd3da4bc8b38963bed4e5cc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a31364455dc442f8df299a8ad758a4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 12:59:50.259941 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-d390e6cd-36cf-4c84-9424-65932ceed6d1 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/a3b02d0f-db9d-4996-a245-7237e989670d" status: 200 len: 1317 microversion: 2.1 time: 0.486112 Nov 23 12:59:50.270202 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 25/72] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 12:59:49 2021] GET /compute/v2.1/servers/a3b02d0f-db9d-4996-a245-7237e989670d => generated 1317 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 12:59:50.338739 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-de9c5959-45a9-4945-a63f-fd9b35b47a00 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 12:59:50.348818 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-de9c5959-45a9-4945-a63f-fd9b35b47a00 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 12:59:50.350434 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-de9c5959-45a9-4945-a63f-fd9b35b47a00 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 12:59:50.351634 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-de9c5959-45a9-4945-a63f-fd9b35b47a00 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1406 microversion: 2.20 time: 0.323247 Nov 23 12:59:50.352470 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 48/73] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 12:59:50 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1406 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 12:59:50.357246 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-8028d516-1134-4710-ac9b-fa9c09ee9142 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:59:50.358335 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-8028d516-1134-4710-ac9b-fa9c09ee9142 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] [instance: 851d1bac-67b3-4477-8109-c37791c90f1b] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 12:59:50.371604 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8028d516-1134-4710-ac9b-fa9c09ee9142 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:59:50.372424 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8028d516-1134-4710-ac9b-fa9c09ee9142 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:59:50.373885 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8028d516-1134-4710-ac9b-fa9c09ee9142 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:59:50.374325 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8028d516-1134-4710-ac9b-fa9c09ee9142 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:59:50.559428 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-6ea55a3f-f8a6-4ea5-a7d5-ef97bb3bb94a tempest-VolumesGetTestJSON-1517719644 tempest-VolumesGetTestJSON-1517719644-project] Action: 'create', calling method: .version_select at 0x7f1870ef6790>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-222599016", "metadata": {"Type": "work"}}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 12:59:50.592706 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-8028d516-1134-4710-ac9b-fa9c09ee9142 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7adc68cc5d47fea458da9232672087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d153c67e84449bb8eb36b752ec41896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 12:59:50.601699 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-8028d516-1134-4710-ac9b-fa9c09ee9142 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] 10.222.0.60 "GET /compute/v2.1/servers/851d1bac-67b3-4477-8109-c37791c90f1b" status: 200 len: 1314 microversion: 2.1 time: 0.247910 Nov 23 12:59:50.604282 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 49/74] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 12:59:50 2021] GET /compute/v2.1/servers/851d1bac-67b3-4477-8109-c37791c90f1b => generated 1314 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 12:59:50.771796 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-03d60b23-43f0-4cee-979c-24488293dc1f tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:59:50.772566 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-03d60b23-43f0-4cee-979c-24488293dc1f tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: bc54276f-764d-49ee-b58e-552822acc211] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 12:59:50.781818 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-03d60b23-43f0-4cee-979c-24488293dc1f tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:59:50.782521 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-03d60b23-43f0-4cee-979c-24488293dc1f tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:59:50.783573 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-03d60b23-43f0-4cee-979c-24488293dc1f tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:59:50.784023 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-03d60b23-43f0-4cee-979c-24488293dc1f tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:59:50.943864 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-03d60b23-43f0-4cee-979c-24488293dc1f tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 12:59:50.952652 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-03d60b23-43f0-4cee-979c-24488293dc1f tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211" status: 200 len: 1273 microversion: 2.1 time: 0.188138 Nov 23 12:59:50.953965 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 50/75] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 12:59:50 2021] GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211 => generated 1273 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 12:59:51.063854 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-6ea55a3f-f8a6-4ea5-a7d5-ef97bb3bb94a tempest-VolumesGetTestJSON-1517719644 tempest-VolumesGetTestJSON-1517719644-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.792037 Nov 23 12:59:51.075741 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 26/76] 10.222.0.60 () {60 vars in 1155 bytes} [Tue Nov 23 12:59:50 2021] POST /compute/v2.1/os-volumes => generated 352 bytes in 805 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Nov 23 12:59:51.079071 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-e4688572-e883-42b5-9d80-a9a0e2e3c8d9 tempest-VolumesGetTestJSON-1517719644 tempest-VolumesGetTestJSON-1517719644-project] Calling method '.version_select at 0x7f18706d6670>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:59:51.277858 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-77665d6a-653a-4c57-bfa4-93d5f533e4b6 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:59:51.278541 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-77665d6a-653a-4c57-bfa4-93d5f533e4b6 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: a3b02d0f-db9d-4996-a245-7237e989670d] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 12:59:51.286812 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-77665d6a-653a-4c57-bfa4-93d5f533e4b6 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:59:51.287531 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-77665d6a-653a-4c57-bfa4-93d5f533e4b6 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:59:51.288530 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-77665d6a-653a-4c57-bfa4-93d5f533e4b6 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:59:51.289270 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-77665d6a-653a-4c57-bfa4-93d5f533e4b6 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:59:51.302993 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-e4688572-e883-42b5-9d80-a9a0e2e3c8d9 tempest-VolumesGetTestJSON-1517719644 tempest-VolumesGetTestJSON-1517719644-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/a92dd313-b1bb-453f-8018-c0796cef225a" status: 200 len: 352 microversion: 2.1 time: 0.230886 Nov 23 12:59:51.303750 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 51/77] 10.222.0.60 () {58 vars in 1244 bytes} [Tue Nov 23 12:59:51 2021] GET /compute/v2.1/os-volumes/a92dd313-b1bb-453f-8018-c0796cef225a => generated 352 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 12:59:51.371651 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-17e4f895-7967-4a2c-8e69-79d0d69fff65 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:59:51.373589 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-17e4f895-7967-4a2c-8e69-79d0d69fff65 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 12:59:51.385581 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-17e4f895-7967-4a2c-8e69-79d0d69fff65 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:59:51.386182 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-17e4f895-7967-4a2c-8e69-79d0d69fff65 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:59:51.387429 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-17e4f895-7967-4a2c-8e69-79d0d69fff65 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:59:51.388005 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-17e4f895-7967-4a2c-8e69-79d0d69fff65 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:59:51.811609 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-17e4f895-7967-4a2c-8e69-79d0d69fff65 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 12:59:51.823142 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-17e4f895-7967-4a2c-8e69-79d0d69fff65 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 12:59:51.826817 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-17e4f895-7967-4a2c-8e69-79d0d69fff65 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 12:59:51.827970 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-17e4f895-7967-4a2c-8e69-79d0d69fff65 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1406 microversion: 2.20 time: 0.461522 Nov 23 12:59:51.839262 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 52/78] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 12:59:51 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1406 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 12:59:51.860609 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-36907203-1120-4a35-a9f2-2ccce6ef2f0b tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:59:51.861236 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-36907203-1120-4a35-a9f2-2ccce6ef2f0b tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] [instance: 851d1bac-67b3-4477-8109-c37791c90f1b] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 12:59:51.874517 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-36907203-1120-4a35-a9f2-2ccce6ef2f0b tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:59:51.875070 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-36907203-1120-4a35-a9f2-2ccce6ef2f0b tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:59:51.875860 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-36907203-1120-4a35-a9f2-2ccce6ef2f0b tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:59:51.876325 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-36907203-1120-4a35-a9f2-2ccce6ef2f0b tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:59:51.993874 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-77665d6a-653a-4c57-bfa4-93d5f533e4b6 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c023f89fd3da4bc8b38963bed4e5cc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a31364455dc442f8df299a8ad758a4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 12:59:52.007065 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-77665d6a-653a-4c57-bfa4-93d5f533e4b6 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/a3b02d0f-db9d-4996-a245-7237e989670d" status: 200 len: 1317 microversion: 2.1 time: 0.733344 Nov 23 12:59:52.022896 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 27/79] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 12:59:51 2021] GET /compute/v2.1/servers/a3b02d0f-db9d-4996-a245-7237e989670d => generated 1317 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 12:59:52.032290 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [req-13be24fa-e4d6-4818-b6b9-cffcef84dfc4 req-99312292-135e-48a1-8c42-6aa41e0ddc5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9c21729-a176-4e26-9074-f5f0bfc0ce20", "tag": "acc6c8bf-82a2-4f88-b12e-f6a39d6ce970"}]} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 12:59:52.041190 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 12:59:52.041190 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: warnings.warn(msg) Nov 23 12:59:52.058124 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [req-13be24fa-e4d6-4818-b6b9-cffcef84dfc4 req-99312292-135e-48a1-8c42-6aa41e0ddc5e service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:59:52.059003 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [req-13be24fa-e4d6-4818-b6b9-cffcef84dfc4 req-99312292-135e-48a1-8c42-6aa41e0ddc5e service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:59:52.094079 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.compute.server_external_events [req-13be24fa-e4d6-4818-b6b9-cffcef84dfc4 req-99312292-135e-48a1-8c42-6aa41e0ddc5e service nova] Creating event network-changed:acc6c8bf-82a2-4f88-b12e-f6a39d6ce970 for instance b9c21729-a176-4e26-9074-f5f0bfc0ce20 on hv-cinder-81888 Nov 23 12:59:52.094975 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [req-13be24fa-e4d6-4818-b6b9-cffcef84dfc4 req-99312292-135e-48a1-8c42-6aa41e0ddc5e service nova] Acquired lock "compute-rpcapi-router" {{(pid=100974) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Nov 23 12:59:52.098141 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ccba15c7-b34e-4c54-ac7f-cf5d890e1928 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:59:52.098896 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ccba15c7-b34e-4c54-ac7f-cf5d890e1928 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:59:52.100491 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ccba15c7-b34e-4c54-ac7f-cf5d890e1928 None None] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:59:52.101653 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ccba15c7-b34e-4c54-ac7f-cf5d890e1928 None None] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:59:52.114579 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.compute.rpcapi [None req-ccba15c7-b34e-4c54-ac7f-cf5d890e1928 None None] Automatically selected compute RPC version 6.0 from minimum service version 56 Nov 23 12:59:52.115635 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ccba15c7-b34e-4c54-ac7f-cf5d890e1928 None None] Releasing lock "compute-rpcapi-router" {{(pid=100974) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Nov 23 12:59:52.169913 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-ccba15c7-b34e-4c54-ac7f-cf5d890e1928 None None] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.143865 Nov 23 12:59:52.175780 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 28/80] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Nov 23 12:59:52 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 12:59:52.183665 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-57d6befd-8b26-4c3b-bea6-0f28811e852d tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:59:52.184382 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-57d6befd-8b26-4c3b-bea6-0f28811e852d tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: bc54276f-764d-49ee-b58e-552822acc211] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 12:59:52.192765 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-57d6befd-8b26-4c3b-bea6-0f28811e852d tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:59:52.192974 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-36907203-1120-4a35-a9f2-2ccce6ef2f0b tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7adc68cc5d47fea458da9232672087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d153c67e84449bb8eb36b752ec41896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 12:59:52.193714 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-57d6befd-8b26-4c3b-bea6-0f28811e852d tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:59:52.194639 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-57d6befd-8b26-4c3b-bea6-0f28811e852d tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:59:52.195233 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-57d6befd-8b26-4c3b-bea6-0f28811e852d tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:59:52.202937 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-36907203-1120-4a35-a9f2-2ccce6ef2f0b tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] 10.222.0.60 "GET /compute/v2.1/servers/851d1bac-67b3-4477-8109-c37791c90f1b" status: 200 len: 1314 microversion: 2.1 time: 0.371275 Nov 23 12:59:52.215942 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 53/81] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 12:59:51 2021] GET /compute/v2.1/servers/851d1bac-67b3-4477-8109-c37791c90f1b => generated 1314 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 12:59:52.314830 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-ec95eee3-d320-4951-b3f4-099f86d35a25 tempest-VolumesGetTestJSON-1517719644 tempest-VolumesGetTestJSON-1517719644-project] Calling method '.version_select at 0x7f1870676a60>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:59:52.418782 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-57d6befd-8b26-4c3b-bea6-0f28811e852d tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 12:59:52.456600 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-57d6befd-8b26-4c3b-bea6-0f28811e852d tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211" status: 200 len: 1281 microversion: 2.1 time: 0.279130 Nov 23 12:59:52.458725 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 29/82] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 12:59:52 2021] GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211 => generated 1281 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 12:59:52.609082 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-ec95eee3-d320-4951-b3f4-099f86d35a25 tempest-VolumesGetTestJSON-1517719644 tempest-VolumesGetTestJSON-1517719644-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/a92dd313-b1bb-453f-8018-c0796cef225a" status: 200 len: 353 microversion: 2.1 time: 0.297782 Nov 23 12:59:52.618845 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 54/83] 10.222.0.60 () {58 vars in 1244 bytes} [Tue Nov 23 12:59:52 2021] GET /compute/v2.1/os-volumes/a92dd313-b1bb-453f-8018-c0796cef225a => generated 353 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 12:59:52.621190 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-56cb0df9-049b-4023-8d38-1a2907b440c3 tempest-VolumesGetTestJSON-1517719644 tempest-VolumesGetTestJSON-1517719644-project] Calling method '.version_select at 0x7f1870eb8160>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:59:52.848267 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-bd1b932c-927d-4910-abad-2a4a6f6ebc98 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:59:52.849449 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-bd1b932c-927d-4910-abad-2a4a6f6ebc98 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 12:59:52.866802 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-bd1b932c-927d-4910-abad-2a4a6f6ebc98 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:59:52.869900 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-bd1b932c-927d-4910-abad-2a4a6f6ebc98 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:59:52.871185 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-bd1b932c-927d-4910-abad-2a4a6f6ebc98 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:59:52.873257 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-bd1b932c-927d-4910-abad-2a4a6f6ebc98 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:59:52.897142 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-56cb0df9-049b-4023-8d38-1a2907b440c3 tempest-VolumesGetTestJSON-1517719644 tempest-VolumesGetTestJSON-1517719644-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/a92dd313-b1bb-453f-8018-c0796cef225a" status: 200 len: 353 microversion: 2.1 time: 0.279649 Nov 23 12:59:52.910018 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 30/84] 10.222.0.60 () {58 vars in 1244 bytes} [Tue Nov 23 12:59:52 2021] GET /compute/v2.1/os-volumes/a92dd313-b1bb-453f-8018-c0796cef225a => generated 353 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 12:59:52.919686 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-4c61f471-9a8a-4c87-8e20-d4803b79f808 tempest-VolumesGetTestJSON-1517719644 tempest-VolumesGetTestJSON-1517719644-project] Calling method '.version_select at 0x7f1870eb8e50>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:59:53.176125 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-4c61f471-9a8a-4c87-8e20-d4803b79f808 tempest-VolumesGetTestJSON-1517719644 tempest-VolumesGetTestJSON-1517719644-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/a92dd313-b1bb-453f-8018-c0796cef225a" status: 202 len: 0 microversion: 2.1 time: 0.260053 Nov 23 12:59:53.177635 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 31/85] 10.222.0.60 () {58 vars in 1247 bytes} [Tue Nov 23 12:59:52 2021] DELETE /compute/v2.1/os-volumes/a92dd313-b1bb-453f-8018-c0796cef225a => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 12:59:53.183207 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-f997950e-0976-4e8e-af2c-535d4e129339 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:59:53.184653 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-f997950e-0976-4e8e-af2c-535d4e129339 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: a3b02d0f-db9d-4996-a245-7237e989670d] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 12:59:53.207942 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f997950e-0976-4e8e-af2c-535d4e129339 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:59:53.214521 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f997950e-0976-4e8e-af2c-535d4e129339 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:59:53.217105 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f997950e-0976-4e8e-af2c-535d4e129339 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:59:53.217796 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f997950e-0976-4e8e-af2c-535d4e129339 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:59:53.732453 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-bd1b932c-927d-4910-abad-2a4a6f6ebc98 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 12:59:53.746073 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-bd1b932c-927d-4910-abad-2a4a6f6ebc98 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 12:59:53.748565 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-bd1b932c-927d-4910-abad-2a4a6f6ebc98 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 12:59:53.750129 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-bd1b932c-927d-4910-abad-2a4a6f6ebc98 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1406 microversion: 2.20 time: 0.906412 Nov 23 12:59:53.751554 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 55/86] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 12:59:52 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1406 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 12:59:53.756681 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-0257a04f-83e3-4bac-9c4d-2341e4b6258a tempest-VolumesGetTestJSON-1517719644 tempest-VolumesGetTestJSON-1517719644-project] Calling method '.version_select at 0x7f18706760d0>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:59:53.935987 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-0257a04f-83e3-4bac-9c4d-2341e4b6258a tempest-VolumesGetTestJSON-1517719644 tempest-VolumesGetTestJSON-1517719644-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/a92dd313-b1bb-453f-8018-c0796cef225a" status: 200 len: 352 microversion: 2.1 time: 0.181803 Nov 23 12:59:53.937558 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 56/87] 10.222.0.60 () {58 vars in 1244 bytes} [Tue Nov 23 12:59:53 2021] GET /compute/v2.1/os-volumes/a92dd313-b1bb-453f-8018-c0796cef225a => generated 352 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 12:59:53.947840 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-d3781988-1c11-4882-9cc5-573cb346bfc4 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:59:53.948998 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-d3781988-1c11-4882-9cc5-573cb346bfc4 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] [instance: 851d1bac-67b3-4477-8109-c37791c90f1b] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 12:59:53.961168 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d3781988-1c11-4882-9cc5-573cb346bfc4 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:59:53.962131 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d3781988-1c11-4882-9cc5-573cb346bfc4 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:59:53.963495 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d3781988-1c11-4882-9cc5-573cb346bfc4 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:59:53.964687 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d3781988-1c11-4882-9cc5-573cb346bfc4 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:59:54.237143 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-f997950e-0976-4e8e-af2c-535d4e129339 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c023f89fd3da4bc8b38963bed4e5cc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a31364455dc442f8df299a8ad758a4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 12:59:54.257074 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-f997950e-0976-4e8e-af2c-535d4e129339 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/a3b02d0f-db9d-4996-a245-7237e989670d" status: 200 len: 1317 microversion: 2.1 time: 1.077593 Nov 23 12:59:54.258960 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 32/88] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 12:59:53 2021] GET /compute/v2.1/servers/a3b02d0f-db9d-4996-a245-7237e989670d => generated 1317 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 12:59:54.263725 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-609111ba-6f1a-4da4-bde9-cd357772a24e tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:59:54.264614 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-609111ba-6f1a-4da4-bde9-cd357772a24e tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: bc54276f-764d-49ee-b58e-552822acc211] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 12:59:54.273173 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-609111ba-6f1a-4da4-bde9-cd357772a24e tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:59:54.273816 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-609111ba-6f1a-4da4-bde9-cd357772a24e tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:59:54.274864 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-609111ba-6f1a-4da4-bde9-cd357772a24e tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:59:54.275513 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-609111ba-6f1a-4da4-bde9-cd357772a24e tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:59:54.366812 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-d3781988-1c11-4882-9cc5-573cb346bfc4 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7adc68cc5d47fea458da9232672087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d153c67e84449bb8eb36b752ec41896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 12:59:54.377102 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-d3781988-1c11-4882-9cc5-573cb346bfc4 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] 10.222.0.60 "GET /compute/v2.1/servers/851d1bac-67b3-4477-8109-c37791c90f1b" status: 200 len: 1314 microversion: 2.1 time: 0.436114 Nov 23 12:59:54.378335 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 57/89] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 12:59:53 2021] GET /compute/v2.1/servers/851d1bac-67b3-4477-8109-c37791c90f1b => generated 1314 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 12:59:54.639415 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [req-0c5f6360-231f-430f-99a6-655704a77e12 req-bc3b935f-4b23-4245-8fd3-6c50dbfbe10c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53633a05-ad06-454a-b540-5fc01821ae45", "tag": "12c0e1a4-3a5f-40d2-8b38-ebcd979a194c"}]} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 12:59:54.641146 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 12:59:54.641146 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: warnings.warn(msg) Nov 23 12:59:54.666065 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [req-0c5f6360-231f-430f-99a6-655704a77e12 req-bc3b935f-4b23-4245-8fd3-6c50dbfbe10c service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:59:54.670896 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [req-0c5f6360-231f-430f-99a6-655704a77e12 req-bc3b935f-4b23-4245-8fd3-6c50dbfbe10c service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:59:54.713498 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.compute.server_external_events [req-0c5f6360-231f-430f-99a6-655704a77e12 req-bc3b935f-4b23-4245-8fd3-6c50dbfbe10c service nova] Creating event network-changed:12c0e1a4-3a5f-40d2-8b38-ebcd979a194c for instance 53633a05-ad06-454a-b540-5fc01821ae45 on hv-cinder-81888 Nov 23 12:59:54.726210 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [req-0c5f6360-231f-430f-99a6-655704a77e12 req-bc3b935f-4b23-4245-8fd3-6c50dbfbe10c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090964 Nov 23 12:59:54.730698 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 58/90] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Nov 23 12:59:54 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 12:59:54.783405 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-733e52b4-d855-4217-a99b-15a669058f47 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:59:54.784738 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-733e52b4-d855-4217-a99b-15a669058f47 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 12:59:54.812114 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-733e52b4-d855-4217-a99b-15a669058f47 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:59:54.812614 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-733e52b4-d855-4217-a99b-15a669058f47 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:59:54.816426 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-733e52b4-d855-4217-a99b-15a669058f47 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:59:54.818153 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-733e52b4-d855-4217-a99b-15a669058f47 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:59:55.060309 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-609111ba-6f1a-4da4-bde9-cd357772a24e tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 12:59:55.071294 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-609111ba-6f1a-4da4-bde9-cd357772a24e tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211" status: 200 len: 1321 microversion: 2.1 time: 0.808460 Nov 23 12:59:55.073081 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 33/91] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 12:59:54 2021] GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211 => generated 1321 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 12:59:55.080120 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-ef30294a-8724-4cdd-afe3-f7eb21e5242b tempest-VolumesGetTestJSON-1517719644 tempest-VolumesGetTestJSON-1517719644-project] Calling method '.version_select at 0x7f1870eb8ee0>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:59:55.161451 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.wsgi [None req-ef30294a-8724-4cdd-afe3-f7eb21e5242b tempest-VolumesGetTestJSON-1517719644 tempest-VolumesGetTestJSON-1517719644-project] HTTP exception thrown: Volume a92dd313-b1bb-453f-8018-c0796cef225a could not be found. Nov 23 12:59:55.162183 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-ef30294a-8724-4cdd-afe3-f7eb21e5242b tempest-VolumesGetTestJSON-1517719644 tempest-VolumesGetTestJSON-1517719644-project] Returning 404 to user: Volume a92dd313-b1bb-453f-8018-c0796cef225a could not be found. {{(pid=100974) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Nov 23 12:59:55.163117 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-ef30294a-8724-4cdd-afe3-f7eb21e5242b tempest-VolumesGetTestJSON-1517719644 tempest-VolumesGetTestJSON-1517719644-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/a92dd313-b1bb-453f-8018-c0796cef225a" status: 404 len: 109 microversion: 2.1 time: 0.088978 Nov 23 12:59:55.167720 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 34/92] 10.222.0.60 () {58 vars in 1244 bytes} [Tue Nov 23 12:59:55 2021] GET /compute/v2.1/os-volumes/a92dd313-b1bb-453f-8018-c0796cef225a => generated 109 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 12:59:55.276782 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-7683e325-7443-48cd-b7e7-1514cdcb2659 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:59:55.276782 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-7683e325-7443-48cd-b7e7-1514cdcb2659 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: a3b02d0f-db9d-4996-a245-7237e989670d] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 12:59:55.287452 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-733e52b4-d855-4217-a99b-15a669058f47 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 12:59:55.292351 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7683e325-7443-48cd-b7e7-1514cdcb2659 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:59:55.292926 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7683e325-7443-48cd-b7e7-1514cdcb2659 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:59:55.294798 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7683e325-7443-48cd-b7e7-1514cdcb2659 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:59:55.296069 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7683e325-7443-48cd-b7e7-1514cdcb2659 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:59:55.301184 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-733e52b4-d855-4217-a99b-15a669058f47 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 12:59:55.303212 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-733e52b4-d855-4217-a99b-15a669058f47 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 12:59:55.304557 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-733e52b4-d855-4217-a99b-15a669058f47 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1406 microversion: 2.20 time: 0.537887 Nov 23 12:59:55.306096 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 59/93] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 12:59:54 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1406 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 12:59:55.394980 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-6526644a-55d8-4f32-8a50-60c669b22bc0 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:59:55.395789 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-6526644a-55d8-4f32-8a50-60c669b22bc0 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] [instance: 851d1bac-67b3-4477-8109-c37791c90f1b] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 12:59:55.407995 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6526644a-55d8-4f32-8a50-60c669b22bc0 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:59:55.408540 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6526644a-55d8-4f32-8a50-60c669b22bc0 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:59:55.409518 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6526644a-55d8-4f32-8a50-60c669b22bc0 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:59:55.409963 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6526644a-55d8-4f32-8a50-60c669b22bc0 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:59:55.794298 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-6526644a-55d8-4f32-8a50-60c669b22bc0 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7adc68cc5d47fea458da9232672087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d153c67e84449bb8eb36b752ec41896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 12:59:55.806134 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-6526644a-55d8-4f32-8a50-60c669b22bc0 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] 10.222.0.60 "GET /compute/v2.1/servers/851d1bac-67b3-4477-8109-c37791c90f1b" status: 200 len: 1314 microversion: 2.1 time: 0.415916 Nov 23 12:59:55.818072 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 60/94] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 12:59:55 2021] GET /compute/v2.1/servers/851d1bac-67b3-4477-8109-c37791c90f1b => generated 1314 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 12:59:55.911881 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [req-2e0a20d3-d1f6-4f20-8e69-f2b9bccdca18 req-e39c799a-dbd6-4937-8e37-e8bfaf85b93f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc54276f-764d-49ee-b58e-552822acc211", "tag": "4f32dbce-9338-45e3-a6af-9412f33ad987"}]} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 12:59:55.913761 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 12:59:55.913761 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: warnings.warn(msg) Nov 23 12:59:55.924338 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [req-2e0a20d3-d1f6-4f20-8e69-f2b9bccdca18 req-e39c799a-dbd6-4937-8e37-e8bfaf85b93f service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:59:55.925442 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [req-2e0a20d3-d1f6-4f20-8e69-f2b9bccdca18 req-e39c799a-dbd6-4937-8e37-e8bfaf85b93f service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:59:55.945566 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.compute.server_external_events [req-2e0a20d3-d1f6-4f20-8e69-f2b9bccdca18 req-e39c799a-dbd6-4937-8e37-e8bfaf85b93f service nova] Creating event network-changed:4f32dbce-9338-45e3-a6af-9412f33ad987 for instance bc54276f-764d-49ee-b58e-552822acc211 on hv-cinder-81888 Nov 23 12:59:55.950817 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [req-2e0a20d3-d1f6-4f20-8e69-f2b9bccdca18 req-e39c799a-dbd6-4937-8e37-e8bfaf85b93f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043113 Nov 23 12:59:55.951742 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 61/95] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Nov 23 12:59:55 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 12:59:56.070392 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-7683e325-7443-48cd-b7e7-1514cdcb2659 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c023f89fd3da4bc8b38963bed4e5cc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a31364455dc442f8df299a8ad758a4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 12:59:56.079862 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-7683e325-7443-48cd-b7e7-1514cdcb2659 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/a3b02d0f-db9d-4996-a245-7237e989670d" status: 200 len: 1317 microversion: 2.1 time: 0.808702 Nov 23 12:59:56.096587 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-ed6c452b-41cc-4ca7-b314-42bd525517aa tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:59:56.097599 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-ed6c452b-41cc-4ca7-b314-42bd525517aa tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: bc54276f-764d-49ee-b58e-552822acc211] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 12:59:56.102448 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 35/96] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 12:59:55 2021] GET /compute/v2.1/servers/a3b02d0f-db9d-4996-a245-7237e989670d => generated 1317 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 12:59:56.107789 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ed6c452b-41cc-4ca7-b314-42bd525517aa tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:59:56.109023 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ed6c452b-41cc-4ca7-b314-42bd525517aa tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:59:56.110012 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ed6c452b-41cc-4ca7-b314-42bd525517aa tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:59:56.110840 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ed6c452b-41cc-4ca7-b314-42bd525517aa tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:59:56.323399 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-1ffda271-07a4-4e54-89fb-ad1b90ea0f85 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:59:56.324583 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-1ffda271-07a4-4e54-89fb-ad1b90ea0f85 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 12:59:56.340031 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1ffda271-07a4-4e54-89fb-ad1b90ea0f85 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:59:56.340540 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1ffda271-07a4-4e54-89fb-ad1b90ea0f85 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:59:56.341303 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1ffda271-07a4-4e54-89fb-ad1b90ea0f85 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:59:56.341736 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1ffda271-07a4-4e54-89fb-ad1b90ea0f85 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:59:56.790893 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-ed6c452b-41cc-4ca7-b314-42bd525517aa tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 12:59:56.802074 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-ed6c452b-41cc-4ca7-b314-42bd525517aa tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211" status: 200 len: 1321 microversion: 2.1 time: 0.710507 Nov 23 12:59:56.806175 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 62/97] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 12:59:56 2021] GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211 => generated 1321 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 12:59:56.823315 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-bfbe27ef-621a-4af6-a1a4-0d12c3a1ab7d tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:59:56.824325 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-bfbe27ef-621a-4af6-a1a4-0d12c3a1ab7d tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] [instance: 851d1bac-67b3-4477-8109-c37791c90f1b] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 12:59:56.835598 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-bfbe27ef-621a-4af6-a1a4-0d12c3a1ab7d tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:59:56.837904 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-bfbe27ef-621a-4af6-a1a4-0d12c3a1ab7d tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:59:56.839852 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-bfbe27ef-621a-4af6-a1a4-0d12c3a1ab7d tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:59:56.843903 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-bfbe27ef-621a-4af6-a1a4-0d12c3a1ab7d tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:59:56.952897 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-1ffda271-07a4-4e54-89fb-ad1b90ea0f85 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 12:59:56.962567 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-1ffda271-07a4-4e54-89fb-ad1b90ea0f85 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 12:59:56.964271 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-1ffda271-07a4-4e54-89fb-ad1b90ea0f85 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 12:59:56.965362 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-1ffda271-07a4-4e54-89fb-ad1b90ea0f85 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1406 microversion: 2.20 time: 0.646289 Nov 23 12:59:56.969257 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 36/98] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 12:59:56 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1406 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 12:59:57.098666 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-5d341876-5708-4419-b35d-150263d3854c tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:59:57.099292 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-5d341876-5708-4419-b35d-150263d3854c tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: a3b02d0f-db9d-4996-a245-7237e989670d] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 12:59:57.112851 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5d341876-5708-4419-b35d-150263d3854c tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:59:57.113312 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5d341876-5708-4419-b35d-150263d3854c tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:59:57.114130 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5d341876-5708-4419-b35d-150263d3854c tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:59:57.114570 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5d341876-5708-4419-b35d-150263d3854c tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:59:57.572983 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-bfbe27ef-621a-4af6-a1a4-0d12c3a1ab7d tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7adc68cc5d47fea458da9232672087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d153c67e84449bb8eb36b752ec41896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 12:59:57.585118 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-bfbe27ef-621a-4af6-a1a4-0d12c3a1ab7d tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] 10.222.0.60 "GET /compute/v2.1/servers/851d1bac-67b3-4477-8109-c37791c90f1b" status: 200 len: 1314 microversion: 2.1 time: 0.765683 Nov 23 12:59:57.585360 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-5d341876-5708-4419-b35d-150263d3854c tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c023f89fd3da4bc8b38963bed4e5cc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a31364455dc442f8df299a8ad758a4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 12:59:57.597621 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 63/99] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 12:59:56 2021] GET /compute/v2.1/servers/851d1bac-67b3-4477-8109-c37791c90f1b => generated 1314 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 12:59:57.601310 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-5d341876-5708-4419-b35d-150263d3854c tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/a3b02d0f-db9d-4996-a245-7237e989670d" status: 200 len: 1317 microversion: 2.1 time: 0.507656 Nov 23 12:59:57.601927 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 37/100] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 12:59:57 2021] GET /compute/v2.1/servers/a3b02d0f-db9d-4996-a245-7237e989670d => generated 1317 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 12:59:57.822130 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-91996cba-2d23-4a92-8be9-a008aa8d4696 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:59:57.823286 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-91996cba-2d23-4a92-8be9-a008aa8d4696 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: bc54276f-764d-49ee-b58e-552822acc211] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 12:59:57.834047 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-91996cba-2d23-4a92-8be9-a008aa8d4696 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:59:57.843513 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-91996cba-2d23-4a92-8be9-a008aa8d4696 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:59:57.844481 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-91996cba-2d23-4a92-8be9-a008aa8d4696 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:59:57.845013 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-91996cba-2d23-4a92-8be9-a008aa8d4696 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:59:57.986902 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-c82ed164-9c7a-4972-b361-d31f828c19a3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:59:57.987579 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-c82ed164-9c7a-4972-b361-d31f828c19a3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 12:59:58.002480 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c82ed164-9c7a-4972-b361-d31f828c19a3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:59:58.002955 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c82ed164-9c7a-4972-b361-d31f828c19a3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:59:58.003732 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c82ed164-9c7a-4972-b361-d31f828c19a3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:59:58.004364 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c82ed164-9c7a-4972-b361-d31f828c19a3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:59:58.311438 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-c82ed164-9c7a-4972-b361-d31f828c19a3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 12:59:58.324575 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-c82ed164-9c7a-4972-b361-d31f828c19a3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 12:59:58.333019 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-c82ed164-9c7a-4972-b361-d31f828c19a3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 12:59:58.341256 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-c82ed164-9c7a-4972-b361-d31f828c19a3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1406 microversion: 2.20 time: 0.358065 Nov 23 12:59:58.342589 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 38/101] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 12:59:57 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1406 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 12:59:58.399369 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-91996cba-2d23-4a92-8be9-a008aa8d4696 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 12:59:58.414574 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-91996cba-2d23-4a92-8be9-a008aa8d4696 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211" status: 200 len: 1321 microversion: 2.1 time: 0.592096 Nov 23 12:59:58.415471 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 64/102] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 12:59:57 2021] GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211 => generated 1321 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 12:59:58.601384 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-37a76780-cbfa-43ea-9fdb-63c5d52ef059 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:59:58.602154 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-37a76780-cbfa-43ea-9fdb-63c5d52ef059 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] [instance: 851d1bac-67b3-4477-8109-c37791c90f1b] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 12:59:58.609821 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-37a76780-cbfa-43ea-9fdb-63c5d52ef059 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:59:58.610271 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-37a76780-cbfa-43ea-9fdb-63c5d52ef059 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:59:58.611045 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-37a76780-cbfa-43ea-9fdb-63c5d52ef059 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:59:58.611475 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-37a76780-cbfa-43ea-9fdb-63c5d52ef059 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:59:58.619266 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-7f129a83-3987-4fa2-a0fe-4784a12fd07b tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:59:58.620378 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-7f129a83-3987-4fa2-a0fe-4784a12fd07b tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: a3b02d0f-db9d-4996-a245-7237e989670d] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 12:59:58.637127 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-7f129a83-3987-4fa2-a0fe-4784a12fd07b tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:59:58.639452 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-7f129a83-3987-4fa2-a0fe-4784a12fd07b tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:59:58.640454 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-7f129a83-3987-4fa2-a0fe-4784a12fd07b tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:59:58.643058 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-7f129a83-3987-4fa2-a0fe-4784a12fd07b tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:59:58.985936 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-7f129a83-3987-4fa2-a0fe-4784a12fd07b tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c023f89fd3da4bc8b38963bed4e5cc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a31364455dc442f8df299a8ad758a4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 12:59:58.996991 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-7f129a83-3987-4fa2-a0fe-4784a12fd07b tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/a3b02d0f-db9d-4996-a245-7237e989670d" status: 200 len: 1317 microversion: 2.1 time: 0.382071 Nov 23 12:59:59.001123 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 65/103] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 12:59:58 2021] GET /compute/v2.1/servers/a3b02d0f-db9d-4996-a245-7237e989670d => generated 1317 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 12:59:59.077640 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-37a76780-cbfa-43ea-9fdb-63c5d52ef059 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7adc68cc5d47fea458da9232672087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d153c67e84449bb8eb36b752ec41896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 12:59:59.091628 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-37a76780-cbfa-43ea-9fdb-63c5d52ef059 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] 10.222.0.60 "GET /compute/v2.1/servers/851d1bac-67b3-4477-8109-c37791c90f1b" status: 200 len: 1314 microversion: 2.1 time: 0.491344 Nov 23 12:59:59.092084 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 39/104] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 12:59:58 2021] GET /compute/v2.1/servers/851d1bac-67b3-4477-8109-c37791c90f1b => generated 1314 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 12:59:59.361111 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-bbc3c432-08c5-42f6-8b5d-8adbcf71cd0c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:59:59.361922 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-bbc3c432-08c5-42f6-8b5d-8adbcf71cd0c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 12:59:59.369936 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-bbc3c432-08c5-42f6-8b5d-8adbcf71cd0c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:59:59.370470 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-bbc3c432-08c5-42f6-8b5d-8adbcf71cd0c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:59:59.371513 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-bbc3c432-08c5-42f6-8b5d-8adbcf71cd0c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:59:59.372043 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-bbc3c432-08c5-42f6-8b5d-8adbcf71cd0c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:59:59.434127 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-efb62184-e404-453c-a92b-d8b4eb6caa36 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 12:59:59.435136 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-efb62184-e404-453c-a92b-d8b4eb6caa36 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: bc54276f-764d-49ee-b58e-552822acc211] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 12:59:59.451562 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-efb62184-e404-453c-a92b-d8b4eb6caa36 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:59:59.452374 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-efb62184-e404-453c-a92b-d8b4eb6caa36 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:59:59.454116 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-efb62184-e404-453c-a92b-d8b4eb6caa36 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 12:59:59.454909 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-efb62184-e404-453c-a92b-d8b4eb6caa36 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 12:59:59.620547 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-bbc3c432-08c5-42f6-8b5d-8adbcf71cd0c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 12:59:59.633980 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-bbc3c432-08c5-42f6-8b5d-8adbcf71cd0c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 12:59:59.638755 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-bbc3c432-08c5-42f6-8b5d-8adbcf71cd0c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 12:59:59.643671 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-bbc3c432-08c5-42f6-8b5d-8adbcf71cd0c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1406 microversion: 2.20 time: 0.287395 Nov 23 12:59:59.644533 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 66/105] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 12:59:59 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1406 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 12:59:59.781821 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-efb62184-e404-453c-a92b-d8b4eb6caa36 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 12:59:59.794387 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-efb62184-e404-453c-a92b-d8b4eb6caa36 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211" status: 200 len: 1321 microversion: 2.1 time: 0.365659 Nov 23 12:59:59.796084 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 40/106] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 12:59:59 2021] GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211 => generated 1321 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:00:00.015053 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-fa155f5d-d804-4daa-9b48-3cb73b420b3c tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:00.015774 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-fa155f5d-d804-4daa-9b48-3cb73b420b3c tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: a3b02d0f-db9d-4996-a245-7237e989670d] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:00.029190 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-fa155f5d-d804-4daa-9b48-3cb73b420b3c tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:00.033171 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-fa155f5d-d804-4daa-9b48-3cb73b420b3c tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:00.034247 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-fa155f5d-d804-4daa-9b48-3cb73b420b3c tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:00.034895 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-fa155f5d-d804-4daa-9b48-3cb73b420b3c tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:00.109158 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-d7c764b4-279c-402a-9078-48b47966447b tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:00.111278 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-d7c764b4-279c-402a-9078-48b47966447b tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] [instance: 851d1bac-67b3-4477-8109-c37791c90f1b] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:00.126140 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d7c764b4-279c-402a-9078-48b47966447b tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:00.126633 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d7c764b4-279c-402a-9078-48b47966447b tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:00.127870 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d7c764b4-279c-402a-9078-48b47966447b tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:00.131045 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d7c764b4-279c-402a-9078-48b47966447b tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:00.528615 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-d7c764b4-279c-402a-9078-48b47966447b tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7adc68cc5d47fea458da9232672087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d153c67e84449bb8eb36b752ec41896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:00.539015 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-d7c764b4-279c-402a-9078-48b47966447b tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] 10.222.0.60 "GET /compute/v2.1/servers/851d1bac-67b3-4477-8109-c37791c90f1b" status: 200 len: 1314 microversion: 2.1 time: 0.433813 Nov 23 13:00:00.549903 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 41/107] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:00:00 2021] GET /compute/v2.1/servers/851d1bac-67b3-4477-8109-c37791c90f1b => generated 1314 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:00:00.556197 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-fa155f5d-d804-4daa-9b48-3cb73b420b3c tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c023f89fd3da4bc8b38963bed4e5cc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a31364455dc442f8df299a8ad758a4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:00.565611 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-fa155f5d-d804-4daa-9b48-3cb73b420b3c tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/a3b02d0f-db9d-4996-a245-7237e989670d" status: 200 len: 1317 microversion: 2.1 time: 0.554330 Nov 23 13:00:00.566500 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 67/108] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:00:00 2021] GET /compute/v2.1/servers/a3b02d0f-db9d-4996-a245-7237e989670d => generated 1317 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:00:00.662372 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-ff522f40-92ab-405d-a4f7-364e562b0fbb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:00.662961 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-ff522f40-92ab-405d-a4f7-364e562b0fbb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:00.677719 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ff522f40-92ab-405d-a4f7-364e562b0fbb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:00.678527 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ff522f40-92ab-405d-a4f7-364e562b0fbb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:00.679354 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ff522f40-92ab-405d-a4f7-364e562b0fbb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:00.679785 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ff522f40-92ab-405d-a4f7-364e562b0fbb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:00.812427 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-a36dabc7-b3c8-4328-9598-4c390a8c16d9 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:00.813388 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-a36dabc7-b3c8-4328-9598-4c390a8c16d9 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: bc54276f-764d-49ee-b58e-552822acc211] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:00.822051 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a36dabc7-b3c8-4328-9598-4c390a8c16d9 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:00.823727 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a36dabc7-b3c8-4328-9598-4c390a8c16d9 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:00.826411 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a36dabc7-b3c8-4328-9598-4c390a8c16d9 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:00.827275 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a36dabc7-b3c8-4328-9598-4c390a8c16d9 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:01.016020 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-ff522f40-92ab-405d-a4f7-364e562b0fbb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:01.032343 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-ff522f40-92ab-405d-a4f7-364e562b0fbb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:01.039185 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-ff522f40-92ab-405d-a4f7-364e562b0fbb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:01.040553 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-ff522f40-92ab-405d-a4f7-364e562b0fbb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1406 microversion: 2.20 time: 0.381854 Nov 23 13:00:01.055279 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 42/109] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:00:00 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1406 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 13:00:01.125914 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-a36dabc7-b3c8-4328-9598-4c390a8c16d9 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:01.141092 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-a36dabc7-b3c8-4328-9598-4c390a8c16d9 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211" status: 200 len: 1321 microversion: 2.1 time: 0.332208 Nov 23 13:00:01.143364 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 68/110] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:00:00 2021] GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211 => generated 1321 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:00:01.556823 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-7c414f0e-2e48-4c3f-84a8-4b46b6c7de8d tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:01.560401 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-7c414f0e-2e48-4c3f-84a8-4b46b6c7de8d tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] [instance: 851d1bac-67b3-4477-8109-c37791c90f1b] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:01.583499 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7c414f0e-2e48-4c3f-84a8-4b46b6c7de8d tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:01.583986 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-3b0cdc76-7ff8-4961-9529-723189dc8f1b tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:01.584805 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-3b0cdc76-7ff8-4961-9529-723189dc8f1b tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: a3b02d0f-db9d-4996-a245-7237e989670d] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:01.585146 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7c414f0e-2e48-4c3f-84a8-4b46b6c7de8d tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:01.586399 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7c414f0e-2e48-4c3f-84a8-4b46b6c7de8d tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:01.587186 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7c414f0e-2e48-4c3f-84a8-4b46b6c7de8d tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:01.620838 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-3b0cdc76-7ff8-4961-9529-723189dc8f1b tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:01.621362 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-3b0cdc76-7ff8-4961-9529-723189dc8f1b tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:01.622204 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-3b0cdc76-7ff8-4961-9529-723189dc8f1b tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:01.625307 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-3b0cdc76-7ff8-4961-9529-723189dc8f1b tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:02.027928 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-7c414f0e-2e48-4c3f-84a8-4b46b6c7de8d tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7adc68cc5d47fea458da9232672087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d153c67e84449bb8eb36b752ec41896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:02.044367 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-7c414f0e-2e48-4c3f-84a8-4b46b6c7de8d tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] 10.222.0.60 "GET /compute/v2.1/servers/851d1bac-67b3-4477-8109-c37791c90f1b" status: 200 len: 1314 microversion: 2.1 time: 0.488797 Nov 23 13:00:02.045242 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 43/111] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:00:01 2021] GET /compute/v2.1/servers/851d1bac-67b3-4477-8109-c37791c90f1b => generated 1314 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:00:02.212117 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-3b0cdc76-7ff8-4961-9529-723189dc8f1b tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c023f89fd3da4bc8b38963bed4e5cc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a31364455dc442f8df299a8ad758a4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:02.225762 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-3b0cdc76-7ff8-4961-9529-723189dc8f1b tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/a3b02d0f-db9d-4996-a245-7237e989670d" status: 200 len: 1317 microversion: 2.1 time: 0.646336 Nov 23 13:00:02.238325 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 69/112] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:00:01 2021] GET /compute/v2.1/servers/a3b02d0f-db9d-4996-a245-7237e989670d => generated 1317 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 13:00:02.244850 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-20717970-98cd-4d8a-bee5-18d4b72d8d5e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:02.245816 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-20717970-98cd-4d8a-bee5-18d4b72d8d5e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:02.254153 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-20717970-98cd-4d8a-bee5-18d4b72d8d5e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:02.255210 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-20717970-98cd-4d8a-bee5-18d4b72d8d5e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:02.256332 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-20717970-98cd-4d8a-bee5-18d4b72d8d5e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:02.256908 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-20717970-98cd-4d8a-bee5-18d4b72d8d5e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:02.265575 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [req-c8395ec8-0e1d-4984-8552-ccb1cafc1c2f req-d211c31e-41e9-4019-9578-aa54d95ce7bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "851d1bac-67b3-4477-8109-c37791c90f1b", "name": "network-vif-plugged", "status": "completed", "tag": "e47ad125-0726-4518-a3bc-ae85b21ef184"}]} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:00:02.268919 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 13:00:02.268919 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: warnings.warn(msg) Nov 23 13:00:02.288082 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [req-c8395ec8-0e1d-4984-8552-ccb1cafc1c2f req-d211c31e-41e9-4019-9578-aa54d95ce7bd service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:02.296557 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [req-c8395ec8-0e1d-4984-8552-ccb1cafc1c2f req-d211c31e-41e9-4019-9578-aa54d95ce7bd service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:02.334560 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.compute.server_external_events [req-c8395ec8-0e1d-4984-8552-ccb1cafc1c2f req-d211c31e-41e9-4019-9578-aa54d95ce7bd service nova] Creating event network-vif-plugged:e47ad125-0726-4518-a3bc-ae85b21ef184 for instance 851d1bac-67b3-4477-8109-c37791c90f1b on hv-cinder-81888 Nov 23 13:00:02.346376 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [req-c8395ec8-0e1d-4984-8552-ccb1cafc1c2f req-d211c31e-41e9-4019-9578-aa54d95ce7bd service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.299702 Nov 23 13:00:02.348516 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 44/113] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Nov 23 13:00:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 13:00:02.361875 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-0e80ce38-01d0-4358-a7ed-51e1150fc694 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:02.365542 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-0e80ce38-01d0-4358-a7ed-51e1150fc694 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: bc54276f-764d-49ee-b58e-552822acc211] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:02.385793 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0e80ce38-01d0-4358-a7ed-51e1150fc694 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:02.387016 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0e80ce38-01d0-4358-a7ed-51e1150fc694 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:02.388988 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0e80ce38-01d0-4358-a7ed-51e1150fc694 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:02.390395 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0e80ce38-01d0-4358-a7ed-51e1150fc694 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:02.635170 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-20717970-98cd-4d8a-bee5-18d4b72d8d5e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:02.645254 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-20717970-98cd-4d8a-bee5-18d4b72d8d5e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:02.647008 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-20717970-98cd-4d8a-bee5-18d4b72d8d5e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:02.648148 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-20717970-98cd-4d8a-bee5-18d4b72d8d5e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1406 microversion: 2.20 time: 0.408431 Nov 23 13:00:02.649166 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 70/114] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:00:02 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1406 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:00:02.773158 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-0e80ce38-01d0-4358-a7ed-51e1150fc694 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:02.785964 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-0e80ce38-01d0-4358-a7ed-51e1150fc694 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211" status: 200 len: 1321 microversion: 2.1 time: 0.435292 Nov 23 13:00:02.786637 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 45/115] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:00:02 2021] GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211 => generated 1321 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:00:03.068565 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-8425c4b1-42fe-4c1c-ab1e-1715e24f8124 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:03.070368 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-8425c4b1-42fe-4c1c-ab1e-1715e24f8124 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] [instance: 851d1bac-67b3-4477-8109-c37791c90f1b] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:03.080023 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8425c4b1-42fe-4c1c-ab1e-1715e24f8124 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:03.080837 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8425c4b1-42fe-4c1c-ab1e-1715e24f8124 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:03.081619 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8425c4b1-42fe-4c1c-ab1e-1715e24f8124 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:03.082051 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8425c4b1-42fe-4c1c-ab1e-1715e24f8124 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:03.245088 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-be05fe8b-cbe7-4ee6-809f-ddf2998927b8 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:03.245699 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-be05fe8b-cbe7-4ee6-809f-ddf2998927b8 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: a3b02d0f-db9d-4996-a245-7237e989670d] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:03.253400 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-be05fe8b-cbe7-4ee6-809f-ddf2998927b8 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:03.254679 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-be05fe8b-cbe7-4ee6-809f-ddf2998927b8 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:03.255549 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-be05fe8b-cbe7-4ee6-809f-ddf2998927b8 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:03.255986 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-be05fe8b-cbe7-4ee6-809f-ddf2998927b8 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:03.297056 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-8425c4b1-42fe-4c1c-ab1e-1715e24f8124 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7adc68cc5d47fea458da9232672087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d153c67e84449bb8eb36b752ec41896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:03.306790 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-8425c4b1-42fe-4c1c-ab1e-1715e24f8124 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] 10.222.0.60 "GET /compute/v2.1/servers/851d1bac-67b3-4477-8109-c37791c90f1b" status: 200 len: 1314 microversion: 2.1 time: 0.248589 Nov 23 13:00:03.307700 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 71/116] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:00:03 2021] GET /compute/v2.1/servers/851d1bac-67b3-4477-8109-c37791c90f1b => generated 1314 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:00:03.465859 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-be05fe8b-cbe7-4ee6-809f-ddf2998927b8 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c023f89fd3da4bc8b38963bed4e5cc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a31364455dc442f8df299a8ad758a4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:03.474454 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-be05fe8b-cbe7-4ee6-809f-ddf2998927b8 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/a3b02d0f-db9d-4996-a245-7237e989670d" status: 200 len: 1317 microversion: 2.1 time: 0.233214 Nov 23 13:00:03.474969 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 46/117] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:00:03 2021] GET /compute/v2.1/servers/a3b02d0f-db9d-4996-a245-7237e989670d => generated 1317 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:00:03.667614 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-01678ef2-6db7-451b-9f21-c3a305bb1a87 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:03.668225 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-01678ef2-6db7-451b-9f21-c3a305bb1a87 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:03.676152 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-01678ef2-6db7-451b-9f21-c3a305bb1a87 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:03.677766 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-01678ef2-6db7-451b-9f21-c3a305bb1a87 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:03.679267 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-01678ef2-6db7-451b-9f21-c3a305bb1a87 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:03.679836 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-01678ef2-6db7-451b-9f21-c3a305bb1a87 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:03.807271 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-c74d264d-c680-461f-9c93-beaaa9ba872c tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:03.808660 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-c74d264d-c680-461f-9c93-beaaa9ba872c tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: bc54276f-764d-49ee-b58e-552822acc211] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:03.818321 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c74d264d-c680-461f-9c93-beaaa9ba872c tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:03.819512 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c74d264d-c680-461f-9c93-beaaa9ba872c tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:03.821294 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c74d264d-c680-461f-9c93-beaaa9ba872c tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:03.822368 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c74d264d-c680-461f-9c93-beaaa9ba872c tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:04.010021 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-01678ef2-6db7-451b-9f21-c3a305bb1a87 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:04.021881 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-01678ef2-6db7-451b-9f21-c3a305bb1a87 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:04.025246 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-01678ef2-6db7-451b-9f21-c3a305bb1a87 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:04.027422 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-01678ef2-6db7-451b-9f21-c3a305bb1a87 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1406 microversion: 2.20 time: 0.364057 Nov 23 13:00:04.028769 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 72/118] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:00:03 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1406 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:00:04.067753 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-c74d264d-c680-461f-9c93-beaaa9ba872c tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:04.076731 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-c74d264d-c680-461f-9c93-beaaa9ba872c tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211" status: 200 len: 1321 microversion: 2.1 time: 0.277883 Nov 23 13:00:04.077617 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 47/119] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:00:03 2021] GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211 => generated 1321 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 13:00:04.329260 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-533f81b4-5035-4e44-bb8b-b2bb57de6596 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:04.330491 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-533f81b4-5035-4e44-bb8b-b2bb57de6596 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] [instance: 851d1bac-67b3-4477-8109-c37791c90f1b] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:04.339271 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-533f81b4-5035-4e44-bb8b-b2bb57de6596 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:04.339809 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-533f81b4-5035-4e44-bb8b-b2bb57de6596 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:04.340957 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-533f81b4-5035-4e44-bb8b-b2bb57de6596 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:04.341573 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-533f81b4-5035-4e44-bb8b-b2bb57de6596 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:04.361795 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [req-749b3e4b-70b6-40cf-9a06-a00acced85b0 req-fc15a32e-9396-4cb1-8857-d353fa07f947 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3b02d0f-db9d-4996-a245-7237e989670d", "name": "network-vif-plugged", "status": "completed", "tag": "2c117b14-8ae9-4517-8547-e104cbcb9a21"}]} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:00:04.363425 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 13:00:04.363425 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: warnings.warn(msg) Nov 23 13:00:04.379792 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [req-749b3e4b-70b6-40cf-9a06-a00acced85b0 req-fc15a32e-9396-4cb1-8857-d353fa07f947 service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:04.380442 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [req-749b3e4b-70b6-40cf-9a06-a00acced85b0 req-fc15a32e-9396-4cb1-8857-d353fa07f947 service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:04.398930 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.compute.server_external_events [req-749b3e4b-70b6-40cf-9a06-a00acced85b0 req-fc15a32e-9396-4cb1-8857-d353fa07f947 service nova] Creating event network-vif-plugged:2c117b14-8ae9-4517-8547-e104cbcb9a21 for instance a3b02d0f-db9d-4996-a245-7237e989670d on hv-cinder-81888 Nov 23 13:00:04.404636 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [req-749b3e4b-70b6-40cf-9a06-a00acced85b0 req-fc15a32e-9396-4cb1-8857-d353fa07f947 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047179 Nov 23 13:00:04.405540 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 48/120] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Nov 23 13:00:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 13:00:04.495183 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-43efa38b-38fc-44f4-9959-34f84a91c28c tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:04.496260 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-43efa38b-38fc-44f4-9959-34f84a91c28c tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: a3b02d0f-db9d-4996-a245-7237e989670d] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:04.504993 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-43efa38b-38fc-44f4-9959-34f84a91c28c tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:04.505832 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-43efa38b-38fc-44f4-9959-34f84a91c28c tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:04.506878 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-43efa38b-38fc-44f4-9959-34f84a91c28c tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:04.507098 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-43efa38b-38fc-44f4-9959-34f84a91c28c tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:04.573363 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-533f81b4-5035-4e44-bb8b-b2bb57de6596 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7adc68cc5d47fea458da9232672087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d153c67e84449bb8eb36b752ec41896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:04.585030 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-533f81b4-5035-4e44-bb8b-b2bb57de6596 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] 10.222.0.60 "GET /compute/v2.1/servers/851d1bac-67b3-4477-8109-c37791c90f1b" status: 200 len: 1314 microversion: 2.1 time: 0.264737 Nov 23 13:00:04.585731 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 73/121] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:00:04 2021] GET /compute/v2.1/servers/851d1bac-67b3-4477-8109-c37791c90f1b => generated 1314 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:00:04.846073 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-43efa38b-38fc-44f4-9959-34f84a91c28c tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c023f89fd3da4bc8b38963bed4e5cc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a31364455dc442f8df299a8ad758a4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:04.860739 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-43efa38b-38fc-44f4-9959-34f84a91c28c tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/a3b02d0f-db9d-4996-a245-7237e989670d" status: 200 len: 1317 microversion: 2.1 time: 0.371641 Nov 23 13:00:04.861950 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 49/122] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:00:04 2021] GET /compute/v2.1/servers/a3b02d0f-db9d-4996-a245-7237e989670d => generated 1317 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 13:00:05.047823 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-0261e78c-155f-4046-a2cf-b0c5292bee51 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:05.048511 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-0261e78c-155f-4046-a2cf-b0c5292bee51 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:05.056156 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0261e78c-155f-4046-a2cf-b0c5292bee51 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:05.056862 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0261e78c-155f-4046-a2cf-b0c5292bee51 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:05.057785 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0261e78c-155f-4046-a2cf-b0c5292bee51 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:05.058359 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0261e78c-155f-4046-a2cf-b0c5292bee51 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:05.140115 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-78100efc-5b0e-489a-8b13-04d47397f8b6 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:05.140786 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-78100efc-5b0e-489a-8b13-04d47397f8b6 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: bc54276f-764d-49ee-b58e-552822acc211] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:05.158592 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-78100efc-5b0e-489a-8b13-04d47397f8b6 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:05.160426 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-78100efc-5b0e-489a-8b13-04d47397f8b6 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:05.161459 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-78100efc-5b0e-489a-8b13-04d47397f8b6 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:05.163442 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-78100efc-5b0e-489a-8b13-04d47397f8b6 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:05.419623 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-0261e78c-155f-4046-a2cf-b0c5292bee51 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:05.429424 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-0261e78c-155f-4046-a2cf-b0c5292bee51 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:05.432273 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-0261e78c-155f-4046-a2cf-b0c5292bee51 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:05.433651 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-0261e78c-155f-4046-a2cf-b0c5292bee51 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1406 microversion: 2.20 time: 0.391073 Nov 23 13:00:05.434397 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 74/123] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:00:05 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1406 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:00:05.602849 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-73ea46eb-bf98-44e9-af38-16411e0eb77f tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:05.603456 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-73ea46eb-bf98-44e9-af38-16411e0eb77f tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] [instance: 851d1bac-67b3-4477-8109-c37791c90f1b] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:05.619834 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-73ea46eb-bf98-44e9-af38-16411e0eb77f tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:05.620381 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-73ea46eb-bf98-44e9-af38-16411e0eb77f tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:05.622014 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-73ea46eb-bf98-44e9-af38-16411e0eb77f tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:05.622596 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-73ea46eb-bf98-44e9-af38-16411e0eb77f tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:05.686401 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-78100efc-5b0e-489a-8b13-04d47397f8b6 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:05.702238 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-78100efc-5b0e-489a-8b13-04d47397f8b6 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211" status: 200 len: 1321 microversion: 2.1 time: 0.566422 Nov 23 13:00:05.703355 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 50/124] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:00:05 2021] GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211 => generated 1321 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:00:05.878634 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-e913a1ba-438e-49bf-bafc-cc6c38add30a tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:05.879967 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-e913a1ba-438e-49bf-bafc-cc6c38add30a tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: a3b02d0f-db9d-4996-a245-7237e989670d] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:05.895015 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e913a1ba-438e-49bf-bafc-cc6c38add30a tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:05.895975 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e913a1ba-438e-49bf-bafc-cc6c38add30a tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:05.900441 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e913a1ba-438e-49bf-bafc-cc6c38add30a tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:05.901018 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e913a1ba-438e-49bf-bafc-cc6c38add30a tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:05.916266 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-73ea46eb-bf98-44e9-af38-16411e0eb77f tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7adc68cc5d47fea458da9232672087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d153c67e84449bb8eb36b752ec41896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:05.927910 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-73ea46eb-bf98-44e9-af38-16411e0eb77f tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] 10.222.0.60 "GET /compute/v2.1/servers/851d1bac-67b3-4477-8109-c37791c90f1b" status: 200 len: 1314 microversion: 2.1 time: 0.328858 Nov 23 13:00:05.939028 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 75/125] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:00:05 2021] GET /compute/v2.1/servers/851d1bac-67b3-4477-8109-c37791c90f1b => generated 1314 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:00:06.302263 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-e913a1ba-438e-49bf-bafc-cc6c38add30a tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c023f89fd3da4bc8b38963bed4e5cc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a31364455dc442f8df299a8ad758a4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:06.312197 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-e913a1ba-438e-49bf-bafc-cc6c38add30a tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/a3b02d0f-db9d-4996-a245-7237e989670d" status: 200 len: 1317 microversion: 2.1 time: 0.437293 Nov 23 13:00:06.313013 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 51/126] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:00:05 2021] GET /compute/v2.1/servers/a3b02d0f-db9d-4996-a245-7237e989670d => generated 1317 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 13:00:06.452389 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-56ca315d-7c52-400b-947b-90df50f54303 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:06.453001 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-56ca315d-7c52-400b-947b-90df50f54303 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:06.460725 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-56ca315d-7c52-400b-947b-90df50f54303 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:06.461339 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-56ca315d-7c52-400b-947b-90df50f54303 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:06.462346 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-56ca315d-7c52-400b-947b-90df50f54303 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:06.462883 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-56ca315d-7c52-400b-947b-90df50f54303 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:06.720155 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-bf1fa503-b6ea-4817-8d84-3fd9a31ae375 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:06.721375 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-bf1fa503-b6ea-4817-8d84-3fd9a31ae375 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: bc54276f-764d-49ee-b58e-552822acc211] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:06.729655 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-bf1fa503-b6ea-4817-8d84-3fd9a31ae375 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:06.730165 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-bf1fa503-b6ea-4817-8d84-3fd9a31ae375 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:06.731150 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-bf1fa503-b6ea-4817-8d84-3fd9a31ae375 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:06.731575 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-bf1fa503-b6ea-4817-8d84-3fd9a31ae375 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:06.803272 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-56ca315d-7c52-400b-947b-90df50f54303 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:06.815338 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-56ca315d-7c52-400b-947b-90df50f54303 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:06.817350 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-56ca315d-7c52-400b-947b-90df50f54303 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:06.818649 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-56ca315d-7c52-400b-947b-90df50f54303 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1406 microversion: 2.20 time: 0.370781 Nov 23 13:00:06.819297 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 76/127] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:00:06 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1406 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:00:06.944783 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-5804ffa8-f171-4e49-9b72-2a04ee591969 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:06.946003 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-5804ffa8-f171-4e49-9b72-2a04ee591969 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] [instance: 851d1bac-67b3-4477-8109-c37791c90f1b] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:06.953963 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5804ffa8-f171-4e49-9b72-2a04ee591969 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:06.954722 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5804ffa8-f171-4e49-9b72-2a04ee591969 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:06.955869 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5804ffa8-f171-4e49-9b72-2a04ee591969 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:06.956551 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5804ffa8-f171-4e49-9b72-2a04ee591969 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:06.967786 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-bf1fa503-b6ea-4817-8d84-3fd9a31ae375 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:06.977863 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-bf1fa503-b6ea-4817-8d84-3fd9a31ae375 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211" status: 200 len: 1321 microversion: 2.1 time: 0.262373 Nov 23 13:00:06.987920 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 52/128] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:00:06 2021] GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211 => generated 1321 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 13:00:07.176584 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-5804ffa8-f171-4e49-9b72-2a04ee591969 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7adc68cc5d47fea458da9232672087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d153c67e84449bb8eb36b752ec41896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:07.185638 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-5804ffa8-f171-4e49-9b72-2a04ee591969 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] 10.222.0.60 "GET /compute/v2.1/servers/851d1bac-67b3-4477-8109-c37791c90f1b" status: 200 len: 1314 microversion: 2.1 time: 0.244528 Nov 23 13:00:07.186210 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 77/129] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:00:06 2021] GET /compute/v2.1/servers/851d1bac-67b3-4477-8109-c37791c90f1b => generated 1314 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:00:07.329136 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-8f3856a4-ae1c-4c54-b434-dd38f216afe8 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:07.330105 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-8f3856a4-ae1c-4c54-b434-dd38f216afe8 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: a3b02d0f-db9d-4996-a245-7237e989670d] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:07.338438 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8f3856a4-ae1c-4c54-b434-dd38f216afe8 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:07.338995 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8f3856a4-ae1c-4c54-b434-dd38f216afe8 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:07.340398 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8f3856a4-ae1c-4c54-b434-dd38f216afe8 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:07.341075 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8f3856a4-ae1c-4c54-b434-dd38f216afe8 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:07.591435 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-8f3856a4-ae1c-4c54-b434-dd38f216afe8 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c023f89fd3da4bc8b38963bed4e5cc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a31364455dc442f8df299a8ad758a4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:07.600192 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-8f3856a4-ae1c-4c54-b434-dd38f216afe8 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/a3b02d0f-db9d-4996-a245-7237e989670d" status: 200 len: 1317 microversion: 2.1 time: 0.274930 Nov 23 13:00:07.604581 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 53/130] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:00:07 2021] GET /compute/v2.1/servers/a3b02d0f-db9d-4996-a245-7237e989670d => generated 1317 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:00:07.837263 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-c9ff70b8-5dec-43e6-8bff-a8674710b1eb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:07.837926 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-c9ff70b8-5dec-43e6-8bff-a8674710b1eb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:07.845253 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c9ff70b8-5dec-43e6-8bff-a8674710b1eb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:07.845687 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c9ff70b8-5dec-43e6-8bff-a8674710b1eb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:07.846468 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c9ff70b8-5dec-43e6-8bff-a8674710b1eb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:07.846870 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c9ff70b8-5dec-43e6-8bff-a8674710b1eb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:07.995598 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-e79715b3-1226-4f11-8964-d3475289180d tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:07.996191 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-e79715b3-1226-4f11-8964-d3475289180d tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: bc54276f-764d-49ee-b58e-552822acc211] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:08.005020 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e79715b3-1226-4f11-8964-d3475289180d tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:08.005380 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e79715b3-1226-4f11-8964-d3475289180d tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:08.006179 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e79715b3-1226-4f11-8964-d3475289180d tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:08.006632 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e79715b3-1226-4f11-8964-d3475289180d tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:08.119395 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-c9ff70b8-5dec-43e6-8bff-a8674710b1eb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:08.128912 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-c9ff70b8-5dec-43e6-8bff-a8674710b1eb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:08.130816 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-c9ff70b8-5dec-43e6-8bff-a8674710b1eb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:08.132349 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-c9ff70b8-5dec-43e6-8bff-a8674710b1eb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1406 microversion: 2.20 time: 0.299058 Nov 23 13:00:08.133106 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 78/131] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:00:07 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1406 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:00:08.202633 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-b68f30c6-e832-4786-9e91-b3bdabaeaa36 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:08.203280 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-b68f30c6-e832-4786-9e91-b3bdabaeaa36 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] [instance: 851d1bac-67b3-4477-8109-c37791c90f1b] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:08.209418 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-e79715b3-1226-4f11-8964-d3475289180d tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:08.211127 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b68f30c6-e832-4786-9e91-b3bdabaeaa36 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:08.211614 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b68f30c6-e832-4786-9e91-b3bdabaeaa36 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:08.212410 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b68f30c6-e832-4786-9e91-b3bdabaeaa36 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:08.212848 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b68f30c6-e832-4786-9e91-b3bdabaeaa36 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:08.217901 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-e79715b3-1226-4f11-8964-d3475289180d tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211" status: 200 len: 1321 microversion: 2.1 time: 0.226491 Nov 23 13:00:08.218483 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 54/132] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:00:07 2021] GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211 => generated 1321 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:00:08.417240 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-b68f30c6-e832-4786-9e91-b3bdabaeaa36 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7adc68cc5d47fea458da9232672087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d153c67e84449bb8eb36b752ec41896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:08.425662 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-b68f30c6-e832-4786-9e91-b3bdabaeaa36 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] 10.222.0.60 "GET /compute/v2.1/servers/851d1bac-67b3-4477-8109-c37791c90f1b" status: 200 len: 1314 microversion: 2.1 time: 0.226804 Nov 23 13:00:08.426230 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 79/133] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:00:08 2021] GET /compute/v2.1/servers/851d1bac-67b3-4477-8109-c37791c90f1b => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:00:08.618207 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-fb5982c9-c156-4828-8362-4bd3f623f2e2 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:08.618717 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-fb5982c9-c156-4828-8362-4bd3f623f2e2 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: a3b02d0f-db9d-4996-a245-7237e989670d] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:08.626689 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-fb5982c9-c156-4828-8362-4bd3f623f2e2 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:08.627114 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-fb5982c9-c156-4828-8362-4bd3f623f2e2 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:08.627919 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-fb5982c9-c156-4828-8362-4bd3f623f2e2 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:08.628419 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-fb5982c9-c156-4828-8362-4bd3f623f2e2 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:08.853352 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-fb5982c9-c156-4828-8362-4bd3f623f2e2 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c023f89fd3da4bc8b38963bed4e5cc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a31364455dc442f8df299a8ad758a4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:08.862370 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-fb5982c9-c156-4828-8362-4bd3f623f2e2 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/a3b02d0f-db9d-4996-a245-7237e989670d" status: 200 len: 1317 microversion: 2.1 time: 0.248209 Nov 23 13:00:08.872946 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 55/134] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:00:08 2021] GET /compute/v2.1/servers/a3b02d0f-db9d-4996-a245-7237e989670d => generated 1317 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:00:09.151480 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-217eee7a-eb89-4ddb-aed4-eb964e118044 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:09.152067 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-217eee7a-eb89-4ddb-aed4-eb964e118044 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:09.161664 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-217eee7a-eb89-4ddb-aed4-eb964e118044 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:09.162294 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-217eee7a-eb89-4ddb-aed4-eb964e118044 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:09.163415 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-217eee7a-eb89-4ddb-aed4-eb964e118044 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:09.163994 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-217eee7a-eb89-4ddb-aed4-eb964e118044 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:09.235213 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-91ab2b2a-f0b3-4fb9-85bf-28d9cfe244a9 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:09.235674 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-91ab2b2a-f0b3-4fb9-85bf-28d9cfe244a9 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: bc54276f-764d-49ee-b58e-552822acc211] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:09.243591 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-91ab2b2a-f0b3-4fb9-85bf-28d9cfe244a9 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:09.244091 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-91ab2b2a-f0b3-4fb9-85bf-28d9cfe244a9 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:09.244973 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-91ab2b2a-f0b3-4fb9-85bf-28d9cfe244a9 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:09.245492 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-91ab2b2a-f0b3-4fb9-85bf-28d9cfe244a9 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:09.368556 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-217eee7a-eb89-4ddb-aed4-eb964e118044 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:09.377582 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-217eee7a-eb89-4ddb-aed4-eb964e118044 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:09.379412 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-217eee7a-eb89-4ddb-aed4-eb964e118044 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:09.380559 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-217eee7a-eb89-4ddb-aed4-eb964e118044 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1406 microversion: 2.20 time: 0.233019 Nov 23 13:00:09.381168 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 80/135] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:00:09 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1406 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:00:09.442869 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-b017eaf4-4fc7-4f29-89f7-9176ba76e0e5 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:09.443359 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-b017eaf4-4fc7-4f29-89f7-9176ba76e0e5 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] [instance: 851d1bac-67b3-4477-8109-c37791c90f1b] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:09.450439 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-91ab2b2a-f0b3-4fb9-85bf-28d9cfe244a9 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:09.451489 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b017eaf4-4fc7-4f29-89f7-9176ba76e0e5 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:09.451957 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b017eaf4-4fc7-4f29-89f7-9176ba76e0e5 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:09.452716 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b017eaf4-4fc7-4f29-89f7-9176ba76e0e5 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:09.453151 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b017eaf4-4fc7-4f29-89f7-9176ba76e0e5 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:09.459170 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-91ab2b2a-f0b3-4fb9-85bf-28d9cfe244a9 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211" status: 200 len: 1321 microversion: 2.1 time: 0.227798 Nov 23 13:00:09.459718 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 56/136] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:00:09 2021] GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211 => generated 1321 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:00:09.655971 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-b017eaf4-4fc7-4f29-89f7-9176ba76e0e5 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7adc68cc5d47fea458da9232672087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d153c67e84449bb8eb36b752ec41896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:09.667231 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-b017eaf4-4fc7-4f29-89f7-9176ba76e0e5 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] 10.222.0.60 "GET /compute/v2.1/servers/851d1bac-67b3-4477-8109-c37791c90f1b" status: 200 len: 1314 microversion: 2.1 time: 0.228142 Nov 23 13:00:09.667817 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 81/137] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:00:09 2021] GET /compute/v2.1/servers/851d1bac-67b3-4477-8109-c37791c90f1b => generated 1314 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 13:00:09.879847 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-70d81348-5b39-4cf1-9052-849eb1c40e60 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:09.880498 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-70d81348-5b39-4cf1-9052-849eb1c40e60 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: a3b02d0f-db9d-4996-a245-7237e989670d] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:09.888290 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-70d81348-5b39-4cf1-9052-849eb1c40e60 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:09.888718 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-70d81348-5b39-4cf1-9052-849eb1c40e60 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:09.889497 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-70d81348-5b39-4cf1-9052-849eb1c40e60 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:09.889998 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-70d81348-5b39-4cf1-9052-849eb1c40e60 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:10.092159 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-70d81348-5b39-4cf1-9052-849eb1c40e60 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c023f89fd3da4bc8b38963bed4e5cc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a31364455dc442f8df299a8ad758a4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:10.101486 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-70d81348-5b39-4cf1-9052-849eb1c40e60 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/a3b02d0f-db9d-4996-a245-7237e989670d" status: 200 len: 1317 microversion: 2.1 time: 0.225705 Nov 23 13:00:10.102321 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 57/138] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:00:09 2021] GET /compute/v2.1/servers/a3b02d0f-db9d-4996-a245-7237e989670d => generated 1317 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:00:10.260894 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [req-dd4073e1-0629-442b-8471-2dd4b3a8b0d2 req-f2b88e3a-c8e9-4e1f-a838-1805c54b03ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9c21729-a176-4e26-9074-f5f0bfc0ce20", "name": "network-vif-plugged", "status": "completed", "tag": "acc6c8bf-82a2-4f88-b12e-f6a39d6ce970"}]} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:00:10.262927 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 13:00:10.262927 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: warnings.warn(msg) Nov 23 13:00:10.271935 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [req-dd4073e1-0629-442b-8471-2dd4b3a8b0d2 req-f2b88e3a-c8e9-4e1f-a838-1805c54b03ad service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:10.272402 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [req-dd4073e1-0629-442b-8471-2dd4b3a8b0d2 req-f2b88e3a-c8e9-4e1f-a838-1805c54b03ad service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:10.289019 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.compute.server_external_events [req-dd4073e1-0629-442b-8471-2dd4b3a8b0d2 req-f2b88e3a-c8e9-4e1f-a838-1805c54b03ad service nova] Creating event network-vif-plugged:acc6c8bf-82a2-4f88-b12e-f6a39d6ce970 for instance b9c21729-a176-4e26-9074-f5f0bfc0ce20 on hv-cinder-81888 Nov 23 13:00:10.294539 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [req-dd4073e1-0629-442b-8471-2dd4b3a8b0d2 req-f2b88e3a-c8e9-4e1f-a838-1805c54b03ad service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037774 Nov 23 13:00:10.295072 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 82/139] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Nov 23 13:00:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 13:00:10.398365 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-e299143c-0805-4122-8e7f-b4eaed24093c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:10.399063 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-e299143c-0805-4122-8e7f-b4eaed24093c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:10.407011 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e299143c-0805-4122-8e7f-b4eaed24093c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:10.407462 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e299143c-0805-4122-8e7f-b4eaed24093c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:10.408217 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e299143c-0805-4122-8e7f-b4eaed24093c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:10.408676 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e299143c-0805-4122-8e7f-b4eaed24093c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:10.476563 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-70f99fee-be47-43c5-9cc1-9cc32d12ba00 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:10.477542 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-70f99fee-be47-43c5-9cc1-9cc32d12ba00 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: bc54276f-764d-49ee-b58e-552822acc211] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:10.485926 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-70f99fee-be47-43c5-9cc1-9cc32d12ba00 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:10.486363 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-70f99fee-be47-43c5-9cc1-9cc32d12ba00 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:10.487131 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-70f99fee-be47-43c5-9cc1-9cc32d12ba00 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:10.487612 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-70f99fee-be47-43c5-9cc1-9cc32d12ba00 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:10.613248 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-e299143c-0805-4122-8e7f-b4eaed24093c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:10.622626 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-e299143c-0805-4122-8e7f-b4eaed24093c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:10.624120 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-e299143c-0805-4122-8e7f-b4eaed24093c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:10.625239 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-e299143c-0805-4122-8e7f-b4eaed24093c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1406 microversion: 2.20 time: 0.230734 Nov 23 13:00:10.625833 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 58/140] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:00:10 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1406 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:00:10.684381 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-757c711c-5502-4760-86fc-05fc9f75c5a4 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:10.685116 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-757c711c-5502-4760-86fc-05fc9f75c5a4 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] [instance: 851d1bac-67b3-4477-8109-c37791c90f1b] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:10.691360 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-70f99fee-be47-43c5-9cc1-9cc32d12ba00 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:10.692866 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-757c711c-5502-4760-86fc-05fc9f75c5a4 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:10.693319 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-757c711c-5502-4760-86fc-05fc9f75c5a4 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:10.694363 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-757c711c-5502-4760-86fc-05fc9f75c5a4 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:10.695104 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-757c711c-5502-4760-86fc-05fc9f75c5a4 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:10.700413 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-70f99fee-be47-43c5-9cc1-9cc32d12ba00 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211" status: 200 len: 1321 microversion: 2.1 time: 0.228086 Nov 23 13:00:10.700994 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 83/141] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:00:10 2021] GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211 => generated 1321 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:00:10.904318 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-757c711c-5502-4760-86fc-05fc9f75c5a4 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7adc68cc5d47fea458da9232672087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d153c67e84449bb8eb36b752ec41896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:10.912775 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-757c711c-5502-4760-86fc-05fc9f75c5a4 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] 10.222.0.60 "GET /compute/v2.1/servers/851d1bac-67b3-4477-8109-c37791c90f1b" status: 200 len: 1314 microversion: 2.1 time: 0.232243 Nov 23 13:00:10.913347 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 59/142] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:00:10 2021] GET /compute/v2.1/servers/851d1bac-67b3-4477-8109-c37791c90f1b => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:00:11.119213 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-5681f4e3-b9f0-49d4-9861-68ee1ac9fc5b tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:11.119914 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-5681f4e3-b9f0-49d4-9861-68ee1ac9fc5b tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: a3b02d0f-db9d-4996-a245-7237e989670d] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:11.131055 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5681f4e3-b9f0-49d4-9861-68ee1ac9fc5b tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:11.131801 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5681f4e3-b9f0-49d4-9861-68ee1ac9fc5b tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:11.133190 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5681f4e3-b9f0-49d4-9861-68ee1ac9fc5b tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:11.133622 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5681f4e3-b9f0-49d4-9861-68ee1ac9fc5b tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:11.398486 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-5681f4e3-b9f0-49d4-9861-68ee1ac9fc5b tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c023f89fd3da4bc8b38963bed4e5cc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a31364455dc442f8df299a8ad758a4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:11.408983 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-5681f4e3-b9f0-49d4-9861-68ee1ac9fc5b tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/a3b02d0f-db9d-4996-a245-7237e989670d" status: 200 len: 1317 microversion: 2.1 time: 0.293721 Nov 23 13:00:11.418713 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 84/143] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:00:11 2021] GET /compute/v2.1/servers/a3b02d0f-db9d-4996-a245-7237e989670d => generated 1317 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:00:11.645372 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-6d7c194d-0a22-4d37-a2e6-69e044aa15ae tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:11.646015 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-6d7c194d-0a22-4d37-a2e6-69e044aa15ae tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:11.655901 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-6d7c194d-0a22-4d37-a2e6-69e044aa15ae tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:11.656389 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-6d7c194d-0a22-4d37-a2e6-69e044aa15ae tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:11.657166 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-6d7c194d-0a22-4d37-a2e6-69e044aa15ae tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:11.657594 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-6d7c194d-0a22-4d37-a2e6-69e044aa15ae tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:11.718141 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-72ddfd50-1bb8-4d2d-abea-d27d8f92ed37 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:11.718764 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-72ddfd50-1bb8-4d2d-abea-d27d8f92ed37 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: bc54276f-764d-49ee-b58e-552822acc211] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:11.726646 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-72ddfd50-1bb8-4d2d-abea-d27d8f92ed37 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:11.727111 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-72ddfd50-1bb8-4d2d-abea-d27d8f92ed37 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:11.727982 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-72ddfd50-1bb8-4d2d-abea-d27d8f92ed37 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:11.728422 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-72ddfd50-1bb8-4d2d-abea-d27d8f92ed37 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:11.862945 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-6d7c194d-0a22-4d37-a2e6-69e044aa15ae tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:11.878824 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-6d7c194d-0a22-4d37-a2e6-69e044aa15ae tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:11.880696 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-6d7c194d-0a22-4d37-a2e6-69e044aa15ae tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:11.881771 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-6d7c194d-0a22-4d37-a2e6-69e044aa15ae tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1406 microversion: 2.20 time: 0.241491 Nov 23 13:00:11.882329 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 60/144] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:00:11 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1406 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:00:11.929969 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-4ed16a2f-3884-442f-a774-1d06047180f1 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:11.930138 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-72ddfd50-1bb8-4d2d-abea-d27d8f92ed37 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:11.930727 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-4ed16a2f-3884-442f-a774-1d06047180f1 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] [instance: 851d1bac-67b3-4477-8109-c37791c90f1b] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:11.938600 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-4ed16a2f-3884-442f-a774-1d06047180f1 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:11.939043 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-72ddfd50-1bb8-4d2d-abea-d27d8f92ed37 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211" status: 200 len: 1321 microversion: 2.1 time: 0.225027 Nov 23 13:00:11.939140 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-4ed16a2f-3884-442f-a774-1d06047180f1 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:11.939637 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 85/145] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:00:11 2021] GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211 => generated 1321 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:00:11.940424 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-4ed16a2f-3884-442f-a774-1d06047180f1 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:11.941115 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-4ed16a2f-3884-442f-a774-1d06047180f1 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:12.175941 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-4ed16a2f-3884-442f-a774-1d06047180f1 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7adc68cc5d47fea458da9232672087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d153c67e84449bb8eb36b752ec41896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:12.184758 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-4ed16a2f-3884-442f-a774-1d06047180f1 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] 10.222.0.60 "GET /compute/v2.1/servers/851d1bac-67b3-4477-8109-c37791c90f1b" status: 200 len: 1314 microversion: 2.1 time: 0.258467 Nov 23 13:00:12.185262 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 61/146] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:00:11 2021] GET /compute/v2.1/servers/851d1bac-67b3-4477-8109-c37791c90f1b => generated 1314 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:00:12.426574 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-595c52a3-02a4-4d2b-9eef-762ce30f49bb tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:12.427207 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-595c52a3-02a4-4d2b-9eef-762ce30f49bb tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: a3b02d0f-db9d-4996-a245-7237e989670d] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:12.435383 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-595c52a3-02a4-4d2b-9eef-762ce30f49bb tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:12.435754 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-595c52a3-02a4-4d2b-9eef-762ce30f49bb tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:12.436557 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-595c52a3-02a4-4d2b-9eef-762ce30f49bb tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:12.436979 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-595c52a3-02a4-4d2b-9eef-762ce30f49bb tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:12.658467 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-595c52a3-02a4-4d2b-9eef-762ce30f49bb tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c023f89fd3da4bc8b38963bed4e5cc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a31364455dc442f8df299a8ad758a4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:12.667780 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-595c52a3-02a4-4d2b-9eef-762ce30f49bb tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/a3b02d0f-db9d-4996-a245-7237e989670d" status: 200 len: 1317 microversion: 2.1 time: 0.244938 Nov 23 13:00:12.670531 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 86/147] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:00:12 2021] GET /compute/v2.1/servers/a3b02d0f-db9d-4996-a245-7237e989670d => generated 1317 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:00:12.900642 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-64397324-a4a1-4dd1-8343-60fefd56dbd7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:12.901346 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-64397324-a4a1-4dd1-8343-60fefd56dbd7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:12.909016 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-64397324-a4a1-4dd1-8343-60fefd56dbd7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:12.909540 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-64397324-a4a1-4dd1-8343-60fefd56dbd7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:12.910382 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-64397324-a4a1-4dd1-8343-60fefd56dbd7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:12.910883 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-64397324-a4a1-4dd1-8343-60fefd56dbd7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:12.957122 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-63d003ff-2d43-4257-9404-62c9d01ac77e tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:12.965095 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-63d003ff-2d43-4257-9404-62c9d01ac77e tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: bc54276f-764d-49ee-b58e-552822acc211] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:12.980641 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-63d003ff-2d43-4257-9404-62c9d01ac77e tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:12.981084 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-63d003ff-2d43-4257-9404-62c9d01ac77e tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:12.983665 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-63d003ff-2d43-4257-9404-62c9d01ac77e tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:12.984112 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-63d003ff-2d43-4257-9404-62c9d01ac77e tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:13.163838 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-64397324-a4a1-4dd1-8343-60fefd56dbd7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:13.177512 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-64397324-a4a1-4dd1-8343-60fefd56dbd7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:13.182666 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-64397324-a4a1-4dd1-8343-60fefd56dbd7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:13.185549 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-64397324-a4a1-4dd1-8343-60fefd56dbd7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1406 microversion: 2.20 time: 0.289362 Nov 23 13:00:13.187478 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 62/148] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:00:12 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1406 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:00:13.193761 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [req-49c68738-11cc-4d0f-a09e-6d0f22c56bea req-42e529ff-363a-4535-af80-369a2d1dbe10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc54276f-764d-49ee-b58e-552822acc211", "name": "network-vif-plugged", "status": "completed", "tag": "4f32dbce-9338-45e3-a6af-9412f33ad987"}]} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:00:13.195556 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 13:00:13.195556 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: warnings.warn(msg) Nov 23 13:00:13.222472 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [req-49c68738-11cc-4d0f-a09e-6d0f22c56bea req-42e529ff-363a-4535-af80-369a2d1dbe10 service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:13.223128 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [req-49c68738-11cc-4d0f-a09e-6d0f22c56bea req-42e529ff-363a-4535-af80-369a2d1dbe10 service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:13.265009 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.compute.server_external_events [req-49c68738-11cc-4d0f-a09e-6d0f22c56bea req-42e529ff-363a-4535-af80-369a2d1dbe10 service nova] Creating event network-vif-plugged:4f32dbce-9338-45e3-a6af-9412f33ad987 for instance bc54276f-764d-49ee-b58e-552822acc211 on hv-cinder-81888 Nov 23 13:00:13.275163 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [req-49c68738-11cc-4d0f-a09e-6d0f22c56bea req-42e529ff-363a-4535-af80-369a2d1dbe10 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084922 Nov 23 13:00:13.284179 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 63/149] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Nov 23 13:00:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 13:00:13.291897 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-20b5ad57-de4c-43bf-b9ac-dad46ceadf40 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:13.292668 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-20b5ad57-de4c-43bf-b9ac-dad46ceadf40 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] [instance: 851d1bac-67b3-4477-8109-c37791c90f1b] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:13.299204 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-63d003ff-2d43-4257-9404-62c9d01ac77e tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:13.309330 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-63d003ff-2d43-4257-9404-62c9d01ac77e tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211" status: 200 len: 1321 microversion: 2.1 time: 0.356045 Nov 23 13:00:13.310521 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 87/150] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:00:12 2021] GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211 => generated 1321 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:00:13.313452 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-20b5ad57-de4c-43bf-b9ac-dad46ceadf40 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:13.314051 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-20b5ad57-de4c-43bf-b9ac-dad46ceadf40 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:13.315184 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-20b5ad57-de4c-43bf-b9ac-dad46ceadf40 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:13.315747 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-20b5ad57-de4c-43bf-b9ac-dad46ceadf40 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:13.628442 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-20b5ad57-de4c-43bf-b9ac-dad46ceadf40 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7adc68cc5d47fea458da9232672087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d153c67e84449bb8eb36b752ec41896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:13.638622 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-20b5ad57-de4c-43bf-b9ac-dad46ceadf40 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] 10.222.0.60 "GET /compute/v2.1/servers/851d1bac-67b3-4477-8109-c37791c90f1b" status: 200 len: 1314 microversion: 2.1 time: 0.352972 Nov 23 13:00:13.639208 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 64/151] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:00:13 2021] GET /compute/v2.1/servers/851d1bac-67b3-4477-8109-c37791c90f1b => generated 1314 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:00:13.686083 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-8046198a-d76d-4e06-9a9d-ad09427870f3 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:13.687969 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-8046198a-d76d-4e06-9a9d-ad09427870f3 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: a3b02d0f-db9d-4996-a245-7237e989670d] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:13.705404 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8046198a-d76d-4e06-9a9d-ad09427870f3 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:13.707462 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8046198a-d76d-4e06-9a9d-ad09427870f3 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:13.708900 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8046198a-d76d-4e06-9a9d-ad09427870f3 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:13.713012 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8046198a-d76d-4e06-9a9d-ad09427870f3 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:14.118759 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-8046198a-d76d-4e06-9a9d-ad09427870f3 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c023f89fd3da4bc8b38963bed4e5cc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a31364455dc442f8df299a8ad758a4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:14.128271 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-8046198a-d76d-4e06-9a9d-ad09427870f3 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/a3b02d0f-db9d-4996-a245-7237e989670d" status: 200 len: 1507 microversion: 2.1 time: 0.446578 Nov 23 13:00:14.129993 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 88/152] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:00:13 2021] GET /compute/v2.1/servers/a3b02d0f-db9d-4996-a245-7237e989670d => generated 1507 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:00:14.212446 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-0cf5cd35-0930-4b06-b62e-7bc1598f194f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:14.213849 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-0cf5cd35-0930-4b06-b62e-7bc1598f194f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:14.224337 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0cf5cd35-0930-4b06-b62e-7bc1598f194f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:14.225134 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0cf5cd35-0930-4b06-b62e-7bc1598f194f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:14.226270 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0cf5cd35-0930-4b06-b62e-7bc1598f194f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:14.228395 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0cf5cd35-0930-4b06-b62e-7bc1598f194f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:14.343890 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-4e0bb55a-2824-4396-83a5-b00d297ff79f tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:14.344928 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-4e0bb55a-2824-4396-83a5-b00d297ff79f tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: bc54276f-764d-49ee-b58e-552822acc211] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:14.369554 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4e0bb55a-2824-4396-83a5-b00d297ff79f tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:14.370309 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4e0bb55a-2824-4396-83a5-b00d297ff79f tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:14.371683 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4e0bb55a-2824-4396-83a5-b00d297ff79f tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:14.372465 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4e0bb55a-2824-4396-83a5-b00d297ff79f tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:14.684159 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-0cf5cd35-0930-4b06-b62e-7bc1598f194f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:14.697752 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-0cf5cd35-0930-4b06-b62e-7bc1598f194f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:14.699349 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-0cf5cd35-0930-4b06-b62e-7bc1598f194f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:14.700540 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-0cf5cd35-0930-4b06-b62e-7bc1598f194f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1598 microversion: 2.20 time: 0.493132 Nov 23 13:00:14.701122 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 65/153] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:00:14 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1598 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:00:14.717638 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-eb1ae274-d062-494b-8d1a-a13e4f2cccfd tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:14.718322 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-eb1ae274-d062-494b-8d1a-a13e4f2cccfd tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] [instance: 851d1bac-67b3-4477-8109-c37791c90f1b] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:14.732863 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-eb1ae274-d062-494b-8d1a-a13e4f2cccfd tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:14.733373 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-eb1ae274-d062-494b-8d1a-a13e4f2cccfd tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:14.734350 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-eb1ae274-d062-494b-8d1a-a13e4f2cccfd tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:14.734892 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-eb1ae274-d062-494b-8d1a-a13e4f2cccfd tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:15.053010 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-eb1ae274-d062-494b-8d1a-a13e4f2cccfd tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7adc68cc5d47fea458da9232672087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d153c67e84449bb8eb36b752ec41896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:15.065461 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-4e0bb55a-2824-4396-83a5-b00d297ff79f tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:15.067073 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-eb1ae274-d062-494b-8d1a-a13e4f2cccfd tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] 10.222.0.60 "GET /compute/v2.1/servers/851d1bac-67b3-4477-8109-c37791c90f1b" status: 200 len: 1501 microversion: 2.1 time: 0.353470 Nov 23 13:00:15.068121 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 66/154] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:00:14 2021] GET /compute/v2.1/servers/851d1bac-67b3-4477-8109-c37791c90f1b => generated 1501 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:00:15.088028 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-4e0bb55a-2824-4396-83a5-b00d297ff79f tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211" status: 200 len: 1321 microversion: 2.1 time: 0.762574 Nov 23 13:00:15.088934 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 89/155] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:00:14 2021] GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211 => generated 1321 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:00:15.095132 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-092991af-352a-4f0f-af48-4c66f67308d5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:15.095638 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-092991af-352a-4f0f-af48-4c66f67308d5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:15.106746 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-092991af-352a-4f0f-af48-4c66f67308d5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:15.107281 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-092991af-352a-4f0f-af48-4c66f67308d5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:15.108144 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-092991af-352a-4f0f-af48-4c66f67308d5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:15.108683 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-092991af-352a-4f0f-af48-4c66f67308d5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:15.325764 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [req-1ab730b7-e8e1-4437-8fa4-5276072dc532 req-ebaa82a8-37be-47a2-a75d-244c6c95d12e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53633a05-ad06-454a-b540-5fc01821ae45", "name": "network-vif-plugged", "status": "completed", "tag": "12c0e1a4-3a5f-40d2-8b38-ebcd979a194c"}]} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:00:15.327810 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 13:00:15.327810 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: warnings.warn(msg) Nov 23 13:00:15.333271 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-092991af-352a-4f0f-af48-4c66f67308d5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.263621 Nov 23 13:00:15.335225 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 67/156] 10.222.0.60 () {60 vars in 1315 bytes} [Tue Nov 23 13:00:15 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-interface => generated 284 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:00:15.342024 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [req-1ab730b7-e8e1-4437-8fa4-5276072dc532 req-ebaa82a8-37be-47a2-a75d-244c6c95d12e service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:15.343389 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [req-1ab730b7-e8e1-4437-8fa4-5276072dc532 req-ebaa82a8-37be-47a2-a75d-244c6c95d12e service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:15.365178 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.compute.server_external_events [req-1ab730b7-e8e1-4437-8fa4-5276072dc532 req-ebaa82a8-37be-47a2-a75d-244c6c95d12e service nova] Creating event network-vif-plugged:12c0e1a4-3a5f-40d2-8b38-ebcd979a194c for instance 53633a05-ad06-454a-b540-5fc01821ae45 on hv-cinder-81888 Nov 23 13:00:15.372397 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [req-1ab730b7-e8e1-4437-8fa4-5276072dc532 req-ebaa82a8-37be-47a2-a75d-244c6c95d12e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050386 Nov 23 13:00:15.373579 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 90/157] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Nov 23 13:00:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 13:00:16.105677 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-09750b5c-e697-432e-a01a-b443f93cf57d tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:16.106483 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-09750b5c-e697-432e-a01a-b443f93cf57d tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: bc54276f-764d-49ee-b58e-552822acc211] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:16.122301 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-09750b5c-e697-432e-a01a-b443f93cf57d tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:16.123148 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-09750b5c-e697-432e-a01a-b443f93cf57d tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:16.124160 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-09750b5c-e697-432e-a01a-b443f93cf57d tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:16.124716 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-09750b5c-e697-432e-a01a-b443f93cf57d tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:16.352859 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-780ba8c3-9637-4e3d-8bf5-0189943fa12a tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cc2dcb04-a6ef-434d-b801-0000f81e8f29"}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:00:16.354741 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-780ba8c3-9637-4e3d-8bf5-0189943fa12a tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: a3b02d0f-db9d-4996-a245-7237e989670d] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:16.375949 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-780ba8c3-9637-4e3d-8bf5-0189943fa12a tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:16.376438 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-780ba8c3-9637-4e3d-8bf5-0189943fa12a tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:16.377209 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-780ba8c3-9637-4e3d-8bf5-0189943fa12a tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:16.377631 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-780ba8c3-9637-4e3d-8bf5-0189943fa12a tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:16.454705 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-09750b5c-e697-432e-a01a-b443f93cf57d tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:16.466027 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-09750b5c-e697-432e-a01a-b443f93cf57d tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211" status: 200 len: 1513 microversion: 2.1 time: 0.364353 Nov 23 13:00:16.467306 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 68/158] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:00:16 2021] GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211 => generated 1513 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:00:16.488988 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-8221f2bb-d524-4e5a-a259-198563e22725 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:00:16.490037 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-8221f2bb-d524-4e5a-a259-198563e22725 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: bc54276f-764d-49ee-b58e-552822acc211] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:16.506785 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8221f2bb-d524-4e5a-a259-198563e22725 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:16.507241 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8221f2bb-d524-4e5a-a259-198563e22725 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:16.508002 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8221f2bb-d524-4e5a-a259-198563e22725 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:16.508728 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8221f2bb-d524-4e5a-a259-198563e22725 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:16.603351 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.objects.instance [None req-8221f2bb-d524-4e5a-a259-198563e22725 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lazy-loading 'flavor' on Instance uuid bc54276f-764d-49ee-b58e-552822acc211 {{(pid=100974) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 23 13:00:16.810187 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-8221f2bb-d524-4e5a-a259-198563e22725 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "POST /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211/action" status: 200 len: 32 microversion: 2.1 time: 0.325987 Nov 23 13:00:16.810840 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 69/159] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:00:16 2021] POST /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211/action => generated 32 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 13:00:16.822272 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-770d6f4a-7346-44d3-9e2e-19f81d93191e tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:16.824111 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-770d6f4a-7346-44d3-9e2e-19f81d93191e tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: bc54276f-764d-49ee-b58e-552822acc211] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:16.834217 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-770d6f4a-7346-44d3-9e2e-19f81d93191e tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:16.835025 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-770d6f4a-7346-44d3-9e2e-19f81d93191e tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:16.836335 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-770d6f4a-7346-44d3-9e2e-19f81d93191e tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:16.837521 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-770d6f4a-7346-44d3-9e2e-19f81d93191e tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:17.226345 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-770d6f4a-7346-44d3-9e2e-19f81d93191e tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:17.241966 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-770d6f4a-7346-44d3-9e2e-19f81d93191e tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211" status: 200 len: 1519 microversion: 2.1 time: 0.425521 Nov 23 13:00:17.244702 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 70/160] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:00:16 2021] GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211 => generated 1519 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:00:17.260910 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-299bfb77-c51b-4b91-904d-0eebec93c3ab tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d6d7f476-fae7-430d-861d-43590b45ea3a"}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:00:17.264506 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-299bfb77-c51b-4b91-904d-0eebec93c3ab tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] [instance: 851d1bac-67b3-4477-8109-c37791c90f1b] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:17.279419 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-299bfb77-c51b-4b91-904d-0eebec93c3ab tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:17.280660 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-299bfb77-c51b-4b91-904d-0eebec93c3ab tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:17.282120 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-299bfb77-c51b-4b91-904d-0eebec93c3ab tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:17.282711 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-299bfb77-c51b-4b91-904d-0eebec93c3ab tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:17.555596 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-780ba8c3-9637-4e3d-8bf5-0189943fa12a tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "POST /compute/v2.1/servers/a3b02d0f-db9d-4996-a245-7237e989670d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.207274 Nov 23 13:00:17.556197 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 91/161] 10.222.0.60 () {60 vars in 1322 bytes} [Tue Nov 23 13:00:16 2021] POST /compute/v2.1/servers/a3b02d0f-db9d-4996-a245-7237e989670d/os-volume_attachments => generated 194 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 13:00:18.145451 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-299bfb77-c51b-4b91-904d-0eebec93c3ab tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] 10.222.0.60 "POST /compute/v2.1/servers/851d1bac-67b3-4477-8109-c37791c90f1b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.899264 Nov 23 13:00:18.146478 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 71/162] 10.222.0.60 () {60 vars in 1322 bytes} [Tue Nov 23 13:00:17 2021] POST /compute/v2.1/servers/851d1bac-67b3-4477-8109-c37791c90f1b/os-volume_attachments => generated 194 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 13:00:18.260521 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-1f50c2cb-1b3d-43e5-91b9-986bf1a704c7 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:18.261212 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-1f50c2cb-1b3d-43e5-91b9-986bf1a704c7 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: bc54276f-764d-49ee-b58e-552822acc211] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:18.272144 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-1f50c2cb-1b3d-43e5-91b9-986bf1a704c7 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:18.272623 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-1f50c2cb-1b3d-43e5-91b9-986bf1a704c7 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:18.273410 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-1f50c2cb-1b3d-43e5-91b9-986bf1a704c7 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:18.273843 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-1f50c2cb-1b3d-43e5-91b9-986bf1a704c7 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:18.646071 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-25503847-7773-4e1e-a0e8-d2436d361126 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:00:18.647997 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-25503847-7773-4e1e-a0e8-d2436d361126 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:18.663753 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-25503847-7773-4e1e-a0e8-d2436d361126 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:18.665106 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-25503847-7773-4e1e-a0e8-d2436d361126 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:18.666716 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-25503847-7773-4e1e-a0e8-d2436d361126 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:18.674582 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-25503847-7773-4e1e-a0e8-d2436d361126 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:18.853435 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-25503847-7773-4e1e-a0e8-d2436d361126 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action" status: 200 len: 14 microversion: 2.20 time: 0.211799 Nov 23 13:00:18.854672 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 72/163] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:00:18 2021] POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action => generated 14 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:00:18.861569 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [req-72f9ad6d-b61e-410d-a893-a88601de1f71 req-563bf4cd-1f0e-426b-ac8b-a8983f8652c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9c21729-a176-4e26-9074-f5f0bfc0ce20", "tag": "acc6c8bf-82a2-4f88-b12e-f6a39d6ce970"}]} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:00:18.863053 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 13:00:18.863053 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: warnings.warn(msg) Nov 23 13:00:18.870410 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-1f50c2cb-1b3d-43e5-91b9-986bf1a704c7 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:18.895741 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-1f50c2cb-1b3d-43e5-91b9-986bf1a704c7 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211" status: 200 len: 1519 microversion: 2.1 time: 0.637837 Nov 23 13:00:18.897436 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 92/164] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:00:18 2021] GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211 => generated 1519 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:00:18.910371 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [req-72f9ad6d-b61e-410d-a893-a88601de1f71 req-563bf4cd-1f0e-426b-ac8b-a8983f8652c0 service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:18.915199 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [req-72f9ad6d-b61e-410d-a893-a88601de1f71 req-563bf4cd-1f0e-426b-ac8b-a8983f8652c0 service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:18.964153 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.compute.server_external_events [req-72f9ad6d-b61e-410d-a893-a88601de1f71 req-563bf4cd-1f0e-426b-ac8b-a8983f8652c0 service nova] Creating event network-changed:acc6c8bf-82a2-4f88-b12e-f6a39d6ce970 for instance b9c21729-a176-4e26-9074-f5f0bfc0ce20 on hv-cinder-81888 Nov 23 13:00:18.973809 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [req-72f9ad6d-b61e-410d-a893-a88601de1f71 req-563bf4cd-1f0e-426b-ac8b-a8983f8652c0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117407 Nov 23 13:00:18.974486 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 73/165] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Nov 23 13:00:18 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 13:00:19.872079 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-98e34ffa-180e-472e-b49f-ecb4fefa82b7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:00:19.873390 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-98e34ffa-180e-472e-b49f-ecb4fefa82b7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:19.890242 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-98e34ffa-180e-472e-b49f-ecb4fefa82b7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:19.890692 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-98e34ffa-180e-472e-b49f-ecb4fefa82b7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:19.895617 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-98e34ffa-180e-472e-b49f-ecb4fefa82b7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:19.896059 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-98e34ffa-180e-472e-b49f-ecb4fefa82b7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:19.917294 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-f48000a8-1e9a-4be8-9613-880cd9ad368f tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:19.919184 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-f48000a8-1e9a-4be8-9613-880cd9ad368f tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: bc54276f-764d-49ee-b58e-552822acc211] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:19.941322 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f48000a8-1e9a-4be8-9613-880cd9ad368f tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:19.942542 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f48000a8-1e9a-4be8-9613-880cd9ad368f tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:19.945026 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f48000a8-1e9a-4be8-9613-880cd9ad368f tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:19.945724 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f48000a8-1e9a-4be8-9613-880cd9ad368f tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:20.125870 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-98e34ffa-180e-472e-b49f-ecb4fefa82b7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action" status: 200 len: 14 microversion: 2.20 time: 0.257965 Nov 23 13:00:20.126782 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 93/166] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:00:19 2021] POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action => generated 14 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:00:20.682053 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-f48000a8-1e9a-4be8-9613-880cd9ad368f tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:20.693283 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-f48000a8-1e9a-4be8-9613-880cd9ad368f tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211" status: 200 len: 1519 microversion: 2.1 time: 0.781496 Nov 23 13:00:20.693940 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 74/167] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:00:19 2021] GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211 => generated 1519 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:00:21.138672 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-dd488b19-bbe9-4104-a10e-1364a322c151 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:00:21.139718 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-dd488b19-bbe9-4104-a10e-1364a322c151 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:21.149431 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-dd488b19-bbe9-4104-a10e-1364a322c151 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:21.150731 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-dd488b19-bbe9-4104-a10e-1364a322c151 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:21.152165 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-dd488b19-bbe9-4104-a10e-1364a322c151 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:21.152939 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-dd488b19-bbe9-4104-a10e-1364a322c151 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:21.351565 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-dd488b19-bbe9-4104-a10e-1364a322c151 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action" status: 200 len: 14 microversion: 2.20 time: 0.216885 Nov 23 13:00:21.355191 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 94/168] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:00:21 2021] POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action => generated 14 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:00:21.710786 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-419afdec-27f0-4d81-b5b0-eba53eef1ef5 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:21.711431 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-419afdec-27f0-4d81-b5b0-eba53eef1ef5 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: bc54276f-764d-49ee-b58e-552822acc211] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:21.719812 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-419afdec-27f0-4d81-b5b0-eba53eef1ef5 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:21.720377 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-419afdec-27f0-4d81-b5b0-eba53eef1ef5 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:21.721224 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-419afdec-27f0-4d81-b5b0-eba53eef1ef5 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:21.721721 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-419afdec-27f0-4d81-b5b0-eba53eef1ef5 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:21.988436 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-419afdec-27f0-4d81-b5b0-eba53eef1ef5 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:21.997913 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-419afdec-27f0-4d81-b5b0-eba53eef1ef5 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211" status: 200 len: 1519 microversion: 2.1 time: 0.290911 Nov 23 13:00:21.998495 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 75/169] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:00:21 2021] GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211 => generated 1519 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:00:22.370865 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-d915f3af-87f4-49d6-a996-43182dc4b0b6 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:00:22.372288 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-d915f3af-87f4-49d6-a996-43182dc4b0b6 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:22.383985 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d915f3af-87f4-49d6-a996-43182dc4b0b6 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:22.384781 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d915f3af-87f4-49d6-a996-43182dc4b0b6 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:22.385615 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d915f3af-87f4-49d6-a996-43182dc4b0b6 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:22.386012 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d915f3af-87f4-49d6-a996-43182dc4b0b6 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:22.538296 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-d915f3af-87f4-49d6-a996-43182dc4b0b6 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action" status: 200 len: 14 microversion: 2.20 time: 0.176514 Nov 23 13:00:22.544338 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 95/170] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:00:22 2021] POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action => generated 14 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:00:23.015688 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-3124a494-54a2-47cb-bfc8-fc1fb88d47af tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:23.016324 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-3124a494-54a2-47cb-bfc8-fc1fb88d47af tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: bc54276f-764d-49ee-b58e-552822acc211] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:23.025511 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3124a494-54a2-47cb-bfc8-fc1fb88d47af tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:23.036963 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3124a494-54a2-47cb-bfc8-fc1fb88d47af tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:23.039083 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3124a494-54a2-47cb-bfc8-fc1fb88d47af tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:23.040322 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3124a494-54a2-47cb-bfc8-fc1fb88d47af tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:23.326095 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-3124a494-54a2-47cb-bfc8-fc1fb88d47af tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:23.335152 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-3124a494-54a2-47cb-bfc8-fc1fb88d47af tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211" status: 200 len: 1519 microversion: 2.1 time: 0.323303 Nov 23 13:00:23.335747 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 76/171] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:00:23 2021] GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211 => generated 1519 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:00:23.551882 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-e3e8bdbc-188e-476d-89c2-97b6d75cc68b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:00:23.552963 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-e3e8bdbc-188e-476d-89c2-97b6d75cc68b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:23.562763 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e3e8bdbc-188e-476d-89c2-97b6d75cc68b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:23.563206 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e3e8bdbc-188e-476d-89c2-97b6d75cc68b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:23.564148 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e3e8bdbc-188e-476d-89c2-97b6d75cc68b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:23.564607 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e3e8bdbc-188e-476d-89c2-97b6d75cc68b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:23.708852 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-e3e8bdbc-188e-476d-89c2-97b6d75cc68b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action" status: 200 len: 14 microversion: 2.20 time: 0.162319 Nov 23 13:00:23.713117 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 96/172] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:00:23 2021] POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action => generated 14 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:00:24.356419 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-4e0ba654-323c-4796-a7c0-5feb13587c7d tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:24.357271 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-4e0ba654-323c-4796-a7c0-5feb13587c7d tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: bc54276f-764d-49ee-b58e-552822acc211] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:24.365551 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-4e0ba654-323c-4796-a7c0-5feb13587c7d tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:24.365946 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-4e0ba654-323c-4796-a7c0-5feb13587c7d tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:24.366924 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-4e0ba654-323c-4796-a7c0-5feb13587c7d tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:24.367591 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-4e0ba654-323c-4796-a7c0-5feb13587c7d tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:24.622228 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-4e0ba654-323c-4796-a7c0-5feb13587c7d tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:24.630932 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-4e0ba654-323c-4796-a7c0-5feb13587c7d tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211" status: 200 len: 1519 microversion: 2.1 time: 0.281125 Nov 23 13:00:24.631520 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 77/173] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:00:24 2021] GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211 => generated 1519 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:00:24.720821 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-bb7ace7c-787e-4968-a702-b3839c13eea0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:00:24.722883 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-bb7ace7c-787e-4968-a702-b3839c13eea0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:24.731267 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-bb7ace7c-787e-4968-a702-b3839c13eea0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:24.732056 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-bb7ace7c-787e-4968-a702-b3839c13eea0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:24.732982 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-bb7ace7c-787e-4968-a702-b3839c13eea0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:24.733681 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-bb7ace7c-787e-4968-a702-b3839c13eea0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:24.939455 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-bb7ace7c-787e-4968-a702-b3839c13eea0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action" status: 200 len: 14 microversion: 2.20 time: 0.222669 Nov 23 13:00:24.940093 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 97/174] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:00:24 2021] POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action => generated 14 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:00:25.649275 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-4a1401de-3932-469d-8a2c-beb5ff43637f tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:25.649887 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-4a1401de-3932-469d-8a2c-beb5ff43637f tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: bc54276f-764d-49ee-b58e-552822acc211] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:25.657749 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-4a1401de-3932-469d-8a2c-beb5ff43637f tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:25.658164 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-4a1401de-3932-469d-8a2c-beb5ff43637f tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:25.658975 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-4a1401de-3932-469d-8a2c-beb5ff43637f tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:25.659385 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-4a1401de-3932-469d-8a2c-beb5ff43637f tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:25.931436 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-4a1401de-3932-469d-8a2c-beb5ff43637f tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:25.941440 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-4a1401de-3932-469d-8a2c-beb5ff43637f tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211" status: 200 len: 1519 microversion: 2.1 time: 0.296076 Nov 23 13:00:25.942629 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 78/175] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:00:25 2021] GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211 => generated 1519 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:00:25.951119 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-93e50185-f204-44ee-bf6f-a9ffbec9fe49 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:00:25.960458 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-93e50185-f204-44ee-bf6f-a9ffbec9fe49 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:25.970141 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-93e50185-f204-44ee-bf6f-a9ffbec9fe49 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:25.970814 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-93e50185-f204-44ee-bf6f-a9ffbec9fe49 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:25.971727 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-93e50185-f204-44ee-bf6f-a9ffbec9fe49 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:25.972308 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-93e50185-f204-44ee-bf6f-a9ffbec9fe49 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:26.960154 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-60045d30-3423-4861-bd72-c56c5b3eec20 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:26.960742 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-60045d30-3423-4861-bd72-c56c5b3eec20 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: bc54276f-764d-49ee-b58e-552822acc211] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:26.969245 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-60045d30-3423-4861-bd72-c56c5b3eec20 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:26.969690 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-60045d30-3423-4861-bd72-c56c5b3eec20 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:26.970469 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-60045d30-3423-4861-bd72-c56c5b3eec20 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:26.970954 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-60045d30-3423-4861-bd72-c56c5b3eec20 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:27.217469 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-60045d30-3423-4861-bd72-c56c5b3eec20 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:27.226223 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-60045d30-3423-4861-bd72-c56c5b3eec20 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211" status: 200 len: 1519 microversion: 2.1 time: 0.270053 Nov 23 13:00:27.227287 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 79/176] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:00:26 2021] GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211 => generated 1519 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:00:28.245788 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-e749647b-8698-43a8-aab0-ba6f4f05de84 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:28.245788 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-e749647b-8698-43a8-aab0-ba6f4f05de84 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: bc54276f-764d-49ee-b58e-552822acc211] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:28.253986 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e749647b-8698-43a8-aab0-ba6f4f05de84 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:28.254436 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e749647b-8698-43a8-aab0-ba6f4f05de84 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:28.255224 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e749647b-8698-43a8-aab0-ba6f4f05de84 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:28.255835 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e749647b-8698-43a8-aab0-ba6f4f05de84 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:28.517640 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-e749647b-8698-43a8-aab0-ba6f4f05de84 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:28.531638 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-e749647b-8698-43a8-aab0-ba6f4f05de84 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211" status: 200 len: 1519 microversion: 2.1 time: 0.291259 Nov 23 13:00:28.532770 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 80/177] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:00:28 2021] GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211 => generated 1519 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:00:29.154260 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-93e50185-f204-44ee-bf6f-a9ffbec9fe49 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action" status: 200 len: 14 microversion: 2.20 time: 3.206734 Nov 23 13:00:29.155131 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 98/178] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:00:25 2021] POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action => generated 14 bytes in 3209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:00:29.551964 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-77460414-d634-4833-b33f-b976bcb07b8e tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:29.552692 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-77460414-d634-4833-b33f-b976bcb07b8e tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: bc54276f-764d-49ee-b58e-552822acc211] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:29.560834 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-77460414-d634-4833-b33f-b976bcb07b8e tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:29.561284 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-77460414-d634-4833-b33f-b976bcb07b8e tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:29.562047 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-77460414-d634-4833-b33f-b976bcb07b8e tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:29.562488 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-77460414-d634-4833-b33f-b976bcb07b8e tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:29.769518 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-77460414-d634-4833-b33f-b976bcb07b8e tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:29.778196 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-77460414-d634-4833-b33f-b976bcb07b8e tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211" status: 200 len: 1519 microversion: 2.1 time: 0.232528 Nov 23 13:00:29.778767 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 81/179] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:00:29 2021] GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211 => generated 1519 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:00:30.167581 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-a2c7099a-683e-4a78-a6d1-683844c47f59 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:00:30.168617 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-a2c7099a-683e-4a78-a6d1-683844c47f59 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:30.176819 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a2c7099a-683e-4a78-a6d1-683844c47f59 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:30.177259 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a2c7099a-683e-4a78-a6d1-683844c47f59 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:30.178021 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a2c7099a-683e-4a78-a6d1-683844c47f59 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:30.178446 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a2c7099a-683e-4a78-a6d1-683844c47f59 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:30.317079 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-a2c7099a-683e-4a78-a6d1-683844c47f59 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action" status: 200 len: 14 microversion: 2.20 time: 0.153668 Nov 23 13:00:30.317708 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 99/180] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:00:30 2021] POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action => generated 14 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 13:00:30.795046 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-0e535c5a-053d-43ed-9bcd-46fd13a73f91 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:30.795614 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-0e535c5a-053d-43ed-9bcd-46fd13a73f91 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: bc54276f-764d-49ee-b58e-552822acc211] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:30.804274 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0e535c5a-053d-43ed-9bcd-46fd13a73f91 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:30.804788 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0e535c5a-053d-43ed-9bcd-46fd13a73f91 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:30.805571 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0e535c5a-053d-43ed-9bcd-46fd13a73f91 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:30.806008 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0e535c5a-053d-43ed-9bcd-46fd13a73f91 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:31.065760 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-0e535c5a-053d-43ed-9bcd-46fd13a73f91 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:31.075121 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-0e535c5a-053d-43ed-9bcd-46fd13a73f91 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211" status: 200 len: 1519 microversion: 2.1 time: 0.283888 Nov 23 13:00:31.075686 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 82/181] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:00:30 2021] GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211 => generated 1519 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:00:31.329231 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-d180b180-2c18-4ee0-89b7-9d74a58961f7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:00:31.330208 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-d180b180-2c18-4ee0-89b7-9d74a58961f7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:31.338436 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d180b180-2c18-4ee0-89b7-9d74a58961f7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:31.338902 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d180b180-2c18-4ee0-89b7-9d74a58961f7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:31.339687 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d180b180-2c18-4ee0-89b7-9d74a58961f7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:31.340118 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d180b180-2c18-4ee0-89b7-9d74a58961f7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:31.500957 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-d180b180-2c18-4ee0-89b7-9d74a58961f7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action" status: 200 len: 14 microversion: 2.20 time: 0.175395 Nov 23 13:00:31.504974 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 100/182] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:00:31 2021] POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action => generated 14 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:00:32.020577 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-c3e2c33e-8982-4966-824c-3c35849ea7d6 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2126132079", "imageRef": "d01e1b62-4f14-4f64-9d63-d155732e33e8", "flavorRef": "452", "networks": [{"uuid": "bf33958f-9165-410d-8036-71326a5124b6"}]}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:00:32.093787 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.network.neutron [None req-c3e2c33e-8982-4966-824c-3c35849ea7d6 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] validate_networks() for [('bf33958f-9165-410d-8036-71326a5124b6', None, None, None)] {{(pid=100974) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Nov 23 13:00:32.096520 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-a24a30ae-44c9-469c-887b-8fc2d3ec3f42 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:32.097452 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-a24a30ae-44c9-469c-887b-8fc2d3ec3f42 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: bc54276f-764d-49ee-b58e-552822acc211] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:32.106353 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a24a30ae-44c9-469c-887b-8fc2d3ec3f42 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:32.107120 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a24a30ae-44c9-469c-887b-8fc2d3ec3f42 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:32.107952 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a24a30ae-44c9-469c-887b-8fc2d3ec3f42 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:32.108487 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a24a30ae-44c9-469c-887b-8fc2d3ec3f42 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:32.356821 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-a24a30ae-44c9-469c-887b-8fc2d3ec3f42 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:32.367144 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-a24a30ae-44c9-469c-887b-8fc2d3ec3f42 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211" status: 200 len: 1519 microversion: 2.1 time: 0.276855 Nov 23 13:00:32.377771 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 101/183] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:00:32 2021] GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211 => generated 1519 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 13:00:32.425327 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-ff24b40b-c416-4618-88d2-bc99ab935efd tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-2072964635", "imageRef": "d01e1b62-4f14-4f64-9d63-d155732e33e8", "flavorRef": "452"}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:00:32.495965 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.network.neutron [None req-ff24b40b-c416-4618-88d2-bc99ab935efd tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] validate_networks() for None {{(pid=100973) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Nov 23 13:00:32.901550 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.virt.hardware [None req-ff24b40b-c416-4618-88d2-bc99ab935efd tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Flavor limits 0:0:0 {{(pid=100973) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 23 13:00:32.901923 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.virt.hardware [None req-ff24b40b-c416-4618-88d2-bc99ab935efd tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Image limits 0:0:0 {{(pid=100973) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 23 13:00:32.902426 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.virt.hardware [None req-ff24b40b-c416-4618-88d2-bc99ab935efd tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Flavor pref 0:0:0 {{(pid=100973) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 23 13:00:32.902855 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.virt.hardware [None req-ff24b40b-c416-4618-88d2-bc99ab935efd tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Image pref 0:0:0 {{(pid=100973) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 23 13:00:32.903431 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.virt.hardware [None req-ff24b40b-c416-4618-88d2-bc99ab935efd tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100973) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 23 13:00:32.911929 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.virt.hardware [None req-c3e2c33e-8982-4966-824c-3c35849ea7d6 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Flavor limits 0:0:0 {{(pid=100974) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 23 13:00:32.912649 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.virt.hardware [None req-c3e2c33e-8982-4966-824c-3c35849ea7d6 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Image limits 0:0:0 {{(pid=100974) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 23 13:00:32.913145 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.virt.hardware [None req-c3e2c33e-8982-4966-824c-3c35849ea7d6 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Flavor pref 0:0:0 {{(pid=100974) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 23 13:00:32.913663 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.virt.hardware [None req-c3e2c33e-8982-4966-824c-3c35849ea7d6 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Image pref 0:0:0 {{(pid=100974) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 23 13:00:32.914114 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.virt.hardware [None req-c3e2c33e-8982-4966-824c-3c35849ea7d6 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100974) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 23 13:00:32.914613 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ff24b40b-c416-4618-88d2-bc99ab935efd tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:32.915063 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ff24b40b-c416-4618-88d2-bc99ab935efd tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:32.916671 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ff24b40b-c416-4618-88d2-bc99ab935efd tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:32.917161 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ff24b40b-c416-4618-88d2-bc99ab935efd tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:32.924585 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c3e2c33e-8982-4966-824c-3c35849ea7d6 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:32.925029 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c3e2c33e-8982-4966-824c-3c35849ea7d6 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:32.926232 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c3e2c33e-8982-4966-824c-3c35849ea7d6 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:32.926928 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c3e2c33e-8982-4966-824c-3c35849ea7d6 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:32.942583 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.quota [None req-ff24b40b-c416-4618-88d2-bc99ab935efd tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Getting quotas for project 727d331da092466b8d717a7e039a5b7b. Resources: {'ram', 'cores', 'instances'} {{(pid=100973) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 13:00:32.946576 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.quota [None req-ff24b40b-c416-4618-88d2-bc99ab935efd tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Getting quotas for user 6bb98e201f2f41b18735465a450909ad and project 727d331da092466b8d717a7e039a5b7b. Resources: {'ram', 'cores', 'instances'} {{(pid=100973) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 13:00:32.949029 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.quota [None req-c3e2c33e-8982-4966-824c-3c35849ea7d6 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Getting quotas for project 9a31364455dc442f8df299a8ad758a4e. Resources: {'ram', 'cores', 'instances'} {{(pid=100974) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 13:00:32.953982 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.quota [None req-c3e2c33e-8982-4966-824c-3c35849ea7d6 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Getting quotas for user c023f89fd3da4bc8b38963bed4e5cc63 and project 9a31364455dc442f8df299a8ad758a4e. Resources: {'ram', 'cores', 'instances'} {{(pid=100974) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 13:00:32.960448 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-ff24b40b-c416-4618-88d2-bc99ab935efd tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Going to run 1 instances... {{(pid=100973) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Nov 23 13:00:32.962934 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-ff24b40b-c416-4618-88d2-bc99ab935efd tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] [instance: 979f72d5-fadc-4b59-ace6-6b8b350a63d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d01e1b62-4f14-4f64-9d63-d155732e33e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100973) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Nov 23 13:00:32.967252 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-c3e2c33e-8982-4966-824c-3c35849ea7d6 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Going to run 1 instances... {{(pid=100974) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Nov 23 13:00:32.971399 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-c3e2c33e-8982-4966-824c-3c35849ea7d6 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: da72692d-5ac7-4e8e-9b7d-11d421a1f071] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d01e1b62-4f14-4f64-9d63-d155732e33e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100974) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Nov 23 13:00:33.015169 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-ff24b40b-c416-4618-88d2-bc99ab935efd tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.594752 Nov 23 13:00:33.018549 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 102/184] 10.222.0.60 () {60 vars in 1146 bytes} [Tue Nov 23 13:00:32 2021] POST /compute/v2.1/servers => generated 380 bytes in 600 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 23 13:00:33.026351 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-439b06fb-9d82-4aae-90d7-1b4e1143e372 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:00:33.029403 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-439b06fb-9d82-4aae-90d7-1b4e1143e372 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:33.039563 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-c3e2c33e-8982-4966-824c-3c35849ea7d6 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.022578 Nov 23 13:00:33.046570 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 83/185] 10.222.0.60 () {60 vars in 1146 bytes} [Tue Nov 23 13:00:32 2021] POST /compute/v2.1/servers => generated 380 bytes in 1026 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 23 13:00:33.047499 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-b490bdd1-757a-437e-8bab-ad85d9891b8e tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:33.048205 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-b490bdd1-757a-437e-8bab-ad85d9891b8e tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] [instance: 979f72d5-fadc-4b59-ace6-6b8b350a63d9] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:33.059970 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-439b06fb-9d82-4aae-90d7-1b4e1143e372 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:33.060452 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-439b06fb-9d82-4aae-90d7-1b4e1143e372 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:33.061223 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-439b06fb-9d82-4aae-90d7-1b4e1143e372 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:33.062168 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-439b06fb-9d82-4aae-90d7-1b4e1143e372 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:33.153467 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-b490bdd1-757a-437e-8bab-ad85d9891b8e tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb98e201f2f41b18735465a450909ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d331da092466b8d717a7e039a5b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:33.166582 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-b490bdd1-757a-437e-8bab-ad85d9891b8e tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] 10.222.0.60 "GET /compute/v2.1/servers/979f72d5-fadc-4b59-ace6-6b8b350a63d9" status: 200 len: 1215 microversion: 2.1 time: 0.123027 Nov 23 13:00:33.167186 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 84/186] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:00:33 2021] GET /compute/v2.1/servers/979f72d5-fadc-4b59-ace6-6b8b350a63d9 => generated 1215 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:00:33.178036 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-92e14fd2-228a-4b2b-ae3f-ee557e5001c6 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:33.178970 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-92e14fd2-228a-4b2b-ae3f-ee557e5001c6 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: da72692d-5ac7-4e8e-9b7d-11d421a1f071] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:33.269660 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-92e14fd2-228a-4b2b-ae3f-ee557e5001c6 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c023f89fd3da4bc8b38963bed4e5cc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a31364455dc442f8df299a8ad758a4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:33.278355 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-92e14fd2-228a-4b2b-ae3f-ee557e5001c6 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/da72692d-5ac7-4e8e-9b7d-11d421a1f071" status: 200 len: 1218 microversion: 2.1 time: 0.110100 Nov 23 13:00:33.288667 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 85/187] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:00:33 2021] GET /compute/v2.1/servers/da72692d-5ac7-4e8e-9b7d-11d421a1f071 => generated 1218 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:00:33.294112 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-439b06fb-9d82-4aae-90d7-1b4e1143e372 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action" status: 200 len: 7270 microversion: 2.20 time: 0.272216 Nov 23 13:00:33.294923 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 103/188] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:00:33 2021] POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action => generated 7270 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:00:33.387109 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-55020290-27f6-4caa-8e1d-79abe8d5c342 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:33.388502 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-55020290-27f6-4caa-8e1d-79abe8d5c342 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: bc54276f-764d-49ee-b58e-552822acc211] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:33.411891 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-55020290-27f6-4caa-8e1d-79abe8d5c342 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:33.413119 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-55020290-27f6-4caa-8e1d-79abe8d5c342 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:33.414669 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-55020290-27f6-4caa-8e1d-79abe8d5c342 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:33.415991 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-55020290-27f6-4caa-8e1d-79abe8d5c342 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:33.714814 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-55020290-27f6-4caa-8e1d-79abe8d5c342 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:33.726745 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-55020290-27f6-4caa-8e1d-79abe8d5c342 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211" status: 200 len: 1519 microversion: 2.1 time: 0.344956 Nov 23 13:00:33.729643 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 86/189] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:00:33 2021] GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211 => generated 1519 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 13:00:34.183824 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-f66b1399-e9b7-4772-ba25-84a2a4b7208f tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:34.184633 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-f66b1399-e9b7-4772-ba25-84a2a4b7208f tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] [instance: 979f72d5-fadc-4b59-ace6-6b8b350a63d9] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:34.201820 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f66b1399-e9b7-4772-ba25-84a2a4b7208f tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:34.202382 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f66b1399-e9b7-4772-ba25-84a2a4b7208f tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:34.204300 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f66b1399-e9b7-4772-ba25-84a2a4b7208f tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:34.205332 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f66b1399-e9b7-4772-ba25-84a2a4b7208f tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:34.295063 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-13b4aa0d-408d-46c6-b02b-871e9dfc007b tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:34.295790 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-13b4aa0d-408d-46c6-b02b-871e9dfc007b tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: da72692d-5ac7-4e8e-9b7d-11d421a1f071] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:34.310069 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-13b4aa0d-408d-46c6-b02b-871e9dfc007b tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:34.310520 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-13b4aa0d-408d-46c6-b02b-871e9dfc007b tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:34.311297 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-13b4aa0d-408d-46c6-b02b-871e9dfc007b tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:34.315185 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-13b4aa0d-408d-46c6-b02b-871e9dfc007b tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:34.388762 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-f66b1399-e9b7-4772-ba25-84a2a4b7208f tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb98e201f2f41b18735465a450909ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d331da092466b8d717a7e039a5b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:34.399340 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-f66b1399-e9b7-4772-ba25-84a2a4b7208f tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] 10.222.0.60 "GET /compute/v2.1/servers/979f72d5-fadc-4b59-ace6-6b8b350a63d9" status: 200 len: 1267 microversion: 2.1 time: 0.219711 Nov 23 13:00:34.400324 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 104/190] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:00:34 2021] GET /compute/v2.1/servers/979f72d5-fadc-4b59-ace6-6b8b350a63d9 => generated 1267 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:00:34.430453 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-3c65efd1-e84e-47ac-872e-58f87d400802 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:00:34.431655 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-3c65efd1-e84e-47ac-872e-58f87d400802 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:34.443920 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-3c65efd1-e84e-47ac-872e-58f87d400802 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:34.444709 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-3c65efd1-e84e-47ac-872e-58f87d400802 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:34.445492 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-3c65efd1-e84e-47ac-872e-58f87d400802 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:34.446266 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-3c65efd1-e84e-47ac-872e-58f87d400802 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:34.466039 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-13b4aa0d-408d-46c6-b02b-871e9dfc007b tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c023f89fd3da4bc8b38963bed4e5cc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a31364455dc442f8df299a8ad758a4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:34.475392 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-13b4aa0d-408d-46c6-b02b-871e9dfc007b tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/da72692d-5ac7-4e8e-9b7d-11d421a1f071" status: 200 len: 1214 microversion: 2.1 time: 0.184133 Nov 23 13:00:34.485623 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 87/191] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:00:34 2021] GET /compute/v2.1/servers/da72692d-5ac7-4e8e-9b7d-11d421a1f071 => generated 1214 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:00:34.719940 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-3c65efd1-e84e-47ac-872e-58f87d400802 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action" status: 200 len: 12331 microversion: 2.20 time: 0.293138 Nov 23 13:00:34.720925 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 105/192] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:00:34 2021] POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action => generated 12331 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:00:34.746401 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-aa5a9477-0495-4eb7-b540-fe6429f10193 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:34.747141 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-aa5a9477-0495-4eb7-b540-fe6429f10193 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: bc54276f-764d-49ee-b58e-552822acc211] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:34.755145 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-aa5a9477-0495-4eb7-b540-fe6429f10193 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:34.755925 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-aa5a9477-0495-4eb7-b540-fe6429f10193 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:34.756954 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-aa5a9477-0495-4eb7-b540-fe6429f10193 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:34.757609 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-aa5a9477-0495-4eb7-b540-fe6429f10193 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:35.217952 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-aa5a9477-0495-4eb7-b540-fe6429f10193 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:35.226157 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-aa5a9477-0495-4eb7-b540-fe6429f10193 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211" status: 200 len: 1519 microversion: 2.1 time: 0.483652 Nov 23 13:00:35.227378 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 88/193] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:00:34 2021] GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211 => generated 1519 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:00:35.418963 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-f64366c8-7391-4791-b713-00c0f0837b25 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:35.419821 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-f64366c8-7391-4791-b713-00c0f0837b25 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] [instance: 979f72d5-fadc-4b59-ace6-6b8b350a63d9] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:35.436923 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f64366c8-7391-4791-b713-00c0f0837b25 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:35.437484 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f64366c8-7391-4791-b713-00c0f0837b25 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:35.445237 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f64366c8-7391-4791-b713-00c0f0837b25 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:35.446253 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f64366c8-7391-4791-b713-00c0f0837b25 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:35.495349 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-b166db71-6679-4827-9556-111c719be6b2 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:35.496094 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-b166db71-6679-4827-9556-111c719be6b2 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: da72692d-5ac7-4e8e-9b7d-11d421a1f071] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:35.512826 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b166db71-6679-4827-9556-111c719be6b2 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:35.515102 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b166db71-6679-4827-9556-111c719be6b2 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:35.516012 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b166db71-6679-4827-9556-111c719be6b2 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:35.519722 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b166db71-6679-4827-9556-111c719be6b2 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:35.666569 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-f64366c8-7391-4791-b713-00c0f0837b25 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb98e201f2f41b18735465a450909ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d331da092466b8d717a7e039a5b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:35.685356 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-f64366c8-7391-4791-b713-00c0f0837b25 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] 10.222.0.60 "GET /compute/v2.1/servers/979f72d5-fadc-4b59-ace6-6b8b350a63d9" status: 200 len: 1273 microversion: 2.1 time: 0.270684 Nov 23 13:00:35.690921 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 106/194] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:00:35 2021] GET /compute/v2.1/servers/979f72d5-fadc-4b59-ace6-6b8b350a63d9 => generated 1273 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:00:35.732830 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-f0d5dbfc-9aa0-44f5-8948-35cd241d1f0a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:00:35.734341 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-f0d5dbfc-9aa0-44f5-8948-35cd241d1f0a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:35.734872 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-b166db71-6679-4827-9556-111c719be6b2 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c023f89fd3da4bc8b38963bed4e5cc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a31364455dc442f8df299a8ad758a4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:35.747890 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-b166db71-6679-4827-9556-111c719be6b2 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/da72692d-5ac7-4e8e-9b7d-11d421a1f071" status: 200 len: 1270 microversion: 2.1 time: 0.259255 Nov 23 13:00:35.748949 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f0d5dbfc-9aa0-44f5-8948-35cd241d1f0a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:35.749962 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 89/195] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:00:35 2021] GET /compute/v2.1/servers/da72692d-5ac7-4e8e-9b7d-11d421a1f071 => generated 1270 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:00:35.750414 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f0d5dbfc-9aa0-44f5-8948-35cd241d1f0a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:35.752508 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f0d5dbfc-9aa0-44f5-8948-35cd241d1f0a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:35.752949 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f0d5dbfc-9aa0-44f5-8948-35cd241d1f0a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:36.063261 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-f0d5dbfc-9aa0-44f5-8948-35cd241d1f0a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action" status: 200 len: 16235 microversion: 2.20 time: 0.335219 Nov 23 13:00:36.064061 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 107/196] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:00:35 2021] POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action => generated 16235 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:00:36.245480 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-2804640c-b3f8-40c4-98c6-fb09fbf61038 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:36.246099 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-2804640c-b3f8-40c4-98c6-fb09fbf61038 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: bc54276f-764d-49ee-b58e-552822acc211] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:36.265113 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2804640c-b3f8-40c4-98c6-fb09fbf61038 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:36.265755 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2804640c-b3f8-40c4-98c6-fb09fbf61038 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:36.266709 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2804640c-b3f8-40c4-98c6-fb09fbf61038 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:36.267151 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2804640c-b3f8-40c4-98c6-fb09fbf61038 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:36.705451 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-32e2eb27-dc1a-4aa4-9a50-693636ade617 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:36.707415 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-32e2eb27-dc1a-4aa4-9a50-693636ade617 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] [instance: 979f72d5-fadc-4b59-ace6-6b8b350a63d9] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:36.721533 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-32e2eb27-dc1a-4aa4-9a50-693636ade617 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:36.722342 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-32e2eb27-dc1a-4aa4-9a50-693636ade617 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:36.723479 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-32e2eb27-dc1a-4aa4-9a50-693636ade617 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:36.724151 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-32e2eb27-dc1a-4aa4-9a50-693636ade617 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:36.950247 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-32e2eb27-dc1a-4aa4-9a50-693636ade617 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb98e201f2f41b18735465a450909ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d331da092466b8d717a7e039a5b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:36.964040 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-32e2eb27-dc1a-4aa4-9a50-693636ade617 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] 10.222.0.60 "GET /compute/v2.1/servers/979f72d5-fadc-4b59-ace6-6b8b350a63d9" status: 200 len: 1273 microversion: 2.1 time: 0.264473 Nov 23 13:00:36.965295 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 108/197] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:00:36 2021] GET /compute/v2.1/servers/979f72d5-fadc-4b59-ace6-6b8b350a63d9 => generated 1273 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:00:36.972124 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-ec150cb6-831a-42d0-84ef-1b5becf9c90b tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:36.973086 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-ec150cb6-831a-42d0-84ef-1b5becf9c90b tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: da72692d-5ac7-4e8e-9b7d-11d421a1f071] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:36.982119 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ec150cb6-831a-42d0-84ef-1b5becf9c90b tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:36.983602 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ec150cb6-831a-42d0-84ef-1b5becf9c90b tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:36.985073 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ec150cb6-831a-42d0-84ef-1b5becf9c90b tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:36.985795 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ec150cb6-831a-42d0-84ef-1b5becf9c90b tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:37.149311 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-ec150cb6-831a-42d0-84ef-1b5becf9c90b tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c023f89fd3da4bc8b38963bed4e5cc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a31364455dc442f8df299a8ad758a4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:37.164226 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-ec150cb6-831a-42d0-84ef-1b5becf9c90b tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/da72692d-5ac7-4e8e-9b7d-11d421a1f071" status: 200 len: 1276 microversion: 2.1 time: 0.196892 Nov 23 13:00:37.165687 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 109/198] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:00:36 2021] GET /compute/v2.1/servers/da72692d-5ac7-4e8e-9b7d-11d421a1f071 => generated 1276 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:00:37.174416 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-906ab917-46f2-41dd-94ec-48a7929541ce tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:00:37.175873 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-906ab917-46f2-41dd-94ec-48a7929541ce tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:37.184427 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-906ab917-46f2-41dd-94ec-48a7929541ce tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:37.185085 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-906ab917-46f2-41dd-94ec-48a7929541ce tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:37.186211 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-906ab917-46f2-41dd-94ec-48a7929541ce tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:37.186786 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-906ab917-46f2-41dd-94ec-48a7929541ce tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:37.342014 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-2804640c-b3f8-40c4-98c6-fb09fbf61038 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:37.352718 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-2804640c-b3f8-40c4-98c6-fb09fbf61038 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211" status: 200 len: 1519 microversion: 2.1 time: 1.112365 Nov 23 13:00:37.354727 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 90/199] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:00:36 2021] GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211 => generated 1519 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:00:37.367377 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-906ab917-46f2-41dd-94ec-48a7929541ce tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action" status: 200 len: 17861 microversion: 2.20 time: 0.200103 Nov 23 13:00:37.368028 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 110/200] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:00:37 2021] POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action => generated 17861 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:00:37.982017 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-2624e90a-57ab-4f4b-89ff-7a0681692d3d tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:37.982894 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-2624e90a-57ab-4f4b-89ff-7a0681692d3d tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] [instance: 979f72d5-fadc-4b59-ace6-6b8b350a63d9] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:37.993231 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2624e90a-57ab-4f4b-89ff-7a0681692d3d tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:37.993924 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2624e90a-57ab-4f4b-89ff-7a0681692d3d tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:37.995084 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2624e90a-57ab-4f4b-89ff-7a0681692d3d tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:37.996478 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2624e90a-57ab-4f4b-89ff-7a0681692d3d tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:38.183831 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-5039385c-813b-4398-ba42-6d5537bbe02b tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:38.184756 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-5039385c-813b-4398-ba42-6d5537bbe02b tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: da72692d-5ac7-4e8e-9b7d-11d421a1f071] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:38.195677 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5039385c-813b-4398-ba42-6d5537bbe02b tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:38.196190 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5039385c-813b-4398-ba42-6d5537bbe02b tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:38.196957 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5039385c-813b-4398-ba42-6d5537bbe02b tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:38.197550 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5039385c-813b-4398-ba42-6d5537bbe02b tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:38.428545 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-5039385c-813b-4398-ba42-6d5537bbe02b tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c023f89fd3da4bc8b38963bed4e5cc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a31364455dc442f8df299a8ad758a4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:38.440156 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-5039385c-813b-4398-ba42-6d5537bbe02b tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/da72692d-5ac7-4e8e-9b7d-11d421a1f071" status: 200 len: 1318 microversion: 2.1 time: 0.260961 Nov 23 13:00:38.451115 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 111/201] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:00:38 2021] GET /compute/v2.1/servers/da72692d-5ac7-4e8e-9b7d-11d421a1f071 => generated 1318 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 13:00:38.458636 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-7ab6fa61-51a4-41ff-bd59-ad95e0271db9 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:38.459546 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-7ab6fa61-51a4-41ff-bd59-ad95e0271db9 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: bc54276f-764d-49ee-b58e-552822acc211] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:38.470116 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-7ab6fa61-51a4-41ff-bd59-ad95e0271db9 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:38.470772 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-7ab6fa61-51a4-41ff-bd59-ad95e0271db9 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:38.471702 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-7ab6fa61-51a4-41ff-bd59-ad95e0271db9 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:38.472313 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-7ab6fa61-51a4-41ff-bd59-ad95e0271db9 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:39.016850 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-7ab6fa61-51a4-41ff-bd59-ad95e0271db9 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:39.038146 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-2624e90a-57ab-4f4b-89ff-7a0681692d3d tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb98e201f2f41b18735465a450909ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d331da092466b8d717a7e039a5b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:39.054069 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-2624e90a-57ab-4f4b-89ff-7a0681692d3d tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] 10.222.0.60 "GET /compute/v2.1/servers/979f72d5-fadc-4b59-ace6-6b8b350a63d9" status: 200 len: 1315 microversion: 2.1 time: 1.076173 Nov 23 13:00:39.063820 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-7ab6fa61-51a4-41ff-bd59-ad95e0271db9 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211" status: 200 len: 1519 microversion: 2.1 time: 0.609009 Nov 23 13:00:39.066878 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 112/202] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:00:38 2021] GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211 => generated 1519 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:00:39.068032 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 91/203] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:00:37 2021] GET /compute/v2.1/servers/979f72d5-fadc-4b59-ace6-6b8b350a63d9 => generated 1315 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:00:39.088871 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-3f1c99c7-852e-4c96-b8cf-a4c3338fb7dd tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:00:39.090104 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-3f1c99c7-852e-4c96-b8cf-a4c3338fb7dd tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:39.101077 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-3f1c99c7-852e-4c96-b8cf-a4c3338fb7dd tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:39.103940 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-3f1c99c7-852e-4c96-b8cf-a4c3338fb7dd tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:39.104802 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-3f1c99c7-852e-4c96-b8cf-a4c3338fb7dd tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:39.105313 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-3f1c99c7-852e-4c96-b8cf-a4c3338fb7dd tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:39.366798 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-3f1c99c7-852e-4c96-b8cf-a4c3338fb7dd tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action" status: 200 len: 20173 microversion: 2.20 time: 0.297068 Nov 23 13:00:39.367619 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 113/204] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:00:39 2021] POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action => generated 20173 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:00:39.458051 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-113d83d3-f4b1-4457-bcf1-78c5b118f332 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:39.458659 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-113d83d3-f4b1-4457-bcf1-78c5b118f332 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: da72692d-5ac7-4e8e-9b7d-11d421a1f071] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:39.470904 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-113d83d3-f4b1-4457-bcf1-78c5b118f332 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:39.471352 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-113d83d3-f4b1-4457-bcf1-78c5b118f332 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:39.473082 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-113d83d3-f4b1-4457-bcf1-78c5b118f332 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:39.473868 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-113d83d3-f4b1-4457-bcf1-78c5b118f332 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:40.075853 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-e32d6004-3362-4d01-b3f4-d45288e3ab08 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:40.076681 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-e32d6004-3362-4d01-b3f4-d45288e3ab08 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] [instance: 979f72d5-fadc-4b59-ace6-6b8b350a63d9] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:40.106091 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e32d6004-3362-4d01-b3f4-d45288e3ab08 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:40.110493 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e32d6004-3362-4d01-b3f4-d45288e3ab08 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:40.111579 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e32d6004-3362-4d01-b3f4-d45288e3ab08 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:40.115793 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e32d6004-3362-4d01-b3f4-d45288e3ab08 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:40.608064 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-e32d6004-3362-4d01-b3f4-d45288e3ab08 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb98e201f2f41b18735465a450909ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d331da092466b8d717a7e039a5b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:40.620003 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-e32d6004-3362-4d01-b3f4-d45288e3ab08 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] 10.222.0.60 "GET /compute/v2.1/servers/979f72d5-fadc-4b59-ace6-6b8b350a63d9" status: 200 len: 1315 microversion: 2.1 time: 0.549974 Nov 23 13:00:40.620620 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 114/205] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:00:40 2021] GET /compute/v2.1/servers/979f72d5-fadc-4b59-ace6-6b8b350a63d9 => generated 1315 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 13:00:40.629447 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-3e5be018-0c07-41f2-9fb6-13ed813d4981 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:40.631833 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-3e5be018-0c07-41f2-9fb6-13ed813d4981 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: bc54276f-764d-49ee-b58e-552822acc211] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:40.641760 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-113d83d3-f4b1-4457-bcf1-78c5b118f332 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c023f89fd3da4bc8b38963bed4e5cc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a31364455dc442f8df299a8ad758a4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:40.645029 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-3e5be018-0c07-41f2-9fb6-13ed813d4981 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:40.645631 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-3e5be018-0c07-41f2-9fb6-13ed813d4981 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:40.646545 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-3e5be018-0c07-41f2-9fb6-13ed813d4981 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:40.647110 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-3e5be018-0c07-41f2-9fb6-13ed813d4981 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:40.649419 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-113d83d3-f4b1-4457-bcf1-78c5b118f332 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/da72692d-5ac7-4e8e-9b7d-11d421a1f071" status: 200 len: 1318 microversion: 2.1 time: 1.194445 Nov 23 13:00:40.650360 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 92/206] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:00:39 2021] GET /compute/v2.1/servers/da72692d-5ac7-4e8e-9b7d-11d421a1f071 => generated 1318 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:00:40.655603 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [req-db6c7487-a386-48ae-a078-e45237c1cf83 req-bd4579f2-5e2e-4eb7-9557-e2e02afd1acf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da72692d-5ac7-4e8e-9b7d-11d421a1f071", "tag": "43d88996-bc75-42de-a03e-4caf7be9d7d1"}]} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:00:40.657482 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 13:00:40.657482 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: warnings.warn(msg) Nov 23 13:00:40.669425 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [req-db6c7487-a386-48ae-a078-e45237c1cf83 req-bd4579f2-5e2e-4eb7-9557-e2e02afd1acf service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:40.670216 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [req-db6c7487-a386-48ae-a078-e45237c1cf83 req-bd4579f2-5e2e-4eb7-9557-e2e02afd1acf service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:40.693224 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.compute.server_external_events [req-db6c7487-a386-48ae-a078-e45237c1cf83 req-bd4579f2-5e2e-4eb7-9557-e2e02afd1acf service nova] Creating event network-changed:43d88996-bc75-42de-a03e-4caf7be9d7d1 for instance da72692d-5ac7-4e8e-9b7d-11d421a1f071 on hv-cinder-81888 Nov 23 13:00:40.701524 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [req-db6c7487-a386-48ae-a078-e45237c1cf83 req-bd4579f2-5e2e-4eb7-9557-e2e02afd1acf service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049533 Nov 23 13:00:40.702996 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 93/207] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Nov 23 13:00:40 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 13:00:40.710141 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-d939d8e9-94e8-42e4-a864-966b9241cf7b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:00:40.711122 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-d939d8e9-94e8-42e4-a864-966b9241cf7b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:40.727513 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d939d8e9-94e8-42e4-a864-966b9241cf7b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:40.727996 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d939d8e9-94e8-42e4-a864-966b9241cf7b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:40.728964 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d939d8e9-94e8-42e4-a864-966b9241cf7b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:40.729404 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d939d8e9-94e8-42e4-a864-966b9241cf7b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:40.909655 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-d939d8e9-94e8-42e4-a864-966b9241cf7b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action" status: 200 len: 22711 microversion: 2.20 time: 0.205009 Nov 23 13:00:40.910295 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 94/208] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:00:40 2021] POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action => generated 22711 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:00:40.916034 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-696d836a-996b-47b2-b941-72fad762fc97 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:40.916575 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-696d836a-996b-47b2-b941-72fad762fc97 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] [instance: 851d1bac-67b3-4477-8109-c37791c90f1b] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:40.925109 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-696d836a-996b-47b2-b941-72fad762fc97 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:40.925636 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-696d836a-996b-47b2-b941-72fad762fc97 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:40.926413 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-696d836a-996b-47b2-b941-72fad762fc97 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:40.926837 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-696d836a-996b-47b2-b941-72fad762fc97 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:40.991797 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-696d836a-996b-47b2-b941-72fad762fc97 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] [instance: 851d1bac-67b3-4477-8109-c37791c90f1b] Going to try to terminate instance {{(pid=100974) delete /opt/stack/nova/nova/compute/api.py:2562}} Nov 23 13:00:41.088307 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-3e5be018-0c07-41f2-9fb6-13ed813d4981 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:41.097528 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-3e5be018-0c07-41f2-9fb6-13ed813d4981 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211" status: 200 len: 1519 microversion: 2.1 time: 0.473085 Nov 23 13:00:41.098234 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 115/209] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:00:40 2021] GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211 => generated 1519 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:00:41.170792 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-696d836a-996b-47b2-b941-72fad762fc97 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] 10.222.0.60 "DELETE /compute/v2.1/servers/851d1bac-67b3-4477-8109-c37791c90f1b" status: 204 len: 0 microversion: 2.1 time: 0.258871 Nov 23 13:00:41.171723 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 95/210] 10.222.0.60 () {58 vars in 1238 bytes} [Tue Nov 23 13:00:40 2021] DELETE /compute/v2.1/servers/851d1bac-67b3-4477-8109-c37791c90f1b => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 23 13:00:41.179297 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-cc387090-9c85-4f1e-8a66-16b7646e60fa tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:41.180421 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-cc387090-9c85-4f1e-8a66-16b7646e60fa tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] [instance: 851d1bac-67b3-4477-8109-c37791c90f1b] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:41.188751 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-cc387090-9c85-4f1e-8a66-16b7646e60fa tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:41.189156 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-cc387090-9c85-4f1e-8a66-16b7646e60fa tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:41.190584 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-cc387090-9c85-4f1e-8a66-16b7646e60fa tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:41.191312 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-cc387090-9c85-4f1e-8a66-16b7646e60fa tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:41.505417 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-cc387090-9c85-4f1e-8a66-16b7646e60fa tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7adc68cc5d47fea458da9232672087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d153c67e84449bb8eb36b752ec41896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:41.520619 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-cc387090-9c85-4f1e-8a66-16b7646e60fa tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] 10.222.0.60 "GET /compute/v2.1/servers/851d1bac-67b3-4477-8109-c37791c90f1b" status: 200 len: 1553 microversion: 2.1 time: 0.344901 Nov 23 13:00:41.521356 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 116/211] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:00:41 2021] GET /compute/v2.1/servers/851d1bac-67b3-4477-8109-c37791c90f1b => generated 1553 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:00:41.641878 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-b024341d-09a5-4ae5-bd88-79c52fc8351b tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:41.641878 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-b024341d-09a5-4ae5-bd88-79c52fc8351b tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] [instance: 979f72d5-fadc-4b59-ace6-6b8b350a63d9] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:41.650291 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b024341d-09a5-4ae5-bd88-79c52fc8351b tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:41.650939 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b024341d-09a5-4ae5-bd88-79c52fc8351b tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:41.651624 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b024341d-09a5-4ae5-bd88-79c52fc8351b tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:41.652045 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b024341d-09a5-4ae5-bd88-79c52fc8351b tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:41.682564 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-ff28e5dc-f758-4956-8898-9e69ff6fce0e tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:41.683303 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-ff28e5dc-f758-4956-8898-9e69ff6fce0e tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: da72692d-5ac7-4e8e-9b7d-11d421a1f071] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:41.697401 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ff28e5dc-f758-4956-8898-9e69ff6fce0e tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:41.698214 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ff28e5dc-f758-4956-8898-9e69ff6fce0e tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:41.699784 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ff28e5dc-f758-4956-8898-9e69ff6fce0e tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:41.700427 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ff28e5dc-f758-4956-8898-9e69ff6fce0e tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:41.975973 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-ff28e5dc-f758-4956-8898-9e69ff6fce0e tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c023f89fd3da4bc8b38963bed4e5cc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a31364455dc442f8df299a8ad758a4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:41.988479 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-ff28e5dc-f758-4956-8898-9e69ff6fce0e tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/da72692d-5ac7-4e8e-9b7d-11d421a1f071" status: 200 len: 1318 microversion: 2.1 time: 0.319350 Nov 23 13:00:41.995171 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 117/212] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:00:41 2021] GET /compute/v2.1/servers/da72692d-5ac7-4e8e-9b7d-11d421a1f071 => generated 1318 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:00:42.003711 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-24cd00b5-76ca-4100-b7ca-9d860b3e8c9e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:00:42.004904 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-24cd00b5-76ca-4100-b7ca-9d860b3e8c9e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:42.014021 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-24cd00b5-76ca-4100-b7ca-9d860b3e8c9e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:42.014574 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-24cd00b5-76ca-4100-b7ca-9d860b3e8c9e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:42.015453 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-24cd00b5-76ca-4100-b7ca-9d860b3e8c9e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:42.015886 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-24cd00b5-76ca-4100-b7ca-9d860b3e8c9e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:42.099118 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-b024341d-09a5-4ae5-bd88-79c52fc8351b tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb98e201f2f41b18735465a450909ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d331da092466b8d717a7e039a5b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:42.108067 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-b024341d-09a5-4ae5-bd88-79c52fc8351b tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] 10.222.0.60 "GET /compute/v2.1/servers/979f72d5-fadc-4b59-ace6-6b8b350a63d9" status: 200 len: 1315 microversion: 2.1 time: 0.470955 Nov 23 13:00:42.110476 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 96/213] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:00:41 2021] GET /compute/v2.1/servers/979f72d5-fadc-4b59-ace6-6b8b350a63d9 => generated 1315 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:00:42.115925 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-7990a96d-82a5-431d-b144-ae92ea1b6b02 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:42.116549 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-7990a96d-82a5-431d-b144-ae92ea1b6b02 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: bc54276f-764d-49ee-b58e-552822acc211] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:42.125017 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7990a96d-82a5-431d-b144-ae92ea1b6b02 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:42.125464 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7990a96d-82a5-431d-b144-ae92ea1b6b02 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:42.126241 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7990a96d-82a5-431d-b144-ae92ea1b6b02 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:42.126843 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7990a96d-82a5-431d-b144-ae92ea1b6b02 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:42.410605 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-7990a96d-82a5-431d-b144-ae92ea1b6b02 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:42.420862 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-7990a96d-82a5-431d-b144-ae92ea1b6b02 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211" status: 200 len: 1519 microversion: 2.1 time: 0.308911 Nov 23 13:00:42.421447 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 97/214] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:00:42 2021] GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211 => generated 1519 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:00:42.538331 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-27d58139-f137-4bec-8591-823740d7134d tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:42.539104 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-27d58139-f137-4bec-8591-823740d7134d tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] [instance: 851d1bac-67b3-4477-8109-c37791c90f1b] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:42.558720 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-27d58139-f137-4bec-8591-823740d7134d tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:42.560212 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-27d58139-f137-4bec-8591-823740d7134d tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:42.561742 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-27d58139-f137-4bec-8591-823740d7134d tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:42.562846 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-27d58139-f137-4bec-8591-823740d7134d tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:42.797144 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-27d58139-f137-4bec-8591-823740d7134d tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7adc68cc5d47fea458da9232672087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d153c67e84449bb8eb36b752ec41896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:42.807360 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-27d58139-f137-4bec-8591-823740d7134d tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] 10.222.0.60 "GET /compute/v2.1/servers/851d1bac-67b3-4477-8109-c37791c90f1b" status: 200 len: 1553 microversion: 2.1 time: 0.272407 Nov 23 13:00:42.818359 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 98/215] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:00:42 2021] GET /compute/v2.1/servers/851d1bac-67b3-4477-8109-c37791c90f1b => generated 1553 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 13:00:42.818359 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [req-767ad4e1-6f01-47cd-9ff6-4febed19eaa0 req-cef65daa-4b3f-4c5b-b795-d4d02420f263 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "979f72d5-fadc-4b59-ace6-6b8b350a63d9", "tag": "d1719e73-7614-4f8d-9a1c-396cfa30d9b3"}]} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:00:42.818359 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 13:00:42.818359 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: warnings.warn(msg) Nov 23 13:00:42.825701 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [req-767ad4e1-6f01-47cd-9ff6-4febed19eaa0 req-cef65daa-4b3f-4c5b-b795-d4d02420f263 service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:42.826137 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [req-767ad4e1-6f01-47cd-9ff6-4febed19eaa0 req-cef65daa-4b3f-4c5b-b795-d4d02420f263 service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:42.844746 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.compute.server_external_events [req-767ad4e1-6f01-47cd-9ff6-4febed19eaa0 req-cef65daa-4b3f-4c5b-b795-d4d02420f263 service nova] Creating event network-changed:d1719e73-7614-4f8d-9a1c-396cfa30d9b3 for instance 979f72d5-fadc-4b59-ace6-6b8b350a63d9 on hv-cinder-81888 Nov 23 13:00:42.849569 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [req-767ad4e1-6f01-47cd-9ff6-4febed19eaa0 req-cef65daa-4b3f-4c5b-b795-d4d02420f263 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039601 Nov 23 13:00:42.850179 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 99/216] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Nov 23 13:00:42 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 13:00:43.008275 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-174bf4d5-3ec2-49e5-b062-7cee1cd24760 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:43.008976 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-174bf4d5-3ec2-49e5-b062-7cee1cd24760 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: da72692d-5ac7-4e8e-9b7d-11d421a1f071] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:43.016974 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-174bf4d5-3ec2-49e5-b062-7cee1cd24760 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:43.017435 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-174bf4d5-3ec2-49e5-b062-7cee1cd24760 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:43.018252 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-174bf4d5-3ec2-49e5-b062-7cee1cd24760 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:43.018643 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-174bf4d5-3ec2-49e5-b062-7cee1cd24760 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:43.229083 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-174bf4d5-3ec2-49e5-b062-7cee1cd24760 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c023f89fd3da4bc8b38963bed4e5cc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a31364455dc442f8df299a8ad758a4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:43.238256 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-174bf4d5-3ec2-49e5-b062-7cee1cd24760 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/da72692d-5ac7-4e8e-9b7d-11d421a1f071" status: 200 len: 1318 microversion: 2.1 time: 0.234803 Nov 23 13:00:43.238809 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 100/217] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:00:43 2021] GET /compute/v2.1/servers/da72692d-5ac7-4e8e-9b7d-11d421a1f071 => generated 1318 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 13:00:43.243363 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-a1a6c43c-9a0d-468a-9ade-437b22169993 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:43.244390 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-a1a6c43c-9a0d-468a-9ade-437b22169993 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] [instance: 979f72d5-fadc-4b59-ace6-6b8b350a63d9] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:43.251648 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a1a6c43c-9a0d-468a-9ade-437b22169993 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:43.252086 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a1a6c43c-9a0d-468a-9ade-437b22169993 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:43.252898 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a1a6c43c-9a0d-468a-9ade-437b22169993 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:43.253680 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a1a6c43c-9a0d-468a-9ade-437b22169993 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:43.453838 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-a1a6c43c-9a0d-468a-9ade-437b22169993 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb98e201f2f41b18735465a450909ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d331da092466b8d717a7e039a5b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:43.462800 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-a1a6c43c-9a0d-468a-9ade-437b22169993 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] 10.222.0.60 "GET /compute/v2.1/servers/979f72d5-fadc-4b59-ace6-6b8b350a63d9" status: 200 len: 1315 microversion: 2.1 time: 0.222646 Nov 23 13:00:43.463580 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 101/218] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:00:43 2021] GET /compute/v2.1/servers/979f72d5-fadc-4b59-ace6-6b8b350a63d9 => generated 1315 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:00:43.467918 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-54d09420-677f-4905-96c9-da0e64cb54cd tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:43.468600 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-54d09420-677f-4905-96c9-da0e64cb54cd tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: bc54276f-764d-49ee-b58e-552822acc211] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:43.475825 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-54d09420-677f-4905-96c9-da0e64cb54cd tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:43.476333 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-54d09420-677f-4905-96c9-da0e64cb54cd tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:43.477109 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-54d09420-677f-4905-96c9-da0e64cb54cd tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:43.477581 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-54d09420-677f-4905-96c9-da0e64cb54cd tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:43.674423 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-54d09420-677f-4905-96c9-da0e64cb54cd tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:43.682991 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-54d09420-677f-4905-96c9-da0e64cb54cd tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211" status: 200 len: 1519 microversion: 2.1 time: 0.218474 Nov 23 13:00:43.683449 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 102/219] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:00:43 2021] GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211 => generated 1519 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:00:43.826585 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-d86d9fa8-8ca1-49b9-9ce0-82ed38dfbf9c tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:43.828362 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-d86d9fa8-8ca1-49b9-9ce0-82ed38dfbf9c tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] [instance: 851d1bac-67b3-4477-8109-c37791c90f1b] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:43.837835 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d86d9fa8-8ca1-49b9-9ce0-82ed38dfbf9c tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:43.838973 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d86d9fa8-8ca1-49b9-9ce0-82ed38dfbf9c tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:43.840032 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d86d9fa8-8ca1-49b9-9ce0-82ed38dfbf9c tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:43.840866 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d86d9fa8-8ca1-49b9-9ce0-82ed38dfbf9c tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:44.050726 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-d86d9fa8-8ca1-49b9-9ce0-82ed38dfbf9c tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7adc68cc5d47fea458da9232672087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d153c67e84449bb8eb36b752ec41896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:44.059784 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-d86d9fa8-8ca1-49b9-9ce0-82ed38dfbf9c tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] 10.222.0.60 "GET /compute/v2.1/servers/851d1bac-67b3-4477-8109-c37791c90f1b" status: 200 len: 1553 microversion: 2.1 time: 0.237807 Nov 23 13:00:44.060577 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 103/220] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:00:43 2021] GET /compute/v2.1/servers/851d1bac-67b3-4477-8109-c37791c90f1b => generated 1553 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:00:44.256410 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-e93b6279-25f3-4175-a037-cfc84b30fda2 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:44.257271 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-e93b6279-25f3-4175-a037-cfc84b30fda2 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: da72692d-5ac7-4e8e-9b7d-11d421a1f071] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:44.265389 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e93b6279-25f3-4175-a037-cfc84b30fda2 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:44.265842 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e93b6279-25f3-4175-a037-cfc84b30fda2 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:44.266612 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e93b6279-25f3-4175-a037-cfc84b30fda2 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:44.267037 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e93b6279-25f3-4175-a037-cfc84b30fda2 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:44.479385 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-e93b6279-25f3-4175-a037-cfc84b30fda2 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c023f89fd3da4bc8b38963bed4e5cc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a31364455dc442f8df299a8ad758a4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:44.487702 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-e93b6279-25f3-4175-a037-cfc84b30fda2 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/da72692d-5ac7-4e8e-9b7d-11d421a1f071" status: 200 len: 1318 microversion: 2.1 time: 0.236210 Nov 23 13:00:44.488280 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 104/221] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:00:44 2021] GET /compute/v2.1/servers/da72692d-5ac7-4e8e-9b7d-11d421a1f071 => generated 1318 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:00:44.492878 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-eb2dc356-7a17-4db4-834f-18dd3c3bfef8 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:44.493475 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-eb2dc356-7a17-4db4-834f-18dd3c3bfef8 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] [instance: 979f72d5-fadc-4b59-ace6-6b8b350a63d9] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:44.500973 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-eb2dc356-7a17-4db4-834f-18dd3c3bfef8 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:44.501424 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-eb2dc356-7a17-4db4-834f-18dd3c3bfef8 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:44.502199 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-eb2dc356-7a17-4db4-834f-18dd3c3bfef8 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:44.502631 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-eb2dc356-7a17-4db4-834f-18dd3c3bfef8 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:44.705697 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-eb2dc356-7a17-4db4-834f-18dd3c3bfef8 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb98e201f2f41b18735465a450909ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d331da092466b8d717a7e039a5b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:44.714175 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-eb2dc356-7a17-4db4-834f-18dd3c3bfef8 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] 10.222.0.60 "GET /compute/v2.1/servers/979f72d5-fadc-4b59-ace6-6b8b350a63d9" status: 200 len: 1315 microversion: 2.1 time: 0.224599 Nov 23 13:00:44.714724 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 105/222] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:00:44 2021] GET /compute/v2.1/servers/979f72d5-fadc-4b59-ace6-6b8b350a63d9 => generated 1315 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:00:44.719048 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-211e11ae-5418-4c20-8833-f06c84fe1c91 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:44.719630 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-211e11ae-5418-4c20-8833-f06c84fe1c91 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: bc54276f-764d-49ee-b58e-552822acc211] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:44.726929 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-211e11ae-5418-4c20-8833-f06c84fe1c91 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:44.727364 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-211e11ae-5418-4c20-8833-f06c84fe1c91 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:44.728360 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-211e11ae-5418-4c20-8833-f06c84fe1c91 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:44.728952 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-211e11ae-5418-4c20-8833-f06c84fe1c91 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:44.931399 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-211e11ae-5418-4c20-8833-f06c84fe1c91 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:44.940666 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-211e11ae-5418-4c20-8833-f06c84fe1c91 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211" status: 200 len: 1519 microversion: 2.1 time: 0.224928 Nov 23 13:00:44.941201 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 106/223] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:00:44 2021] GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211 => generated 1519 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:00:45.079341 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-366924f4-4d1a-410c-8f82-68c2e6d75ec6 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:45.079341 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-366924f4-4d1a-410c-8f82-68c2e6d75ec6 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] [instance: 851d1bac-67b3-4477-8109-c37791c90f1b] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:45.086353 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-366924f4-4d1a-410c-8f82-68c2e6d75ec6 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:45.086832 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-366924f4-4d1a-410c-8f82-68c2e6d75ec6 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:45.087618 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-366924f4-4d1a-410c-8f82-68c2e6d75ec6 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:45.088047 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-366924f4-4d1a-410c-8f82-68c2e6d75ec6 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:45.291074 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-366924f4-4d1a-410c-8f82-68c2e6d75ec6 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7adc68cc5d47fea458da9232672087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d153c67e84449bb8eb36b752ec41896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:45.300370 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-366924f4-4d1a-410c-8f82-68c2e6d75ec6 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] 10.222.0.60 "GET /compute/v2.1/servers/851d1bac-67b3-4477-8109-c37791c90f1b" status: 200 len: 1553 microversion: 2.1 time: 0.226744 Nov 23 13:00:45.300938 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 107/224] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:00:45 2021] GET /compute/v2.1/servers/851d1bac-67b3-4477-8109-c37791c90f1b => generated 1553 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:00:45.506505 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-02904d53-df8d-4f5b-b0f7-905e3d050d93 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:45.507114 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-02904d53-df8d-4f5b-b0f7-905e3d050d93 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: da72692d-5ac7-4e8e-9b7d-11d421a1f071] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:45.515502 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-02904d53-df8d-4f5b-b0f7-905e3d050d93 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:45.515948 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-02904d53-df8d-4f5b-b0f7-905e3d050d93 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:45.516756 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-02904d53-df8d-4f5b-b0f7-905e3d050d93 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:45.517189 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-02904d53-df8d-4f5b-b0f7-905e3d050d93 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:45.737030 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-02904d53-df8d-4f5b-b0f7-905e3d050d93 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c023f89fd3da4bc8b38963bed4e5cc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a31364455dc442f8df299a8ad758a4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:45.749580 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-02904d53-df8d-4f5b-b0f7-905e3d050d93 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/da72692d-5ac7-4e8e-9b7d-11d421a1f071" status: 200 len: 1318 microversion: 2.1 time: 0.246908 Nov 23 13:00:45.750352 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 108/225] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:00:45 2021] GET /compute/v2.1/servers/da72692d-5ac7-4e8e-9b7d-11d421a1f071 => generated 1318 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:00:45.754965 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-a59b482a-434a-4aa3-8b5e-0359ca134fd3 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:45.755560 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-a59b482a-434a-4aa3-8b5e-0359ca134fd3 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] [instance: 979f72d5-fadc-4b59-ace6-6b8b350a63d9] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:45.763505 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a59b482a-434a-4aa3-8b5e-0359ca134fd3 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:45.763940 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a59b482a-434a-4aa3-8b5e-0359ca134fd3 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:45.764738 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a59b482a-434a-4aa3-8b5e-0359ca134fd3 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:45.765171 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a59b482a-434a-4aa3-8b5e-0359ca134fd3 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:45.962028 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-a59b482a-434a-4aa3-8b5e-0359ca134fd3 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb98e201f2f41b18735465a450909ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d331da092466b8d717a7e039a5b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:45.970918 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-a59b482a-434a-4aa3-8b5e-0359ca134fd3 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] 10.222.0.60 "GET /compute/v2.1/servers/979f72d5-fadc-4b59-ace6-6b8b350a63d9" status: 200 len: 1315 microversion: 2.1 time: 0.219608 Nov 23 13:00:45.971533 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 109/226] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:00:45 2021] GET /compute/v2.1/servers/979f72d5-fadc-4b59-ace6-6b8b350a63d9 => generated 1315 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:00:45.975885 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-c985eb9c-1d12-422b-a276-5d26a74dd5d1 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:45.976527 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-c985eb9c-1d12-422b-a276-5d26a74dd5d1 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: bc54276f-764d-49ee-b58e-552822acc211] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:45.983978 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c985eb9c-1d12-422b-a276-5d26a74dd5d1 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:45.984467 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c985eb9c-1d12-422b-a276-5d26a74dd5d1 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:45.985242 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c985eb9c-1d12-422b-a276-5d26a74dd5d1 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:45.985670 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c985eb9c-1d12-422b-a276-5d26a74dd5d1 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:46.196206 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-c985eb9c-1d12-422b-a276-5d26a74dd5d1 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:46.205351 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-c985eb9c-1d12-422b-a276-5d26a74dd5d1 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211" status: 200 len: 1519 microversion: 2.1 time: 0.232857 Nov 23 13:00:46.205922 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 110/227] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:00:45 2021] GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211 => generated 1519 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:00:46.317583 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-c9cc05ee-5a10-4d92-a215-3698cd6cd24a tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:46.318185 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-c9cc05ee-5a10-4d92-a215-3698cd6cd24a tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] [instance: 851d1bac-67b3-4477-8109-c37791c90f1b] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:46.327108 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c9cc05ee-5a10-4d92-a215-3698cd6cd24a tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:46.327578 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c9cc05ee-5a10-4d92-a215-3698cd6cd24a tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:46.328381 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c9cc05ee-5a10-4d92-a215-3698cd6cd24a tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:46.328794 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c9cc05ee-5a10-4d92-a215-3698cd6cd24a tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:46.881329 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-c9cc05ee-5a10-4d92-a215-3698cd6cd24a tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7adc68cc5d47fea458da9232672087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d153c67e84449bb8eb36b752ec41896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:46.890569 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-c9cc05ee-5a10-4d92-a215-3698cd6cd24a tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] 10.222.0.60 "GET /compute/v2.1/servers/851d1bac-67b3-4477-8109-c37791c90f1b" status: 200 len: 1553 microversion: 2.1 time: 0.576812 Nov 23 13:00:46.891155 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 111/228] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:00:46 2021] GET /compute/v2.1/servers/851d1bac-67b3-4477-8109-c37791c90f1b => generated 1553 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:00:46.895553 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-f4a8c6a6-fd5f-4e1a-ae9e-b54cb92e23da tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:46.896145 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-f4a8c6a6-fd5f-4e1a-ae9e-b54cb92e23da tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: da72692d-5ac7-4e8e-9b7d-11d421a1f071] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:46.903614 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f4a8c6a6-fd5f-4e1a-ae9e-b54cb92e23da tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:46.904064 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f4a8c6a6-fd5f-4e1a-ae9e-b54cb92e23da tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:46.904868 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f4a8c6a6-fd5f-4e1a-ae9e-b54cb92e23da tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:46.905304 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f4a8c6a6-fd5f-4e1a-ae9e-b54cb92e23da tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:47.201173 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-24cd00b5-76ca-4100-b7ca-9d860b3e8c9e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action" status: 200 len: 26621 microversion: 2.20 time: 5.204269 Nov 23 13:00:47.201717 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 118/229] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:00:41 2021] POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action => generated 26621 bytes in 5206 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:00:47.210817 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-45be9b40-0a53-4066-9778-e392125c71e0 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:47.211860 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-45be9b40-0a53-4066-9778-e392125c71e0 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] [instance: 979f72d5-fadc-4b59-ace6-6b8b350a63d9] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:47.220463 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-45be9b40-0a53-4066-9778-e392125c71e0 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:47.220896 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-45be9b40-0a53-4066-9778-e392125c71e0 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:47.221657 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-45be9b40-0a53-4066-9778-e392125c71e0 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:47.222433 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-45be9b40-0a53-4066-9778-e392125c71e0 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:47.361725 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-f4a8c6a6-fd5f-4e1a-ae9e-b54cb92e23da tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c023f89fd3da4bc8b38963bed4e5cc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a31364455dc442f8df299a8ad758a4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:47.372717 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-f4a8c6a6-fd5f-4e1a-ae9e-b54cb92e23da tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/da72692d-5ac7-4e8e-9b7d-11d421a1f071" status: 200 len: 1318 microversion: 2.1 time: 0.480440 Nov 23 13:00:47.383357 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 112/230] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:00:46 2021] GET /compute/v2.1/servers/da72692d-5ac7-4e8e-9b7d-11d421a1f071 => generated 1318 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:00:47.390587 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-4321eeec-7483-4ad1-a6f2-502587a24d2e tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:47.391730 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-4321eeec-7483-4ad1-a6f2-502587a24d2e tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: bc54276f-764d-49ee-b58e-552822acc211] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:47.402637 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-4321eeec-7483-4ad1-a6f2-502587a24d2e tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:47.403090 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-4321eeec-7483-4ad1-a6f2-502587a24d2e tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:47.403880 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-4321eeec-7483-4ad1-a6f2-502587a24d2e tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:47.404496 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-4321eeec-7483-4ad1-a6f2-502587a24d2e tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:47.448355 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-45be9b40-0a53-4066-9778-e392125c71e0 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb98e201f2f41b18735465a450909ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d331da092466b8d717a7e039a5b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:47.456775 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-45be9b40-0a53-4066-9778-e392125c71e0 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] 10.222.0.60 "GET /compute/v2.1/servers/979f72d5-fadc-4b59-ace6-6b8b350a63d9" status: 200 len: 1315 microversion: 2.1 time: 0.253702 Nov 23 13:00:47.457364 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 119/231] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:00:47 2021] GET /compute/v2.1/servers/979f72d5-fadc-4b59-ace6-6b8b350a63d9 => generated 1315 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:00:47.639494 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-4321eeec-7483-4ad1-a6f2-502587a24d2e tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:47.648176 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-4321eeec-7483-4ad1-a6f2-502587a24d2e tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211" status: 200 len: 1519 microversion: 2.1 time: 0.263666 Nov 23 13:00:47.648806 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 113/232] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:00:47 2021] GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211 => generated 1519 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:00:47.906701 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-b70a9f44-00f9-4f41-8132-f663afafc25c tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:47.907385 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-b70a9f44-00f9-4f41-8132-f663afafc25c tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] [instance: 851d1bac-67b3-4477-8109-c37791c90f1b] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:47.914745 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b70a9f44-00f9-4f41-8132-f663afafc25c tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:47.915275 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b70a9f44-00f9-4f41-8132-f663afafc25c tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:47.916212 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b70a9f44-00f9-4f41-8132-f663afafc25c tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:47.916737 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b70a9f44-00f9-4f41-8132-f663afafc25c tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:48.208700 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-b70a9f44-00f9-4f41-8132-f663afafc25c tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7adc68cc5d47fea458da9232672087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d153c67e84449bb8eb36b752ec41896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:48.215213 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-70b55615-5655-4641-8618-17ec63243cb9 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:00:48.216471 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-70b55615-5655-4641-8618-17ec63243cb9 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:48.218817 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-b70a9f44-00f9-4f41-8132-f663afafc25c tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] 10.222.0.60 "GET /compute/v2.1/servers/851d1bac-67b3-4477-8109-c37791c90f1b" status: 200 len: 1553 microversion: 2.1 time: 0.315643 Nov 23 13:00:48.219571 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 120/233] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:00:47 2021] GET /compute/v2.1/servers/851d1bac-67b3-4477-8109-c37791c90f1b => generated 1553 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:00:48.224998 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-70b55615-5655-4641-8618-17ec63243cb9 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:48.225581 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-70b55615-5655-4641-8618-17ec63243cb9 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:48.226551 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-70b55615-5655-4641-8618-17ec63243cb9 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:48.227171 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-70b55615-5655-4641-8618-17ec63243cb9 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:48.391099 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-5dc61f15-c8db-49e4-af40-99adedc44698 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:48.392733 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-5dc61f15-c8db-49e4-af40-99adedc44698 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: da72692d-5ac7-4e8e-9b7d-11d421a1f071] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:48.402576 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5dc61f15-c8db-49e4-af40-99adedc44698 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:48.403090 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5dc61f15-c8db-49e4-af40-99adedc44698 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:48.403938 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5dc61f15-c8db-49e4-af40-99adedc44698 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:48.404438 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5dc61f15-c8db-49e4-af40-99adedc44698 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:48.455192 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-70b55615-5655-4641-8618-17ec63243cb9 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action" status: 200 len: 27263 microversion: 2.20 time: 0.243959 Nov 23 13:00:48.456275 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 114/234] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:00:48 2021] POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action => generated 27263 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:00:48.475034 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-2a7a6648-88fc-404f-b803-9ad5499e1cc7 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:48.475864 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-2a7a6648-88fc-404f-b803-9ad5499e1cc7 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] [instance: 979f72d5-fadc-4b59-ace6-6b8b350a63d9] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:48.484962 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2a7a6648-88fc-404f-b803-9ad5499e1cc7 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:48.485553 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2a7a6648-88fc-404f-b803-9ad5499e1cc7 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:48.486517 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2a7a6648-88fc-404f-b803-9ad5499e1cc7 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:48.487359 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2a7a6648-88fc-404f-b803-9ad5499e1cc7 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:48.629678 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-5dc61f15-c8db-49e4-af40-99adedc44698 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c023f89fd3da4bc8b38963bed4e5cc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a31364455dc442f8df299a8ad758a4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:48.638478 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-5dc61f15-c8db-49e4-af40-99adedc44698 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/da72692d-5ac7-4e8e-9b7d-11d421a1f071" status: 200 len: 1318 microversion: 2.1 time: 0.252579 Nov 23 13:00:48.639502 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 121/235] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:00:48 2021] GET /compute/v2.1/servers/da72692d-5ac7-4e8e-9b7d-11d421a1f071 => generated 1318 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:00:48.665725 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-d3f3aa10-daea-4d73-9622-2a371160baaf tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:48.666357 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-d3f3aa10-daea-4d73-9622-2a371160baaf tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: bc54276f-764d-49ee-b58e-552822acc211] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:48.673748 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d3f3aa10-daea-4d73-9622-2a371160baaf tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:48.674199 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d3f3aa10-daea-4d73-9622-2a371160baaf tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:48.675019 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d3f3aa10-daea-4d73-9622-2a371160baaf tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:48.675615 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d3f3aa10-daea-4d73-9622-2a371160baaf tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:48.706064 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-2a7a6648-88fc-404f-b803-9ad5499e1cc7 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb98e201f2f41b18735465a450909ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d331da092466b8d717a7e039a5b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:48.715194 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-2a7a6648-88fc-404f-b803-9ad5499e1cc7 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] 10.222.0.60 "GET /compute/v2.1/servers/979f72d5-fadc-4b59-ace6-6b8b350a63d9" status: 200 len: 1315 microversion: 2.1 time: 0.244390 Nov 23 13:00:48.715857 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 115/236] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:00:48 2021] GET /compute/v2.1/servers/979f72d5-fadc-4b59-ace6-6b8b350a63d9 => generated 1315 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 13:00:48.889006 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-d3f3aa10-daea-4d73-9622-2a371160baaf tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:48.897418 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-d3f3aa10-daea-4d73-9622-2a371160baaf tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211" status: 200 len: 1519 microversion: 2.1 time: 0.235627 Nov 23 13:00:48.898211 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 122/237] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:00:48 2021] GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211 => generated 1519 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 13:00:49.237128 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-fe2f41bd-ac6d-41a1-9d3f-61fa27d76cf1 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:49.237820 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-fe2f41bd-ac6d-41a1-9d3f-61fa27d76cf1 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] [instance: 851d1bac-67b3-4477-8109-c37791c90f1b] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:49.245372 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-fe2f41bd-ac6d-41a1-9d3f-61fa27d76cf1 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:49.245870 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-fe2f41bd-ac6d-41a1-9d3f-61fa27d76cf1 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:49.246631 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-fe2f41bd-ac6d-41a1-9d3f-61fa27d76cf1 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:49.247069 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-fe2f41bd-ac6d-41a1-9d3f-61fa27d76cf1 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:49.471873 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-fe2f41bd-ac6d-41a1-9d3f-61fa27d76cf1 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7adc68cc5d47fea458da9232672087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d153c67e84449bb8eb36b752ec41896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:49.476066 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-134b7942-481b-4eca-a632-96afee5ff94c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:00:49.477286 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-134b7942-481b-4eca-a632-96afee5ff94c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:49.481016 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-fe2f41bd-ac6d-41a1-9d3f-61fa27d76cf1 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] 10.222.0.60 "GET /compute/v2.1/servers/851d1bac-67b3-4477-8109-c37791c90f1b" status: 200 len: 1553 microversion: 2.1 time: 0.247557 Nov 23 13:00:49.481777 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 116/238] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:00:49 2021] GET /compute/v2.1/servers/851d1bac-67b3-4477-8109-c37791c90f1b => generated 1553 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 13:00:49.494426 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-134b7942-481b-4eca-a632-96afee5ff94c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:49.494881 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-134b7942-481b-4eca-a632-96afee5ff94c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:49.495651 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-134b7942-481b-4eca-a632-96afee5ff94c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:49.496083 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-134b7942-481b-4eca-a632-96afee5ff94c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:49.656092 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-71a7d309-3997-4e89-8e13-b3340aa83f08 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:49.656794 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-71a7d309-3997-4e89-8e13-b3340aa83f08 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: da72692d-5ac7-4e8e-9b7d-11d421a1f071] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:49.665174 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-71a7d309-3997-4e89-8e13-b3340aa83f08 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:49.665429 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-71a7d309-3997-4e89-8e13-b3340aa83f08 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:49.666316 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-71a7d309-3997-4e89-8e13-b3340aa83f08 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:49.666796 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-71a7d309-3997-4e89-8e13-b3340aa83f08 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:49.887746 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-71a7d309-3997-4e89-8e13-b3340aa83f08 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c023f89fd3da4bc8b38963bed4e5cc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a31364455dc442f8df299a8ad758a4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:49.896660 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-71a7d309-3997-4e89-8e13-b3340aa83f08 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/da72692d-5ac7-4e8e-9b7d-11d421a1f071" status: 200 len: 1318 microversion: 2.1 time: 0.244363 Nov 23 13:00:49.897214 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 117/239] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:00:49 2021] GET /compute/v2.1/servers/da72692d-5ac7-4e8e-9b7d-11d421a1f071 => generated 1318 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 13:00:49.904122 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-7eff6b2c-c3fc-40e6-9efa-2d9a73457a8c tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:49.905071 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-7eff6b2c-c3fc-40e6-9efa-2d9a73457a8c tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] [instance: 979f72d5-fadc-4b59-ace6-6b8b350a63d9] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:49.916341 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7eff6b2c-c3fc-40e6-9efa-2d9a73457a8c tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:49.916758 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7eff6b2c-c3fc-40e6-9efa-2d9a73457a8c tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:49.917522 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7eff6b2c-c3fc-40e6-9efa-2d9a73457a8c tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:49.917959 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7eff6b2c-c3fc-40e6-9efa-2d9a73457a8c tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:50.118258 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-7eff6b2c-c3fc-40e6-9efa-2d9a73457a8c tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb98e201f2f41b18735465a450909ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d331da092466b8d717a7e039a5b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:50.129020 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-7eff6b2c-c3fc-40e6-9efa-2d9a73457a8c tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] 10.222.0.60 "GET /compute/v2.1/servers/979f72d5-fadc-4b59-ace6-6b8b350a63d9" status: 200 len: 1315 microversion: 2.1 time: 0.230397 Nov 23 13:00:50.129838 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 118/240] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:00:49 2021] GET /compute/v2.1/servers/979f72d5-fadc-4b59-ace6-6b8b350a63d9 => generated 1315 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:00:50.136783 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-1f899d3e-da62-491c-81ad-e3ee8cca43c6 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:50.137814 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-1f899d3e-da62-491c-81ad-e3ee8cca43c6 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: bc54276f-764d-49ee-b58e-552822acc211] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:50.149659 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1f899d3e-da62-491c-81ad-e3ee8cca43c6 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:50.150448 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1f899d3e-da62-491c-81ad-e3ee8cca43c6 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:50.153341 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1f899d3e-da62-491c-81ad-e3ee8cca43c6 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:50.153341 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1f899d3e-da62-491c-81ad-e3ee8cca43c6 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:50.352305 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-1f899d3e-da62-491c-81ad-e3ee8cca43c6 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:50.361599 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-1f899d3e-da62-491c-81ad-e3ee8cca43c6 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211" status: 200 len: 1519 microversion: 2.1 time: 0.230506 Nov 23 13:00:50.362230 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 119/241] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:00:50 2021] GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211 => generated 1519 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:00:50.498227 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-04504a14-28d9-4801-a808-9f815abda86d tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:50.498822 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-04504a14-28d9-4801-a808-9f815abda86d tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] [instance: 851d1bac-67b3-4477-8109-c37791c90f1b] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:50.507025 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-04504a14-28d9-4801-a808-9f815abda86d tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:50.507467 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-04504a14-28d9-4801-a808-9f815abda86d tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:50.508230 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-04504a14-28d9-4801-a808-9f815abda86d tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:50.508702 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-04504a14-28d9-4801-a808-9f815abda86d tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:50.720023 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-04504a14-28d9-4801-a808-9f815abda86d tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7adc68cc5d47fea458da9232672087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d153c67e84449bb8eb36b752ec41896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:50.729479 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-04504a14-28d9-4801-a808-9f815abda86d tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] 10.222.0.60 "GET /compute/v2.1/servers/851d1bac-67b3-4477-8109-c37791c90f1b" status: 200 len: 1553 microversion: 2.1 time: 0.234983 Nov 23 13:00:50.729967 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 120/242] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:00:50 2021] GET /compute/v2.1/servers/851d1bac-67b3-4477-8109-c37791c90f1b => generated 1553 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:00:50.922521 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-067bcdfd-dd25-4c32-b14d-be76a56bb439 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:50.923817 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-067bcdfd-dd25-4c32-b14d-be76a56bb439 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: da72692d-5ac7-4e8e-9b7d-11d421a1f071] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:50.934047 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-067bcdfd-dd25-4c32-b14d-be76a56bb439 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:50.934496 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-067bcdfd-dd25-4c32-b14d-be76a56bb439 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:50.935253 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-067bcdfd-dd25-4c32-b14d-be76a56bb439 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:50.935677 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-067bcdfd-dd25-4c32-b14d-be76a56bb439 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:51.230159 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-067bcdfd-dd25-4c32-b14d-be76a56bb439 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c023f89fd3da4bc8b38963bed4e5cc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a31364455dc442f8df299a8ad758a4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:51.239161 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-067bcdfd-dd25-4c32-b14d-be76a56bb439 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/da72692d-5ac7-4e8e-9b7d-11d421a1f071" status: 200 len: 1318 microversion: 2.1 time: 0.324739 Nov 23 13:00:51.239736 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 121/243] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:00:50 2021] GET /compute/v2.1/servers/da72692d-5ac7-4e8e-9b7d-11d421a1f071 => generated 1318 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:00:51.244051 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-55e64cad-5568-4483-9201-2d9a00de47a7 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:51.244692 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-55e64cad-5568-4483-9201-2d9a00de47a7 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] [instance: 979f72d5-fadc-4b59-ace6-6b8b350a63d9] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:51.252526 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-55e64cad-5568-4483-9201-2d9a00de47a7 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:51.253334 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-55e64cad-5568-4483-9201-2d9a00de47a7 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:51.254110 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-55e64cad-5568-4483-9201-2d9a00de47a7 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:51.254537 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-55e64cad-5568-4483-9201-2d9a00de47a7 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:51.468402 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-55e64cad-5568-4483-9201-2d9a00de47a7 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb98e201f2f41b18735465a450909ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d331da092466b8d717a7e039a5b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:51.480524 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-55e64cad-5568-4483-9201-2d9a00de47a7 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] 10.222.0.60 "GET /compute/v2.1/servers/979f72d5-fadc-4b59-ace6-6b8b350a63d9" status: 200 len: 1315 microversion: 2.1 time: 0.239806 Nov 23 13:00:51.481106 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 122/244] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:00:51 2021] GET /compute/v2.1/servers/979f72d5-fadc-4b59-ace6-6b8b350a63d9 => generated 1315 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:00:51.485359 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-f44b1ba5-6bce-41ae-9a7a-e26f598bad7f tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:51.485957 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-f44b1ba5-6bce-41ae-9a7a-e26f598bad7f tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: bc54276f-764d-49ee-b58e-552822acc211] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:51.493670 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f44b1ba5-6bce-41ae-9a7a-e26f598bad7f tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:51.494388 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f44b1ba5-6bce-41ae-9a7a-e26f598bad7f tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:51.495235 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f44b1ba5-6bce-41ae-9a7a-e26f598bad7f tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:51.495667 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f44b1ba5-6bce-41ae-9a7a-e26f598bad7f tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:51.709681 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-f44b1ba5-6bce-41ae-9a7a-e26f598bad7f tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:51.718875 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-f44b1ba5-6bce-41ae-9a7a-e26f598bad7f tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211" status: 200 len: 1519 microversion: 2.1 time: 0.236739 Nov 23 13:00:51.719369 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 123/245] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:00:51 2021] GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211 => generated 1519 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:00:51.747270 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-a398c7e9-eefa-4fc7-9b60-a251c2a3ca41 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:51.747905 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-a398c7e9-eefa-4fc7-9b60-a251c2a3ca41 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] [instance: 851d1bac-67b3-4477-8109-c37791c90f1b] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:51.755937 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a398c7e9-eefa-4fc7-9b60-a251c2a3ca41 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:51.756429 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a398c7e9-eefa-4fc7-9b60-a251c2a3ca41 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:51.757200 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a398c7e9-eefa-4fc7-9b60-a251c2a3ca41 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:51.757646 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a398c7e9-eefa-4fc7-9b60-a251c2a3ca41 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:51.980697 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-a398c7e9-eefa-4fc7-9b60-a251c2a3ca41 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7adc68cc5d47fea458da9232672087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d153c67e84449bb8eb36b752ec41896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:51.990075 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-a398c7e9-eefa-4fc7-9b60-a251c2a3ca41 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] 10.222.0.60 "GET /compute/v2.1/servers/851d1bac-67b3-4477-8109-c37791c90f1b" status: 200 len: 1553 microversion: 2.1 time: 0.246826 Nov 23 13:00:51.990629 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 124/246] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:00:51 2021] GET /compute/v2.1/servers/851d1bac-67b3-4477-8109-c37791c90f1b => generated 1553 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:00:52.257136 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-c6ab564f-5a7b-4cd2-bd19-8b544c559378 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:52.257649 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-c6ab564f-5a7b-4cd2-bd19-8b544c559378 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: da72692d-5ac7-4e8e-9b7d-11d421a1f071] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:52.265684 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c6ab564f-5a7b-4cd2-bd19-8b544c559378 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:52.266139 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c6ab564f-5a7b-4cd2-bd19-8b544c559378 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:52.266930 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c6ab564f-5a7b-4cd2-bd19-8b544c559378 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:52.267365 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c6ab564f-5a7b-4cd2-bd19-8b544c559378 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:52.471084 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-c6ab564f-5a7b-4cd2-bd19-8b544c559378 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c023f89fd3da4bc8b38963bed4e5cc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a31364455dc442f8df299a8ad758a4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:52.480206 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-c6ab564f-5a7b-4cd2-bd19-8b544c559378 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/da72692d-5ac7-4e8e-9b7d-11d421a1f071" status: 200 len: 1318 microversion: 2.1 time: 0.227093 Nov 23 13:00:52.481379 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 125/247] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:00:52 2021] GET /compute/v2.1/servers/da72692d-5ac7-4e8e-9b7d-11d421a1f071 => generated 1318 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:00:52.498273 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-a82017ac-da16-4da1-8862-d360ffcca6de tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:52.498872 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-a82017ac-da16-4da1-8862-d360ffcca6de tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] [instance: 979f72d5-fadc-4b59-ace6-6b8b350a63d9] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:52.507037 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a82017ac-da16-4da1-8862-d360ffcca6de tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:52.507560 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a82017ac-da16-4da1-8862-d360ffcca6de tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:52.508337 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a82017ac-da16-4da1-8862-d360ffcca6de tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:52.508767 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a82017ac-da16-4da1-8862-d360ffcca6de tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:52.725681 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-a82017ac-da16-4da1-8862-d360ffcca6de tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb98e201f2f41b18735465a450909ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d331da092466b8d717a7e039a5b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:52.735761 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-a82017ac-da16-4da1-8862-d360ffcca6de tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] 10.222.0.60 "GET /compute/v2.1/servers/979f72d5-fadc-4b59-ace6-6b8b350a63d9" status: 200 len: 1315 microversion: 2.1 time: 0.241427 Nov 23 13:00:52.736391 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 126/248] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:00:52 2021] GET /compute/v2.1/servers/979f72d5-fadc-4b59-ace6-6b8b350a63d9 => generated 1315 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:00:52.740704 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-df68cb1b-a6da-43c5-97ff-cccb6879f239 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:52.741300 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-df68cb1b-a6da-43c5-97ff-cccb6879f239 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: bc54276f-764d-49ee-b58e-552822acc211] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:52.749169 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-df68cb1b-a6da-43c5-97ff-cccb6879f239 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:52.749624 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-df68cb1b-a6da-43c5-97ff-cccb6879f239 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:52.750393 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-df68cb1b-a6da-43c5-97ff-cccb6879f239 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:52.750825 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-df68cb1b-a6da-43c5-97ff-cccb6879f239 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:52.967769 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-df68cb1b-a6da-43c5-97ff-cccb6879f239 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:52.981535 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-df68cb1b-a6da-43c5-97ff-cccb6879f239 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211" status: 200 len: 1519 microversion: 2.1 time: 0.244148 Nov 23 13:00:52.982113 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 127/249] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:00:52 2021] GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211 => generated 1519 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:00:53.006839 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-9549aab1-3874-41de-b761-32e19867282f tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:53.007437 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-9549aab1-3874-41de-b761-32e19867282f tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] [instance: 851d1bac-67b3-4477-8109-c37791c90f1b] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:53.015124 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-9549aab1-3874-41de-b761-32e19867282f tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:53.015569 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-9549aab1-3874-41de-b761-32e19867282f tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:53.016404 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-9549aab1-3874-41de-b761-32e19867282f tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:53.016807 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-9549aab1-3874-41de-b761-32e19867282f tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:53.225947 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-9549aab1-3874-41de-b761-32e19867282f tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7adc68cc5d47fea458da9232672087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d153c67e84449bb8eb36b752ec41896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:53.240530 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-9549aab1-3874-41de-b761-32e19867282f tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] 10.222.0.60 "GET /compute/v2.1/servers/851d1bac-67b3-4477-8109-c37791c90f1b" status: 200 len: 1553 microversion: 2.1 time: 0.237278 Nov 23 13:00:53.241252 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 128/250] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:00:53 2021] GET /compute/v2.1/servers/851d1bac-67b3-4477-8109-c37791c90f1b => generated 1553 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:00:53.501852 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-fd95b015-6207-4ec5-87be-6720c007617c tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:53.502450 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-fd95b015-6207-4ec5-87be-6720c007617c tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: da72692d-5ac7-4e8e-9b7d-11d421a1f071] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:53.510701 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-fd95b015-6207-4ec5-87be-6720c007617c tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:53.511151 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-fd95b015-6207-4ec5-87be-6720c007617c tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:53.511978 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-fd95b015-6207-4ec5-87be-6720c007617c tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:53.512446 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-fd95b015-6207-4ec5-87be-6720c007617c tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:53.713056 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-fd95b015-6207-4ec5-87be-6720c007617c tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c023f89fd3da4bc8b38963bed4e5cc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a31364455dc442f8df299a8ad758a4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:53.721637 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-fd95b015-6207-4ec5-87be-6720c007617c tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/da72692d-5ac7-4e8e-9b7d-11d421a1f071" status: 200 len: 1318 microversion: 2.1 time: 0.223613 Nov 23 13:00:53.722218 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 129/251] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:00:53 2021] GET /compute/v2.1/servers/da72692d-5ac7-4e8e-9b7d-11d421a1f071 => generated 1318 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:00:53.756060 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-d6900c86-e9ce-4102-ab97-9d784d1cd7d7 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:53.756879 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-d6900c86-e9ce-4102-ab97-9d784d1cd7d7 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] [instance: 979f72d5-fadc-4b59-ace6-6b8b350a63d9] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:53.767606 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d6900c86-e9ce-4102-ab97-9d784d1cd7d7 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:53.768127 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d6900c86-e9ce-4102-ab97-9d784d1cd7d7 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:53.769112 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d6900c86-e9ce-4102-ab97-9d784d1cd7d7 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:53.769448 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d6900c86-e9ce-4102-ab97-9d784d1cd7d7 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:53.973385 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-d6900c86-e9ce-4102-ab97-9d784d1cd7d7 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb98e201f2f41b18735465a450909ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d331da092466b8d717a7e039a5b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:53.986172 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-d6900c86-e9ce-4102-ab97-9d784d1cd7d7 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] 10.222.0.60 "GET /compute/v2.1/servers/979f72d5-fadc-4b59-ace6-6b8b350a63d9" status: 200 len: 1315 microversion: 2.1 time: 0.235455 Nov 23 13:00:53.987567 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 130/252] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:00:53 2021] GET /compute/v2.1/servers/979f72d5-fadc-4b59-ace6-6b8b350a63d9 => generated 1315 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:00:53.998339 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-b158aa14-0726-4eca-8bcd-7ee5c2ffbcf1 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:53.998969 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-b158aa14-0726-4eca-8bcd-7ee5c2ffbcf1 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: bc54276f-764d-49ee-b58e-552822acc211] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:54.007007 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b158aa14-0726-4eca-8bcd-7ee5c2ffbcf1 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:54.007391 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b158aa14-0726-4eca-8bcd-7ee5c2ffbcf1 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:54.008155 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b158aa14-0726-4eca-8bcd-7ee5c2ffbcf1 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:54.008613 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b158aa14-0726-4eca-8bcd-7ee5c2ffbcf1 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:54.237539 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-b158aa14-0726-4eca-8bcd-7ee5c2ffbcf1 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:54.250479 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-b158aa14-0726-4eca-8bcd-7ee5c2ffbcf1 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211" status: 200 len: 1519 microversion: 2.1 time: 0.255499 Nov 23 13:00:54.251370 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 131/253] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:00:53 2021] GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211 => generated 1519 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:00:54.260977 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-10cfa86e-a14a-4116-b549-30e9b4299873 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:54.261652 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-10cfa86e-a14a-4116-b549-30e9b4299873 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] [instance: 851d1bac-67b3-4477-8109-c37791c90f1b] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:54.269982 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-10cfa86e-a14a-4116-b549-30e9b4299873 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:54.270432 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-10cfa86e-a14a-4116-b549-30e9b4299873 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:54.271253 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-10cfa86e-a14a-4116-b549-30e9b4299873 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:54.271687 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-10cfa86e-a14a-4116-b549-30e9b4299873 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:54.471629 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-10cfa86e-a14a-4116-b549-30e9b4299873 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7adc68cc5d47fea458da9232672087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d153c67e84449bb8eb36b752ec41896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:54.481267 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-10cfa86e-a14a-4116-b549-30e9b4299873 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] 10.222.0.60 "GET /compute/v2.1/servers/851d1bac-67b3-4477-8109-c37791c90f1b" status: 200 len: 1553 microversion: 2.1 time: 0.223994 Nov 23 13:00:54.481885 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 132/254] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:00:54 2021] GET /compute/v2.1/servers/851d1bac-67b3-4477-8109-c37791c90f1b => generated 1553 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:00:54.674368 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-134b7942-481b-4eca-a632-96afee5ff94c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action" status: 200 len: 27851 microversion: 2.20 time: 5.209520 Nov 23 13:00:54.675166 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 123/255] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:00:49 2021] POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action => generated 27851 bytes in 5211 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:00:54.744459 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-7e13acfa-0cc4-4966-a209-68daf79cc28a tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:54.745389 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-7e13acfa-0cc4-4966-a209-68daf79cc28a tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: da72692d-5ac7-4e8e-9b7d-11d421a1f071] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:54.753360 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7e13acfa-0cc4-4966-a209-68daf79cc28a tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:54.754095 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7e13acfa-0cc4-4966-a209-68daf79cc28a tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:54.754568 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7e13acfa-0cc4-4966-a209-68daf79cc28a tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:54.755023 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7e13acfa-0cc4-4966-a209-68daf79cc28a tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:55.004353 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-62f5eebd-2fbf-41f8-859f-f43d55fd146f tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:55.005050 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-62f5eebd-2fbf-41f8-859f-f43d55fd146f tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] [instance: 979f72d5-fadc-4b59-ace6-6b8b350a63d9] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:55.014037 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-62f5eebd-2fbf-41f8-859f-f43d55fd146f tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:55.014489 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-62f5eebd-2fbf-41f8-859f-f43d55fd146f tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:55.015245 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-62f5eebd-2fbf-41f8-859f-f43d55fd146f tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:55.015841 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-62f5eebd-2fbf-41f8-859f-f43d55fd146f tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:55.160481 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-7e13acfa-0cc4-4966-a209-68daf79cc28a tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c023f89fd3da4bc8b38963bed4e5cc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a31364455dc442f8df299a8ad758a4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:55.171030 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-7e13acfa-0cc4-4966-a209-68daf79cc28a tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/da72692d-5ac7-4e8e-9b7d-11d421a1f071" status: 200 len: 1318 microversion: 2.1 time: 0.431772 Nov 23 13:00:55.181888 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 133/256] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:00:54 2021] GET /compute/v2.1/servers/da72692d-5ac7-4e8e-9b7d-11d421a1f071 => generated 1318 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:00:55.235682 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-62f5eebd-2fbf-41f8-859f-f43d55fd146f tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb98e201f2f41b18735465a450909ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d331da092466b8d717a7e039a5b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:55.244252 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-62f5eebd-2fbf-41f8-859f-f43d55fd146f tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] 10.222.0.60 "GET /compute/v2.1/servers/979f72d5-fadc-4b59-ace6-6b8b350a63d9" status: 200 len: 1315 microversion: 2.1 time: 0.244416 Nov 23 13:00:55.244880 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 124/257] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:00:54 2021] GET /compute/v2.1/servers/979f72d5-fadc-4b59-ace6-6b8b350a63d9 => generated 1315 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:00:55.268798 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-246885e4-c4a8-43a1-ad56-fa1ae7ef6190 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:55.269480 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-246885e4-c4a8-43a1-ad56-fa1ae7ef6190 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: bc54276f-764d-49ee-b58e-552822acc211] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:55.277600 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-246885e4-c4a8-43a1-ad56-fa1ae7ef6190 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:55.278064 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-246885e4-c4a8-43a1-ad56-fa1ae7ef6190 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:55.278854 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-246885e4-c4a8-43a1-ad56-fa1ae7ef6190 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:55.279294 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-246885e4-c4a8-43a1-ad56-fa1ae7ef6190 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:55.498773 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-65683ba0-a0f9-4f9c-a534-b2f24daa31f5 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:55.499385 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-65683ba0-a0f9-4f9c-a534-b2f24daa31f5 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] [instance: 851d1bac-67b3-4477-8109-c37791c90f1b] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:55.507425 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-65683ba0-a0f9-4f9c-a534-b2f24daa31f5 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:55.507889 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-65683ba0-a0f9-4f9c-a534-b2f24daa31f5 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:55.508695 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-65683ba0-a0f9-4f9c-a534-b2f24daa31f5 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:55.509123 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-65683ba0-a0f9-4f9c-a534-b2f24daa31f5 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:55.710936 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-246885e4-c4a8-43a1-ad56-fa1ae7ef6190 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:55.725663 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-65683ba0-a0f9-4f9c-a534-b2f24daa31f5 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7adc68cc5d47fea458da9232672087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d153c67e84449bb8eb36b752ec41896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:55.727502 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-246885e4-c4a8-43a1-ad56-fa1ae7ef6190 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211" status: 200 len: 1519 microversion: 2.1 time: 0.462443 Nov 23 13:00:55.737853 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 134/258] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:00:55 2021] GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211 => generated 1519 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:00:55.738819 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-65683ba0-a0f9-4f9c-a534-b2f24daa31f5 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] 10.222.0.60 "GET /compute/v2.1/servers/851d1bac-67b3-4477-8109-c37791c90f1b" status: 200 len: 1553 microversion: 2.1 time: 0.243534 Nov 23 13:00:55.740145 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 125/259] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:00:55 2021] GET /compute/v2.1/servers/851d1bac-67b3-4477-8109-c37791c90f1b => generated 1553 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:00:55.758736 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-7ddb6a90-f1f9-4a42-8535-d0bb545884af tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:00:55.760150 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-7ddb6a90-f1f9-4a42-8535-d0bb545884af tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:55.775475 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7ddb6a90-f1f9-4a42-8535-d0bb545884af tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:55.775918 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7ddb6a90-f1f9-4a42-8535-d0bb545884af tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:55.776726 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7ddb6a90-f1f9-4a42-8535-d0bb545884af tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:55.777247 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7ddb6a90-f1f9-4a42-8535-d0bb545884af tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:55.893469 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [req-39fd47d1-a6cf-4552-bea9-c9f643367b4f req-21352478-ef6e-4731-ac57-b7149b057c4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "851d1bac-67b3-4477-8109-c37791c90f1b", "name": "network-vif-deleted", "tag": "e47ad125-0726-4518-a3bc-ae85b21ef184"}]} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:00:55.895356 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 13:00:55.895356 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: warnings.warn(msg) Nov 23 13:00:55.904637 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [req-39fd47d1-a6cf-4552-bea9-c9f643367b4f req-21352478-ef6e-4731-ac57-b7149b057c4e service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:55.905074 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [req-39fd47d1-a6cf-4552-bea9-c9f643367b4f req-21352478-ef6e-4731-ac57-b7149b057c4e service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:55.924768 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.compute.server_external_events [req-39fd47d1-a6cf-4552-bea9-c9f643367b4f req-21352478-ef6e-4731-ac57-b7149b057c4e service nova] Creating event network-vif-deleted:e47ad125-0726-4518-a3bc-ae85b21ef184 for instance 851d1bac-67b3-4477-8109-c37791c90f1b on hv-cinder-81888 Nov 23 13:00:55.929794 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [req-39fd47d1-a6cf-4552-bea9-c9f643367b4f req-21352478-ef6e-4731-ac57-b7149b057c4e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040310 Nov 23 13:00:55.930698 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 126/260] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Nov 23 13:00:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 13:00:56.191962 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-bf12906b-fd1e-4bdb-b572-57aa14c56839 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:56.192729 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-bf12906b-fd1e-4bdb-b572-57aa14c56839 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: da72692d-5ac7-4e8e-9b7d-11d421a1f071] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:56.201387 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-bf12906b-fd1e-4bdb-b572-57aa14c56839 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:56.201828 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-bf12906b-fd1e-4bdb-b572-57aa14c56839 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:56.202600 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-bf12906b-fd1e-4bdb-b572-57aa14c56839 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:56.203028 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-bf12906b-fd1e-4bdb-b572-57aa14c56839 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:56.422390 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-bf12906b-fd1e-4bdb-b572-57aa14c56839 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c023f89fd3da4bc8b38963bed4e5cc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a31364455dc442f8df299a8ad758a4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:56.436549 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-bf12906b-fd1e-4bdb-b572-57aa14c56839 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/da72692d-5ac7-4e8e-9b7d-11d421a1f071" status: 200 len: 1318 microversion: 2.1 time: 0.248901 Nov 23 13:00:56.437344 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 127/261] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:00:56 2021] GET /compute/v2.1/servers/da72692d-5ac7-4e8e-9b7d-11d421a1f071 => generated 1318 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 13:00:56.444624 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-6c574feb-9f4b-4a92-8dad-f8e729f7467f tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:56.444624 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-6c574feb-9f4b-4a92-8dad-f8e729f7467f tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] [instance: 979f72d5-fadc-4b59-ace6-6b8b350a63d9] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:56.453004 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6c574feb-9f4b-4a92-8dad-f8e729f7467f tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:56.453538 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6c574feb-9f4b-4a92-8dad-f8e729f7467f tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:56.454177 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6c574feb-9f4b-4a92-8dad-f8e729f7467f tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:56.454622 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6c574feb-9f4b-4a92-8dad-f8e729f7467f tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:56.673278 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-6c574feb-9f4b-4a92-8dad-f8e729f7467f tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb98e201f2f41b18735465a450909ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d331da092466b8d717a7e039a5b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:56.686536 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-6c574feb-9f4b-4a92-8dad-f8e729f7467f tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] 10.222.0.60 "GET /compute/v2.1/servers/979f72d5-fadc-4b59-ace6-6b8b350a63d9" status: 200 len: 1315 microversion: 2.1 time: 0.247972 Nov 23 13:00:56.687351 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 128/262] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:00:56 2021] GET /compute/v2.1/servers/979f72d5-fadc-4b59-ace6-6b8b350a63d9 => generated 1315 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:00:56.744082 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-581ea260-51c4-465a-ad2a-b5873c00f8f9 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:56.744817 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-581ea260-51c4-465a-ad2a-b5873c00f8f9 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: bc54276f-764d-49ee-b58e-552822acc211] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:56.753135 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-581ea260-51c4-465a-ad2a-b5873c00f8f9 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:56.753603 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-581ea260-51c4-465a-ad2a-b5873c00f8f9 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:56.754360 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-581ea260-51c4-465a-ad2a-b5873c00f8f9 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:56.754788 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-581ea260-51c4-465a-ad2a-b5873c00f8f9 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:56.958387 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-581ea260-51c4-465a-ad2a-b5873c00f8f9 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:56.967517 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-581ea260-51c4-465a-ad2a-b5873c00f8f9 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211" status: 200 len: 1519 microversion: 2.1 time: 0.227187 Nov 23 13:00:56.968097 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 129/263] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:00:56 2021] GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211 => generated 1519 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:00:56.972516 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-a8bfd996-2be3-464c-82ad-b5f6e9dcea44 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:56.973113 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-a8bfd996-2be3-464c-82ad-b5f6e9dcea44 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] [instance: 851d1bac-67b3-4477-8109-c37791c90f1b] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:56.980400 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a8bfd996-2be3-464c-82ad-b5f6e9dcea44 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:56.980851 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a8bfd996-2be3-464c-82ad-b5f6e9dcea44 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:56.981613 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a8bfd996-2be3-464c-82ad-b5f6e9dcea44 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:56.982050 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a8bfd996-2be3-464c-82ad-b5f6e9dcea44 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:57.100492 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-a8bfd996-2be3-464c-82ad-b5f6e9dcea44 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7adc68cc5d47fea458da9232672087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d153c67e84449bb8eb36b752ec41896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:57.109555 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-a8bfd996-2be3-464c-82ad-b5f6e9dcea44 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] 10.222.0.60 "GET /compute/v2.1/servers/851d1bac-67b3-4477-8109-c37791c90f1b" status: 200 len: 1511 microversion: 2.1 time: 0.140469 Nov 23 13:00:57.110113 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 130/264] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:00:56 2021] GET /compute/v2.1/servers/851d1bac-67b3-4477-8109-c37791c90f1b => generated 1511 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:00:57.455299 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-d917dc6b-352f-4d74-b8ec-9c09b9962af2 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:57.455892 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-d917dc6b-352f-4d74-b8ec-9c09b9962af2 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: da72692d-5ac7-4e8e-9b7d-11d421a1f071] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:57.464117 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d917dc6b-352f-4d74-b8ec-9c09b9962af2 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:57.464636 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d917dc6b-352f-4d74-b8ec-9c09b9962af2 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:57.465509 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d917dc6b-352f-4d74-b8ec-9c09b9962af2 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:57.465938 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d917dc6b-352f-4d74-b8ec-9c09b9962af2 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:57.690079 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-d917dc6b-352f-4d74-b8ec-9c09b9962af2 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c023f89fd3da4bc8b38963bed4e5cc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a31364455dc442f8df299a8ad758a4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:57.699048 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-d917dc6b-352f-4d74-b8ec-9c09b9962af2 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/da72692d-5ac7-4e8e-9b7d-11d421a1f071" status: 200 len: 1318 microversion: 2.1 time: 0.247606 Nov 23 13:00:57.700023 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 131/265] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:00:57 2021] GET /compute/v2.1/servers/da72692d-5ac7-4e8e-9b7d-11d421a1f071 => generated 1318 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:00:57.709773 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-c7f20c10-3b44-4f82-8a30-bcdc736fe0b7 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:57.710220 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-c7f20c10-3b44-4f82-8a30-bcdc736fe0b7 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] [instance: 979f72d5-fadc-4b59-ace6-6b8b350a63d9] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:57.718681 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c7f20c10-3b44-4f82-8a30-bcdc736fe0b7 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:57.719125 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c7f20c10-3b44-4f82-8a30-bcdc736fe0b7 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:57.719889 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c7f20c10-3b44-4f82-8a30-bcdc736fe0b7 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:57.720348 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c7f20c10-3b44-4f82-8a30-bcdc736fe0b7 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:57.939231 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-c7f20c10-3b44-4f82-8a30-bcdc736fe0b7 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb98e201f2f41b18735465a450909ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d331da092466b8d717a7e039a5b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:57.949298 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-c7f20c10-3b44-4f82-8a30-bcdc736fe0b7 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] 10.222.0.60 "GET /compute/v2.1/servers/979f72d5-fadc-4b59-ace6-6b8b350a63d9" status: 200 len: 1315 microversion: 2.1 time: 0.243336 Nov 23 13:00:57.950040 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 132/266] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:00:57 2021] GET /compute/v2.1/servers/979f72d5-fadc-4b59-ace6-6b8b350a63d9 => generated 1315 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:00:57.985238 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-455ad464-9072-4371-91e7-2df672e23f84 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:57.985920 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-455ad464-9072-4371-91e7-2df672e23f84 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: bc54276f-764d-49ee-b58e-552822acc211] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:57.994306 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-455ad464-9072-4371-91e7-2df672e23f84 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:57.994760 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-455ad464-9072-4371-91e7-2df672e23f84 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:57.995632 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-455ad464-9072-4371-91e7-2df672e23f84 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:57.996370 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-455ad464-9072-4371-91e7-2df672e23f84 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:58.204027 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-455ad464-9072-4371-91e7-2df672e23f84 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:58.214619 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-455ad464-9072-4371-91e7-2df672e23f84 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211" status: 200 len: 1519 microversion: 2.1 time: 0.233222 Nov 23 13:00:58.215291 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 133/267] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:00:57 2021] GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211 => generated 1519 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:00:58.219754 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-0bb34555-e66f-4e37-b4b8-cb74ce317121 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:58.220380 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-0bb34555-e66f-4e37-b4b8-cb74ce317121 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] [instance: 851d1bac-67b3-4477-8109-c37791c90f1b] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:58.228196 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0bb34555-e66f-4e37-b4b8-cb74ce317121 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:58.228678 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0bb34555-e66f-4e37-b4b8-cb74ce317121 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:58.229467 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0bb34555-e66f-4e37-b4b8-cb74ce317121 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:58.229906 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0bb34555-e66f-4e37-b4b8-cb74ce317121 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:58.350605 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-0bb34555-e66f-4e37-b4b8-cb74ce317121 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7adc68cc5d47fea458da9232672087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d153c67e84449bb8eb36b752ec41896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:58.360370 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-0bb34555-e66f-4e37-b4b8-cb74ce317121 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] 10.222.0.60 "GET /compute/v2.1/servers/851d1bac-67b3-4477-8109-c37791c90f1b" status: 200 len: 1511 microversion: 2.1 time: 0.144095 Nov 23 13:00:58.360978 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 134/268] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:00:58 2021] GET /compute/v2.1/servers/851d1bac-67b3-4477-8109-c37791c90f1b => generated 1511 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:00:58.718825 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-df818356-67fe-4d8f-9a00-c1102c6185bb tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:58.719343 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-df818356-67fe-4d8f-9a00-c1102c6185bb tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: da72692d-5ac7-4e8e-9b7d-11d421a1f071] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:58.727489 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-df818356-67fe-4d8f-9a00-c1102c6185bb tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:58.727977 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-df818356-67fe-4d8f-9a00-c1102c6185bb tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:58.728781 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-df818356-67fe-4d8f-9a00-c1102c6185bb tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:58.729211 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-df818356-67fe-4d8f-9a00-c1102c6185bb tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:58.931775 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-df818356-67fe-4d8f-9a00-c1102c6185bb tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c023f89fd3da4bc8b38963bed4e5cc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a31364455dc442f8df299a8ad758a4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:58.940969 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-df818356-67fe-4d8f-9a00-c1102c6185bb tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/da72692d-5ac7-4e8e-9b7d-11d421a1f071" status: 200 len: 1318 microversion: 2.1 time: 0.226195 Nov 23 13:00:58.941586 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 135/269] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:00:58 2021] GET /compute/v2.1/servers/da72692d-5ac7-4e8e-9b7d-11d421a1f071 => generated 1318 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:00:58.967280 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-d64c34dc-f2fe-40e6-9178-4a73ebdfab8a tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:58.967878 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-d64c34dc-f2fe-40e6-9178-4a73ebdfab8a tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] [instance: 979f72d5-fadc-4b59-ace6-6b8b350a63d9] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:58.975799 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d64c34dc-f2fe-40e6-9178-4a73ebdfab8a tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:58.976185 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d64c34dc-f2fe-40e6-9178-4a73ebdfab8a tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:58.976989 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d64c34dc-f2fe-40e6-9178-4a73ebdfab8a tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:58.977709 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d64c34dc-f2fe-40e6-9178-4a73ebdfab8a tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:59.201413 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-d64c34dc-f2fe-40e6-9178-4a73ebdfab8a tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb98e201f2f41b18735465a450909ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d331da092466b8d717a7e039a5b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:59.214668 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-d64c34dc-f2fe-40e6-9178-4a73ebdfab8a tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] 10.222.0.60 "GET /compute/v2.1/servers/979f72d5-fadc-4b59-ace6-6b8b350a63d9" status: 200 len: 1315 microversion: 2.1 time: 0.251532 Nov 23 13:00:59.215272 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 136/270] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:00:58 2021] GET /compute/v2.1/servers/979f72d5-fadc-4b59-ace6-6b8b350a63d9 => generated 1315 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:00:59.231539 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-cbeb783f-e0c7-457d-b1e2-d533e4496031 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:59.232060 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-cbeb783f-e0c7-457d-b1e2-d533e4496031 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: bc54276f-764d-49ee-b58e-552822acc211] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:59.240723 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-cbeb783f-e0c7-457d-b1e2-d533e4496031 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:59.241307 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-cbeb783f-e0c7-457d-b1e2-d533e4496031 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:59.242182 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-cbeb783f-e0c7-457d-b1e2-d533e4496031 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:59.242611 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-cbeb783f-e0c7-457d-b1e2-d533e4496031 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:59.460409 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-cbeb783f-e0c7-457d-b1e2-d533e4496031 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:59.474319 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-cbeb783f-e0c7-457d-b1e2-d533e4496031 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211" status: 200 len: 1519 microversion: 2.1 time: 0.246416 Nov 23 13:00:59.475055 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 137/271] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:00:59 2021] GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211 => generated 1519 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:00:59.479306 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-160dc508-569d-471e-9b5b-7db8f18f7ae9 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:59.479887 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-160dc508-569d-471e-9b5b-7db8f18f7ae9 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] [instance: 851d1bac-67b3-4477-8109-c37791c90f1b] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:59.487857 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-160dc508-569d-471e-9b5b-7db8f18f7ae9 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:59.488219 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-160dc508-569d-471e-9b5b-7db8f18f7ae9 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:59.489021 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-160dc508-569d-471e-9b5b-7db8f18f7ae9 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:59.489476 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-160dc508-569d-471e-9b5b-7db8f18f7ae9 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:59.611597 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-160dc508-569d-471e-9b5b-7db8f18f7ae9 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7adc68cc5d47fea458da9232672087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d153c67e84449bb8eb36b752ec41896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:00:59.620490 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-160dc508-569d-471e-9b5b-7db8f18f7ae9 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] 10.222.0.60 "GET /compute/v2.1/servers/851d1bac-67b3-4477-8109-c37791c90f1b" status: 200 len: 1511 microversion: 2.1 time: 0.144497 Nov 23 13:00:59.621116 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 138/272] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:00:59 2021] GET /compute/v2.1/servers/851d1bac-67b3-4477-8109-c37791c90f1b => generated 1511 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:00:59.964208 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-fff8df56-c976-4186-9fbf-e8f13da2b475 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:00:59.965177 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-fff8df56-c976-4186-9fbf-e8f13da2b475 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: da72692d-5ac7-4e8e-9b7d-11d421a1f071] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:00:59.973132 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-fff8df56-c976-4186-9fbf-e8f13da2b475 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:59.973583 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-fff8df56-c976-4186-9fbf-e8f13da2b475 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:00:59.974387 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-fff8df56-c976-4186-9fbf-e8f13da2b475 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:00:59.974848 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-fff8df56-c976-4186-9fbf-e8f13da2b475 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:00.067431 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-7ddb6a90-f1f9-4a42-8535-d0bb545884af tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action" status: 200 len: 27851 microversion: 2.20 time: 4.321138 Nov 23 13:01:00.067431 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 135/273] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:00:55 2021] POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action => generated 27851 bytes in 4324 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:01:00.196016 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-fff8df56-c976-4186-9fbf-e8f13da2b475 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c023f89fd3da4bc8b38963bed4e5cc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a31364455dc442f8df299a8ad758a4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:01:00.206303 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-fff8df56-c976-4186-9fbf-e8f13da2b475 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/da72692d-5ac7-4e8e-9b7d-11d421a1f071" status: 200 len: 1318 microversion: 2.1 time: 0.247650 Nov 23 13:01:00.207196 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 139/274] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:00:59 2021] GET /compute/v2.1/servers/da72692d-5ac7-4e8e-9b7d-11d421a1f071 => generated 1318 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:01:00.231946 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-0dedba53-caf0-476a-8bd9-715f1da5570a tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:00.232661 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-0dedba53-caf0-476a-8bd9-715f1da5570a tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] [instance: 979f72d5-fadc-4b59-ace6-6b8b350a63d9] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:00.240723 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0dedba53-caf0-476a-8bd9-715f1da5570a tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:00.241174 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0dedba53-caf0-476a-8bd9-715f1da5570a tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:00.241949 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0dedba53-caf0-476a-8bd9-715f1da5570a tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:00.242541 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0dedba53-caf0-476a-8bd9-715f1da5570a tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:00.467333 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-0dedba53-caf0-476a-8bd9-715f1da5570a tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb98e201f2f41b18735465a450909ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d331da092466b8d717a7e039a5b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:01:00.476339 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-0dedba53-caf0-476a-8bd9-715f1da5570a tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] 10.222.0.60 "GET /compute/v2.1/servers/979f72d5-fadc-4b59-ace6-6b8b350a63d9" status: 200 len: 1315 microversion: 2.1 time: 0.248904 Nov 23 13:01:00.476936 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 136/275] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:01:00 2021] GET /compute/v2.1/servers/979f72d5-fadc-4b59-ace6-6b8b350a63d9 => generated 1315 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:01:00.493561 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-7aeb6e2a-4719-4255-9a09-63ac5a87fcf2 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:00.494819 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-7aeb6e2a-4719-4255-9a09-63ac5a87fcf2 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: bc54276f-764d-49ee-b58e-552822acc211] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:00.503616 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-7aeb6e2a-4719-4255-9a09-63ac5a87fcf2 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:00.504068 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-7aeb6e2a-4719-4255-9a09-63ac5a87fcf2 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:00.504881 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-7aeb6e2a-4719-4255-9a09-63ac5a87fcf2 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:00.505311 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-7aeb6e2a-4719-4255-9a09-63ac5a87fcf2 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:00.643684 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-e69c081d-83d1-4c62-9800-9df8bbce9065 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:00.644910 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-e69c081d-83d1-4c62-9800-9df8bbce9065 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] [instance: 851d1bac-67b3-4477-8109-c37791c90f1b] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:00.655191 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e69c081d-83d1-4c62-9800-9df8bbce9065 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:00.655655 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e69c081d-83d1-4c62-9800-9df8bbce9065 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:00.656555 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e69c081d-83d1-4c62-9800-9df8bbce9065 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:00.657012 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e69c081d-83d1-4c62-9800-9df8bbce9065 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:00.719772 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-7aeb6e2a-4719-4255-9a09-63ac5a87fcf2 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:01:00.728650 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-7aeb6e2a-4719-4255-9a09-63ac5a87fcf2 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211" status: 200 len: 1519 microversion: 2.1 time: 0.241217 Nov 23 13:01:00.729303 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 140/276] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:01:00 2021] GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211 => generated 1519 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:01:00.792683 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-e69c081d-83d1-4c62-9800-9df8bbce9065 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7adc68cc5d47fea458da9232672087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d153c67e84449bb8eb36b752ec41896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:01:00.801794 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-e69c081d-83d1-4c62-9800-9df8bbce9065 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] 10.222.0.60 "GET /compute/v2.1/servers/851d1bac-67b3-4477-8109-c37791c90f1b" status: 200 len: 1345 microversion: 2.1 time: 0.162295 Nov 23 13:01:00.802365 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 137/277] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:01:00 2021] GET /compute/v2.1/servers/851d1bac-67b3-4477-8109-c37791c90f1b => generated 1345 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:01:01.073971 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-b28ebb10-c48f-4653-8eda-e5beb04102b7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:01:01.075116 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-b28ebb10-c48f-4653-8eda-e5beb04102b7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:01.082989 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b28ebb10-c48f-4653-8eda-e5beb04102b7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:01.083433 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b28ebb10-c48f-4653-8eda-e5beb04102b7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:01.084207 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b28ebb10-c48f-4653-8eda-e5beb04102b7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:01.084666 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b28ebb10-c48f-4653-8eda-e5beb04102b7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:01.224579 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-dba68b82-749b-4395-b53c-8dd17975b469 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:01.225596 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-dba68b82-749b-4395-b53c-8dd17975b469 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: da72692d-5ac7-4e8e-9b7d-11d421a1f071] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:01.233437 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-dba68b82-749b-4395-b53c-8dd17975b469 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:01.233884 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-dba68b82-749b-4395-b53c-8dd17975b469 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:01.234651 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-dba68b82-749b-4395-b53c-8dd17975b469 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:01.235081 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-dba68b82-749b-4395-b53c-8dd17975b469 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:01.255186 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-b28ebb10-c48f-4653-8eda-e5beb04102b7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action" status: 200 len: 27917 microversion: 2.20 time: 0.185020 Nov 23 13:01:01.255840 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 141/278] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:01:01 2021] POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action => generated 27917 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:01:01.434209 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-dba68b82-749b-4395-b53c-8dd17975b469 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c023f89fd3da4bc8b38963bed4e5cc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a31364455dc442f8df299a8ad758a4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:01:01.442923 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-dba68b82-749b-4395-b53c-8dd17975b469 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/da72692d-5ac7-4e8e-9b7d-11d421a1f071" status: 200 len: 1318 microversion: 2.1 time: 0.221635 Nov 23 13:01:01.443301 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 138/279] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:01:01 2021] GET /compute/v2.1/servers/da72692d-5ac7-4e8e-9b7d-11d421a1f071 => generated 1318 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:01:01.496289 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-b6202bcd-ec30-40d0-878a-d4997e0d6b6f tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:01.497150 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-b6202bcd-ec30-40d0-878a-d4997e0d6b6f tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] [instance: 979f72d5-fadc-4b59-ace6-6b8b350a63d9] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:01.505519 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b6202bcd-ec30-40d0-878a-d4997e0d6b6f tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:01.505949 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b6202bcd-ec30-40d0-878a-d4997e0d6b6f tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:01.506740 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b6202bcd-ec30-40d0-878a-d4997e0d6b6f tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:01.507165 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b6202bcd-ec30-40d0-878a-d4997e0d6b6f tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:01.719016 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-b6202bcd-ec30-40d0-878a-d4997e0d6b6f tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb98e201f2f41b18735465a450909ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d331da092466b8d717a7e039a5b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:01:01.727711 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-b6202bcd-ec30-40d0-878a-d4997e0d6b6f tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] 10.222.0.60 "GET /compute/v2.1/servers/979f72d5-fadc-4b59-ace6-6b8b350a63d9" status: 200 len: 1315 microversion: 2.1 time: 0.236052 Nov 23 13:01:01.728605 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 142/280] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:01:01 2021] GET /compute/v2.1/servers/979f72d5-fadc-4b59-ace6-6b8b350a63d9 => generated 1315 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:01:01.745206 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-6e0d67db-dc52-4b31-9721-becd130383dd tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:01.745349 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-6e0d67db-dc52-4b31-9721-becd130383dd tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: bc54276f-764d-49ee-b58e-552822acc211] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:01.753384 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-6e0d67db-dc52-4b31-9721-becd130383dd tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:01.753826 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-6e0d67db-dc52-4b31-9721-becd130383dd tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:01.754593 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-6e0d67db-dc52-4b31-9721-becd130383dd tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:01.755023 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-6e0d67db-dc52-4b31-9721-becd130383dd tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:01.859218 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-6f019931-1fc7-4131-b13d-4a597c867481 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:01.860173 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-6f019931-1fc7-4131-b13d-4a597c867481 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] [instance: 851d1bac-67b3-4477-8109-c37791c90f1b] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:01.871887 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6f019931-1fc7-4131-b13d-4a597c867481 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:01.872169 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6f019931-1fc7-4131-b13d-4a597c867481 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:01.873488 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6f019931-1fc7-4131-b13d-4a597c867481 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:01.873488 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6f019931-1fc7-4131-b13d-4a597c867481 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:02.028694 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-6e0d67db-dc52-4b31-9721-becd130383dd tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:01:02.039750 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-6e0d67db-dc52-4b31-9721-becd130383dd tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211" status: 200 len: 1519 microversion: 2.1 time: 0.298208 Nov 23 13:01:02.049531 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 139/281] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:01:01 2021] GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211 => generated 1519 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:01:02.123807 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-6f019931-1fc7-4131-b13d-4a597c867481 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7adc68cc5d47fea458da9232672087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d153c67e84449bb8eb36b752ec41896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:01:02.134511 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-6f019931-1fc7-4131-b13d-4a597c867481 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] 10.222.0.60 "GET /compute/v2.1/servers/851d1bac-67b3-4477-8109-c37791c90f1b" status: 200 len: 1345 microversion: 2.1 time: 0.279244 Nov 23 13:01:02.135099 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 143/282] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:01:01 2021] GET /compute/v2.1/servers/851d1bac-67b3-4477-8109-c37791c90f1b => generated 1345 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 13:01:02.268777 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-7b416346-cc84-430f-9688-8ca1549a4f98 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:01:02.270068 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-7b416346-cc84-430f-9688-8ca1549a4f98 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:02.279240 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7b416346-cc84-430f-9688-8ca1549a4f98 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:02.279752 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7b416346-cc84-430f-9688-8ca1549a4f98 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:02.280613 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7b416346-cc84-430f-9688-8ca1549a4f98 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:02.281123 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7b416346-cc84-430f-9688-8ca1549a4f98 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:02.459512 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-d266ff0b-a767-46e4-9efe-059e9b0d0bdb tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:02.460133 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-d266ff0b-a767-46e4-9efe-059e9b0d0bdb tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: da72692d-5ac7-4e8e-9b7d-11d421a1f071] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:02.470182 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d266ff0b-a767-46e4-9efe-059e9b0d0bdb tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:02.470661 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d266ff0b-a767-46e4-9efe-059e9b0d0bdb tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:02.471589 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d266ff0b-a767-46e4-9efe-059e9b0d0bdb tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:02.472087 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d266ff0b-a767-46e4-9efe-059e9b0d0bdb tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:02.694269 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-d266ff0b-a767-46e4-9efe-059e9b0d0bdb tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c023f89fd3da4bc8b38963bed4e5cc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a31364455dc442f8df299a8ad758a4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:01:02.702632 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-d266ff0b-a767-46e4-9efe-059e9b0d0bdb tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/da72692d-5ac7-4e8e-9b7d-11d421a1f071" status: 200 len: 1318 microversion: 2.1 time: 0.247148 Nov 23 13:01:02.703460 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 144/283] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:01:02 2021] GET /compute/v2.1/servers/da72692d-5ac7-4e8e-9b7d-11d421a1f071 => generated 1318 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:01:02.744900 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-c19ca026-2787-4f93-986c-603f86589ad7 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:02.745664 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-c19ca026-2787-4f93-986c-603f86589ad7 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] [instance: 979f72d5-fadc-4b59-ace6-6b8b350a63d9] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:02.753843 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c19ca026-2787-4f93-986c-603f86589ad7 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:02.754462 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c19ca026-2787-4f93-986c-603f86589ad7 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:02.755331 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c19ca026-2787-4f93-986c-603f86589ad7 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:02.756023 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c19ca026-2787-4f93-986c-603f86589ad7 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:02.982222 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-c19ca026-2787-4f93-986c-603f86589ad7 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb98e201f2f41b18735465a450909ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d331da092466b8d717a7e039a5b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:01:02.990844 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-c19ca026-2787-4f93-986c-603f86589ad7 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] 10.222.0.60 "GET /compute/v2.1/servers/979f72d5-fadc-4b59-ace6-6b8b350a63d9" status: 200 len: 1315 microversion: 2.1 time: 0.249953 Nov 23 13:01:02.991417 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 145/284] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:01:02 2021] GET /compute/v2.1/servers/979f72d5-fadc-4b59-ace6-6b8b350a63d9 => generated 1315 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 13:01:03.057333 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-591ddad9-e05a-4804-8a0b-57ef19d05b92 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:03.057936 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-591ddad9-e05a-4804-8a0b-57ef19d05b92 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: bc54276f-764d-49ee-b58e-552822acc211] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:03.066544 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-591ddad9-e05a-4804-8a0b-57ef19d05b92 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:03.066966 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-591ddad9-e05a-4804-8a0b-57ef19d05b92 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:03.067743 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-591ddad9-e05a-4804-8a0b-57ef19d05b92 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:03.068162 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-591ddad9-e05a-4804-8a0b-57ef19d05b92 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:03.079886 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-7b416346-cc84-430f-9688-8ca1549a4f98 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action" status: 200 len: 28096 microversion: 2.20 time: 0.814711 Nov 23 13:01:03.080581 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 140/285] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:01:02 2021] POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action => generated 28096 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:01:03.152179 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-a9a1ad22-3844-47ed-8e39-0a292a3a8cd7 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:03.153368 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-a9a1ad22-3844-47ed-8e39-0a292a3a8cd7 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] [instance: 851d1bac-67b3-4477-8109-c37791c90f1b] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:03.161681 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a9a1ad22-3844-47ed-8e39-0a292a3a8cd7 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:03.162091 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a9a1ad22-3844-47ed-8e39-0a292a3a8cd7 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:03.162873 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a9a1ad22-3844-47ed-8e39-0a292a3a8cd7 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:03.163305 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a9a1ad22-3844-47ed-8e39-0a292a3a8cd7 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:03.233757 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a9a1ad22-3844-47ed-8e39-0a292a3a8cd7 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:03.234469 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a9a1ad22-3844-47ed-8e39-0a292a3a8cd7 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:03.235205 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.objects.instance [None req-a9a1ad22-3844-47ed-8e39-0a292a3a8cd7 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lazy-loading 'fault' on Instance uuid 851d1bac-67b3-4477-8109-c37791c90f1b {{(pid=100974) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 23 13:01:03.286538 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-591ddad9-e05a-4804-8a0b-57ef19d05b92 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:01:03.296967 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-591ddad9-e05a-4804-8a0b-57ef19d05b92 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211" status: 200 len: 1519 microversion: 2.1 time: 0.243386 Nov 23 13:01:03.297743 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 146/286] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:01:03 2021] GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211 => generated 1519 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 13:01:03.320130 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-a9a1ad22-3844-47ed-8e39-0a292a3a8cd7 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7adc68cc5d47fea458da9232672087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d153c67e84449bb8eb36b752ec41896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:01:03.330264 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-a9a1ad22-3844-47ed-8e39-0a292a3a8cd7 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] 10.222.0.60 "GET /compute/v2.1/servers/851d1bac-67b3-4477-8109-c37791c90f1b" status: 200 len: 1350 microversion: 2.1 time: 0.182249 Nov 23 13:01:03.330833 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 141/287] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:01:03 2021] GET /compute/v2.1/servers/851d1bac-67b3-4477-8109-c37791c90f1b => generated 1350 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 13:01:03.720587 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-0ac2bbba-f818-47f3-af1f-b22be476dde6 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:03.721230 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-0ac2bbba-f818-47f3-af1f-b22be476dde6 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: da72692d-5ac7-4e8e-9b7d-11d421a1f071] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:03.729247 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0ac2bbba-f818-47f3-af1f-b22be476dde6 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:03.729765 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0ac2bbba-f818-47f3-af1f-b22be476dde6 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:03.730556 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0ac2bbba-f818-47f3-af1f-b22be476dde6 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:03.730970 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0ac2bbba-f818-47f3-af1f-b22be476dde6 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:03.945256 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-0ac2bbba-f818-47f3-af1f-b22be476dde6 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c023f89fd3da4bc8b38963bed4e5cc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a31364455dc442f8df299a8ad758a4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:01:03.953458 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-0ac2bbba-f818-47f3-af1f-b22be476dde6 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/da72692d-5ac7-4e8e-9b7d-11d421a1f071" status: 200 len: 1318 microversion: 2.1 time: 0.236745 Nov 23 13:01:03.954047 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 147/288] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:01:03 2021] GET /compute/v2.1/servers/da72692d-5ac7-4e8e-9b7d-11d421a1f071 => generated 1318 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:01:04.008868 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-aa6c120d-448a-45d3-b034-a2934f9a1921 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:04.009475 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-aa6c120d-448a-45d3-b034-a2934f9a1921 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] [instance: 979f72d5-fadc-4b59-ace6-6b8b350a63d9] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:04.017071 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-aa6c120d-448a-45d3-b034-a2934f9a1921 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:04.017510 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-aa6c120d-448a-45d3-b034-a2934f9a1921 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:04.018292 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-aa6c120d-448a-45d3-b034-a2934f9a1921 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:04.018691 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-aa6c120d-448a-45d3-b034-a2934f9a1921 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:04.091407 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-6535dcee-9b02-44c0-a0d7-e4953cebceae tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:01:04.092457 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-6535dcee-9b02-44c0-a0d7-e4953cebceae tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:04.100544 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6535dcee-9b02-44c0-a0d7-e4953cebceae tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:04.100997 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6535dcee-9b02-44c0-a0d7-e4953cebceae tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:04.101786 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6535dcee-9b02-44c0-a0d7-e4953cebceae tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:04.102217 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6535dcee-9b02-44c0-a0d7-e4953cebceae tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:04.228054 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-aa6c120d-448a-45d3-b034-a2934f9a1921 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb98e201f2f41b18735465a450909ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d331da092466b8d717a7e039a5b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:01:04.237733 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-aa6c120d-448a-45d3-b034-a2934f9a1921 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] 10.222.0.60 "GET /compute/v2.1/servers/979f72d5-fadc-4b59-ace6-6b8b350a63d9" status: 200 len: 1315 microversion: 2.1 time: 0.232928 Nov 23 13:01:04.238307 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 142/289] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:01:04 2021] GET /compute/v2.1/servers/979f72d5-fadc-4b59-ace6-6b8b350a63d9 => generated 1315 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:01:04.314735 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-3f5e118d-b562-4bdd-a79a-0c03a53cd4cb tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:04.315336 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-3f5e118d-b562-4bdd-a79a-0c03a53cd4cb tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: bc54276f-764d-49ee-b58e-552822acc211] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:04.323500 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3f5e118d-b562-4bdd-a79a-0c03a53cd4cb tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:04.324637 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3f5e118d-b562-4bdd-a79a-0c03a53cd4cb tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:04.324868 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3f5e118d-b562-4bdd-a79a-0c03a53cd4cb tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:04.325298 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3f5e118d-b562-4bdd-a79a-0c03a53cd4cb tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:04.551226 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-3f5e118d-b562-4bdd-a79a-0c03a53cd4cb tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:01:04.560397 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-3f5e118d-b562-4bdd-a79a-0c03a53cd4cb tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211" status: 200 len: 1519 microversion: 2.1 time: 0.249454 Nov 23 13:01:04.560981 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 143/290] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:01:04 2021] GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211 => generated 1519 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:01:04.565314 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-6453fc79-d884-4b43-be3f-86569ddb1bb5 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:04.565947 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-6453fc79-d884-4b43-be3f-86569ddb1bb5 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] [instance: 851d1bac-67b3-4477-8109-c37791c90f1b] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:04.573362 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-6453fc79-d884-4b43-be3f-86569ddb1bb5 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:04.573767 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-6453fc79-d884-4b43-be3f-86569ddb1bb5 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:04.574521 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-6453fc79-d884-4b43-be3f-86569ddb1bb5 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:04.574996 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-6453fc79-d884-4b43-be3f-86569ddb1bb5 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:04.624081 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.wsgi [None req-6453fc79-d884-4b43-be3f-86569ddb1bb5 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] HTTP exception thrown: Instance 851d1bac-67b3-4477-8109-c37791c90f1b could not be found. Nov 23 13:01:04.624714 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-6453fc79-d884-4b43-be3f-86569ddb1bb5 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Returning 404 to user: Instance 851d1bac-67b3-4477-8109-c37791c90f1b could not be found. {{(pid=100974) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Nov 23 13:01:04.625549 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-6453fc79-d884-4b43-be3f-86569ddb1bb5 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] 10.222.0.60 "GET /compute/v2.1/servers/851d1bac-67b3-4477-8109-c37791c90f1b" status: 404 len: 111 microversion: 2.1 time: 0.063635 Nov 23 13:01:04.626072 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 144/291] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:01:04 2021] GET /compute/v2.1/servers/851d1bac-67b3-4477-8109-c37791c90f1b => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 13:01:04.828814 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-fa7becfa-2fca-48ea-8beb-a973a28916de tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:04.829912 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-fa7becfa-2fca-48ea-8beb-a973a28916de tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] [instance: 851d1bac-67b3-4477-8109-c37791c90f1b] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:04.838367 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-fa7becfa-2fca-48ea-8beb-a973a28916de tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:04.838819 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-fa7becfa-2fca-48ea-8beb-a973a28916de tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:04.840197 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-fa7becfa-2fca-48ea-8beb-a973a28916de tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:04.840681 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-fa7becfa-2fca-48ea-8beb-a973a28916de tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:04.891406 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.wsgi [None req-fa7becfa-2fca-48ea-8beb-a973a28916de tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] HTTP exception thrown: Instance 851d1bac-67b3-4477-8109-c37791c90f1b could not be found. Nov 23 13:01:04.892005 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-fa7becfa-2fca-48ea-8beb-a973a28916de tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Returning 404 to user: Instance 851d1bac-67b3-4477-8109-c37791c90f1b could not be found. {{(pid=100974) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Nov 23 13:01:04.892872 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-fa7becfa-2fca-48ea-8beb-a973a28916de tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] 10.222.0.60 "GET /compute/v2.1/servers/851d1bac-67b3-4477-8109-c37791c90f1b/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.068282 Nov 23 13:01:04.893414 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 145/292] 10.222.0.60 () {58 vars in 1301 bytes} [Tue Nov 23 13:01:04 2021] GET /compute/v2.1/servers/851d1bac-67b3-4477-8109-c37791c90f1b/os-volume_attachments => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 23 13:01:04.970158 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-9c704ab1-cd47-4182-be3e-4a824852bd55 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:04.970781 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-9c704ab1-cd47-4182-be3e-4a824852bd55 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: da72692d-5ac7-4e8e-9b7d-11d421a1f071] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:04.982439 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-9c704ab1-cd47-4182-be3e-4a824852bd55 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:04.983054 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-9c704ab1-cd47-4182-be3e-4a824852bd55 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:04.983849 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-9c704ab1-cd47-4182-be3e-4a824852bd55 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:04.984448 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-9c704ab1-cd47-4182-be3e-4a824852bd55 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:05.196880 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-9c704ab1-cd47-4182-be3e-4a824852bd55 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c023f89fd3da4bc8b38963bed4e5cc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a31364455dc442f8df299a8ad758a4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:01:05.207209 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-9c704ab1-cd47-4182-be3e-4a824852bd55 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/da72692d-5ac7-4e8e-9b7d-11d421a1f071" status: 200 len: 1318 microversion: 2.1 time: 0.240756 Nov 23 13:01:05.207793 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 146/293] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:01:04 2021] GET /compute/v2.1/servers/da72692d-5ac7-4e8e-9b7d-11d421a1f071 => generated 1318 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 13:01:05.255511 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-994cc742-2a64-4784-bdc9-ebbeab141dde tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:05.256109 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-994cc742-2a64-4784-bdc9-ebbeab141dde tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] [instance: 979f72d5-fadc-4b59-ace6-6b8b350a63d9] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:05.265647 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-994cc742-2a64-4784-bdc9-ebbeab141dde tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:05.266377 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-994cc742-2a64-4784-bdc9-ebbeab141dde tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:05.267561 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-994cc742-2a64-4784-bdc9-ebbeab141dde tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:05.268218 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-994cc742-2a64-4784-bdc9-ebbeab141dde tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:05.486655 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-994cc742-2a64-4784-bdc9-ebbeab141dde tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb98e201f2f41b18735465a450909ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d331da092466b8d717a7e039a5b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:01:05.501348 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-994cc742-2a64-4784-bdc9-ebbeab141dde tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] 10.222.0.60 "GET /compute/v2.1/servers/979f72d5-fadc-4b59-ace6-6b8b350a63d9" status: 200 len: 1315 microversion: 2.1 time: 0.249648 Nov 23 13:01:05.502264 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 147/294] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:01:05 2021] GET /compute/v2.1/servers/979f72d5-fadc-4b59-ace6-6b8b350a63d9 => generated 1315 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:01:05.579138 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-6980f048-fa43-4e66-8121-656bc9811e87 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:05.579788 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-6980f048-fa43-4e66-8121-656bc9811e87 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: bc54276f-764d-49ee-b58e-552822acc211] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:05.588304 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-6980f048-fa43-4e66-8121-656bc9811e87 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:05.588786 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-6980f048-fa43-4e66-8121-656bc9811e87 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:05.589649 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-6980f048-fa43-4e66-8121-656bc9811e87 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:05.590391 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-6980f048-fa43-4e66-8121-656bc9811e87 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:05.796952 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-6980f048-fa43-4e66-8121-656bc9811e87 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:01:05.805382 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-6980f048-fa43-4e66-8121-656bc9811e87 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211" status: 200 len: 1519 microversion: 2.1 time: 0.230571 Nov 23 13:01:05.805984 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 148/295] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:01:05 2021] GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211 => generated 1519 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:01:06.232810 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-ead6784e-489b-4563-9729-5f5b360bae36 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:06.234217 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-ead6784e-489b-4563-9729-5f5b360bae36 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: da72692d-5ac7-4e8e-9b7d-11d421a1f071] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:06.242078 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ead6784e-489b-4563-9729-5f5b360bae36 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:06.242573 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ead6784e-489b-4563-9729-5f5b360bae36 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:06.243862 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ead6784e-489b-4563-9729-5f5b360bae36 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:06.244488 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ead6784e-489b-4563-9729-5f5b360bae36 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:06.455950 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-ead6784e-489b-4563-9729-5f5b360bae36 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c023f89fd3da4bc8b38963bed4e5cc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a31364455dc442f8df299a8ad758a4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:01:06.464945 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-ead6784e-489b-4563-9729-5f5b360bae36 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/da72692d-5ac7-4e8e-9b7d-11d421a1f071" status: 200 len: 1318 microversion: 2.1 time: 0.237806 Nov 23 13:01:06.465599 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 149/296] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:01:06 2021] GET /compute/v2.1/servers/da72692d-5ac7-4e8e-9b7d-11d421a1f071 => generated 1318 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:01:06.523642 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-926a89cd-e4a9-43c7-a6be-648c2e209f99 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:06.524460 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-926a89cd-e4a9-43c7-a6be-648c2e209f99 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] [instance: 979f72d5-fadc-4b59-ace6-6b8b350a63d9] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:06.532542 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-926a89cd-e4a9-43c7-a6be-648c2e209f99 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:06.532998 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-926a89cd-e4a9-43c7-a6be-648c2e209f99 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:06.533762 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-926a89cd-e4a9-43c7-a6be-648c2e209f99 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:06.534200 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-926a89cd-e4a9-43c7-a6be-648c2e209f99 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:06.838205 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-926a89cd-e4a9-43c7-a6be-648c2e209f99 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb98e201f2f41b18735465a450909ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d331da092466b8d717a7e039a5b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:01:06.848043 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-926a89cd-e4a9-43c7-a6be-648c2e209f99 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] 10.222.0.60 "GET /compute/v2.1/servers/979f72d5-fadc-4b59-ace6-6b8b350a63d9" status: 200 len: 1315 microversion: 2.1 time: 0.328304 Nov 23 13:01:06.857969 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 150/297] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:01:06 2021] GET /compute/v2.1/servers/979f72d5-fadc-4b59-ace6-6b8b350a63d9 => generated 1315 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:01:06.857969 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-e40d4304-4b3f-4c7c-a882-26c3259f5b39 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:06.857969 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-e40d4304-4b3f-4c7c-a882-26c3259f5b39 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: bc54276f-764d-49ee-b58e-552822acc211] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:06.867004 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e40d4304-4b3f-4c7c-a882-26c3259f5b39 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:06.867498 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e40d4304-4b3f-4c7c-a882-26c3259f5b39 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:06.868284 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e40d4304-4b3f-4c7c-a882-26c3259f5b39 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:06.868899 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e40d4304-4b3f-4c7c-a882-26c3259f5b39 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:07.075993 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-e40d4304-4b3f-4c7c-a882-26c3259f5b39 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:01:07.085127 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-e40d4304-4b3f-4c7c-a882-26c3259f5b39 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211" status: 200 len: 1519 microversion: 2.1 time: 0.234748 Nov 23 13:01:07.085709 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 151/298] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:01:06 2021] GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211 => generated 1519 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:01:07.091803 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [req-2e591492-a2e9-49a8-95d6-0f9c49ff1a6c req-fe1c38f0-ed08-4efe-ac63-cd34d0c8d1fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da72692d-5ac7-4e8e-9b7d-11d421a1f071", "name": "network-vif-plugged", "status": "completed", "tag": "43d88996-bc75-42de-a03e-4caf7be9d7d1"}]} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:01:07.093742 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 13:01:07.093742 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: warnings.warn(msg) Nov 23 13:01:07.102769 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [req-2e591492-a2e9-49a8-95d6-0f9c49ff1a6c req-fe1c38f0-ed08-4efe-ac63-cd34d0c8d1fb service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:07.103283 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [req-2e591492-a2e9-49a8-95d6-0f9c49ff1a6c req-fe1c38f0-ed08-4efe-ac63-cd34d0c8d1fb service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:07.119425 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.compute.server_external_events [req-2e591492-a2e9-49a8-95d6-0f9c49ff1a6c req-fe1c38f0-ed08-4efe-ac63-cd34d0c8d1fb service nova] Creating event network-vif-plugged:43d88996-bc75-42de-a03e-4caf7be9d7d1 for instance da72692d-5ac7-4e8e-9b7d-11d421a1f071 on hv-cinder-81888 Nov 23 13:01:07.124581 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [req-2e591492-a2e9-49a8-95d6-0f9c49ff1a6c req-fe1c38f0-ed08-4efe-ac63-cd34d0c8d1fb service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036477 Nov 23 13:01:07.125395 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 152/299] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Nov 23 13:01:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 13:01:07.483156 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-746dfb25-0877-4b1b-9c33-cc271af6c319 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:07.483851 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-746dfb25-0877-4b1b-9c33-cc271af6c319 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: da72692d-5ac7-4e8e-9b7d-11d421a1f071] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:07.491958 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-746dfb25-0877-4b1b-9c33-cc271af6c319 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:07.492442 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-746dfb25-0877-4b1b-9c33-cc271af6c319 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:07.493205 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-746dfb25-0877-4b1b-9c33-cc271af6c319 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:07.493627 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-746dfb25-0877-4b1b-9c33-cc271af6c319 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:07.719657 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-746dfb25-0877-4b1b-9c33-cc271af6c319 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c023f89fd3da4bc8b38963bed4e5cc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a31364455dc442f8df299a8ad758a4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:01:07.728266 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-746dfb25-0877-4b1b-9c33-cc271af6c319 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/da72692d-5ac7-4e8e-9b7d-11d421a1f071" status: 200 len: 1318 microversion: 2.1 time: 0.249511 Nov 23 13:01:07.728859 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 153/300] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:01:07 2021] GET /compute/v2.1/servers/da72692d-5ac7-4e8e-9b7d-11d421a1f071 => generated 1318 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:01:07.865995 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-50f9d38e-ff35-41e4-9825-4a95a584021e tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:07.866801 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-50f9d38e-ff35-41e4-9825-4a95a584021e tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] [instance: 979f72d5-fadc-4b59-ace6-6b8b350a63d9] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:07.874516 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-50f9d38e-ff35-41e4-9825-4a95a584021e tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:07.875106 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-50f9d38e-ff35-41e4-9825-4a95a584021e tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:07.876271 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-50f9d38e-ff35-41e4-9825-4a95a584021e tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:07.876816 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-50f9d38e-ff35-41e4-9825-4a95a584021e tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:08.083262 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-50f9d38e-ff35-41e4-9825-4a95a584021e tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb98e201f2f41b18735465a450909ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d331da092466b8d717a7e039a5b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:01:08.092518 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-50f9d38e-ff35-41e4-9825-4a95a584021e tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] 10.222.0.60 "GET /compute/v2.1/servers/979f72d5-fadc-4b59-ace6-6b8b350a63d9" status: 200 len: 1315 microversion: 2.1 time: 0.230335 Nov 23 13:01:08.093045 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 154/301] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:01:07 2021] GET /compute/v2.1/servers/979f72d5-fadc-4b59-ace6-6b8b350a63d9 => generated 1315 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:01:08.103657 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-92bb56ec-b483-4e83-b763-ade5b06e9307 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:08.104289 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-92bb56ec-b483-4e83-b763-ade5b06e9307 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: bc54276f-764d-49ee-b58e-552822acc211] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:08.111877 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-92bb56ec-b483-4e83-b763-ade5b06e9307 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:08.112358 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-92bb56ec-b483-4e83-b763-ade5b06e9307 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:08.113122 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-92bb56ec-b483-4e83-b763-ade5b06e9307 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:08.113553 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-92bb56ec-b483-4e83-b763-ade5b06e9307 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:08.316460 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-92bb56ec-b483-4e83-b763-ade5b06e9307 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:01:08.328123 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-92bb56ec-b483-4e83-b763-ade5b06e9307 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211" status: 200 len: 1519 microversion: 2.1 time: 0.228082 Nov 23 13:01:08.328713 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 155/302] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:01:08 2021] GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211 => generated 1519 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 13:01:08.460672 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-6535dcee-9b02-44c0-a0d7-e4953cebceae tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action" status: 200 len: 28096 microversion: 2.20 time: 4.373049 Nov 23 13:01:08.462076 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 148/303] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:01:04 2021] POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action => generated 28096 bytes in 4375 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:01:08.746623 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-0af46c4a-6271-43ed-9d6b-3a7dbf04b667 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:08.747390 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-0af46c4a-6271-43ed-9d6b-3a7dbf04b667 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: da72692d-5ac7-4e8e-9b7d-11d421a1f071] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:08.755719 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0af46c4a-6271-43ed-9d6b-3a7dbf04b667 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:08.756159 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0af46c4a-6271-43ed-9d6b-3a7dbf04b667 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:08.756963 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0af46c4a-6271-43ed-9d6b-3a7dbf04b667 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:08.757455 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0af46c4a-6271-43ed-9d6b-3a7dbf04b667 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:08.968808 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-0af46c4a-6271-43ed-9d6b-3a7dbf04b667 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c023f89fd3da4bc8b38963bed4e5cc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a31364455dc442f8df299a8ad758a4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:01:08.977676 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-0af46c4a-6271-43ed-9d6b-3a7dbf04b667 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/da72692d-5ac7-4e8e-9b7d-11d421a1f071" status: 200 len: 1318 microversion: 2.1 time: 0.235113 Nov 23 13:01:08.978281 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 156/304] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:01:08 2021] GET /compute/v2.1/servers/da72692d-5ac7-4e8e-9b7d-11d421a1f071 => generated 1318 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:01:09.109699 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-bf87b7f8-bfc6-4cef-a8aa-456dea2a450c tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:09.110398 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-bf87b7f8-bfc6-4cef-a8aa-456dea2a450c tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] [instance: 979f72d5-fadc-4b59-ace6-6b8b350a63d9] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:09.118994 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-bf87b7f8-bfc6-4cef-a8aa-456dea2a450c tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:09.119480 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-bf87b7f8-bfc6-4cef-a8aa-456dea2a450c tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:09.120285 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-bf87b7f8-bfc6-4cef-a8aa-456dea2a450c tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:09.120726 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-bf87b7f8-bfc6-4cef-a8aa-456dea2a450c tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:09.344967 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-bf87b7f8-bfc6-4cef-a8aa-456dea2a450c tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb98e201f2f41b18735465a450909ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d331da092466b8d717a7e039a5b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:01:09.346143 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-fcaa92b0-5f35-42a4-ba4c-dc9ee58f5e6e tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:09.346871 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-fcaa92b0-5f35-42a4-ba4c-dc9ee58f5e6e tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: bc54276f-764d-49ee-b58e-552822acc211] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:09.353762 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-bf87b7f8-bfc6-4cef-a8aa-456dea2a450c tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] 10.222.0.60 "GET /compute/v2.1/servers/979f72d5-fadc-4b59-ace6-6b8b350a63d9" status: 200 len: 1315 microversion: 2.1 time: 0.248353 Nov 23 13:01:09.354334 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 149/305] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:01:09 2021] GET /compute/v2.1/servers/979f72d5-fadc-4b59-ace6-6b8b350a63d9 => generated 1315 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:01:09.354624 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-fcaa92b0-5f35-42a4-ba4c-dc9ee58f5e6e tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:09.355084 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-fcaa92b0-5f35-42a4-ba4c-dc9ee58f5e6e tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:09.355841 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-fcaa92b0-5f35-42a4-ba4c-dc9ee58f5e6e tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:09.356279 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-fcaa92b0-5f35-42a4-ba4c-dc9ee58f5e6e tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:09.474073 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-abe86de2-73fb-472e-ae04-a2bab33e38c6 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:01:09.475061 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-abe86de2-73fb-472e-ae04-a2bab33e38c6 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:09.483388 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-abe86de2-73fb-472e-ae04-a2bab33e38c6 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:09.484146 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-abe86de2-73fb-472e-ae04-a2bab33e38c6 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:09.485558 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-abe86de2-73fb-472e-ae04-a2bab33e38c6 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:09.487501 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-abe86de2-73fb-472e-ae04-a2bab33e38c6 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:09.586885 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-fcaa92b0-5f35-42a4-ba4c-dc9ee58f5e6e tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:01:09.595658 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-fcaa92b0-5f35-42a4-ba4c-dc9ee58f5e6e tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211" status: 200 len: 1519 microversion: 2.1 time: 0.253438 Nov 23 13:01:09.596309 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 157/306] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:01:09 2021] GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211 => generated 1519 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 13:01:09.995808 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-7db357b7-c244-47ef-9f5c-92730f8e9c32 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:09.996675 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-7db357b7-c244-47ef-9f5c-92730f8e9c32 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: da72692d-5ac7-4e8e-9b7d-11d421a1f071] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:10.006882 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7db357b7-c244-47ef-9f5c-92730f8e9c32 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:10.007507 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7db357b7-c244-47ef-9f5c-92730f8e9c32 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:10.008256 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7db357b7-c244-47ef-9f5c-92730f8e9c32 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:10.008768 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7db357b7-c244-47ef-9f5c-92730f8e9c32 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:10.089946 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-abe86de2-73fb-472e-ae04-a2bab33e38c6 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action" status: 200 len: 28213 microversion: 2.20 time: 0.619356 Nov 23 13:01:10.091033 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 150/307] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:01:09 2021] POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action => generated 28213 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:01:10.376136 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-f7420179-daa5-4d46-99f5-a9efa79ee77d tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:10.377089 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-f7420179-daa5-4d46-99f5-a9efa79ee77d tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] [instance: 979f72d5-fadc-4b59-ace6-6b8b350a63d9] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:10.386645 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f7420179-daa5-4d46-99f5-a9efa79ee77d tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:10.387396 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f7420179-daa5-4d46-99f5-a9efa79ee77d tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:10.389683 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f7420179-daa5-4d46-99f5-a9efa79ee77d tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:10.390774 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f7420179-daa5-4d46-99f5-a9efa79ee77d tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:10.457992 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-7db357b7-c244-47ef-9f5c-92730f8e9c32 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c023f89fd3da4bc8b38963bed4e5cc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a31364455dc442f8df299a8ad758a4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:01:10.469257 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-7db357b7-c244-47ef-9f5c-92730f8e9c32 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/da72692d-5ac7-4e8e-9b7d-11d421a1f071" status: 200 len: 1318 microversion: 2.1 time: 0.478573 Nov 23 13:01:10.470223 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 158/308] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:01:09 2021] GET /compute/v2.1/servers/da72692d-5ac7-4e8e-9b7d-11d421a1f071 => generated 1318 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:01:10.603349 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-f7420179-daa5-4d46-99f5-a9efa79ee77d tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb98e201f2f41b18735465a450909ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d331da092466b8d717a7e039a5b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:01:10.616929 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-0b910855-0a99-4d6c-9e5d-efe99f6e62e7 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:10.617682 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-0b910855-0a99-4d6c-9e5d-efe99f6e62e7 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: bc54276f-764d-49ee-b58e-552822acc211] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:10.619609 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-f7420179-daa5-4d46-99f5-a9efa79ee77d tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] 10.222.0.60 "GET /compute/v2.1/servers/979f72d5-fadc-4b59-ace6-6b8b350a63d9" status: 200 len: 1315 microversion: 2.1 time: 0.250791 Nov 23 13:01:10.620871 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 151/309] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:01:10 2021] GET /compute/v2.1/servers/979f72d5-fadc-4b59-ace6-6b8b350a63d9 => generated 1315 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:01:10.626766 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0b910855-0a99-4d6c-9e5d-efe99f6e62e7 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:10.628135 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0b910855-0a99-4d6c-9e5d-efe99f6e62e7 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:10.630099 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0b910855-0a99-4d6c-9e5d-efe99f6e62e7 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:10.634353 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0b910855-0a99-4d6c-9e5d-efe99f6e62e7 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:10.676527 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-244b8f18-9b02-4e08-86a5-a923db766cb1 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:10.677289 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-244b8f18-9b02-4e08-86a5-a923db766cb1 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] [instance: 851d1bac-67b3-4477-8109-c37791c90f1b] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:10.687298 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-244b8f18-9b02-4e08-86a5-a923db766cb1 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:10.688225 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-244b8f18-9b02-4e08-86a5-a923db766cb1 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:10.689266 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-244b8f18-9b02-4e08-86a5-a923db766cb1 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:10.689889 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-244b8f18-9b02-4e08-86a5-a923db766cb1 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:10.746950 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.wsgi [None req-244b8f18-9b02-4e08-86a5-a923db766cb1 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] HTTP exception thrown: Instance 851d1bac-67b3-4477-8109-c37791c90f1b could not be found. Nov 23 13:01:10.747783 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-244b8f18-9b02-4e08-86a5-a923db766cb1 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Returning 404 to user: Instance 851d1bac-67b3-4477-8109-c37791c90f1b could not be found. {{(pid=100973) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Nov 23 13:01:10.748593 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-244b8f18-9b02-4e08-86a5-a923db766cb1 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] 10.222.0.60 "DELETE /compute/v2.1/servers/851d1bac-67b3-4477-8109-c37791c90f1b" status: 404 len: 111 microversion: 2.1 time: 0.075747 Nov 23 13:01:10.749218 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 152/310] 10.222.0.60 () {58 vars in 1238 bytes} [Tue Nov 23 13:01:10 2021] DELETE /compute/v2.1/servers/851d1bac-67b3-4477-8109-c37791c90f1b => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 13:01:10.758956 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-9bc8fead-5cc0-4121-9417-f6ee96d0e8f2 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:10.759578 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-9bc8fead-5cc0-4121-9417-f6ee96d0e8f2 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] [instance: 851d1bac-67b3-4477-8109-c37791c90f1b] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:10.767235 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-9bc8fead-5cc0-4121-9417-f6ee96d0e8f2 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:10.767687 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-9bc8fead-5cc0-4121-9417-f6ee96d0e8f2 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:10.768650 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-9bc8fead-5cc0-4121-9417-f6ee96d0e8f2 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:10.769081 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-9bc8fead-5cc0-4121-9417-f6ee96d0e8f2 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:10.826994 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.wsgi [None req-9bc8fead-5cc0-4121-9417-f6ee96d0e8f2 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] HTTP exception thrown: Instance 851d1bac-67b3-4477-8109-c37791c90f1b could not be found. Nov 23 13:01:10.827709 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-9bc8fead-5cc0-4121-9417-f6ee96d0e8f2 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] Returning 404 to user: Instance 851d1bac-67b3-4477-8109-c37791c90f1b could not be found. {{(pid=100973) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Nov 23 13:01:10.828787 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-9bc8fead-5cc0-4121-9417-f6ee96d0e8f2 tempest-DeleteServersTestJSON-519214497 tempest-DeleteServersTestJSON-519214497-project] 10.222.0.60 "GET /compute/v2.1/servers/851d1bac-67b3-4477-8109-c37791c90f1b" status: 404 len: 111 microversion: 2.1 time: 0.074709 Nov 23 13:01:10.833314 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 153/311] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:01:10 2021] GET /compute/v2.1/servers/851d1bac-67b3-4477-8109-c37791c90f1b => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 13:01:10.925671 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-0b910855-0a99-4d6c-9e5d-efe99f6e62e7 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:01:10.934872 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-0b910855-0a99-4d6c-9e5d-efe99f6e62e7 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211" status: 200 len: 1499 microversion: 2.1 time: 0.321634 Nov 23 13:01:10.942185 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 159/312] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:01:10 2021] GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211 => generated 1499 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 13:01:10.953442 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-eb81cab8-6852-415e-8303-a2999aaa61c3 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:10.955365 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-eb81cab8-6852-415e-8303-a2999aaa61c3 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: 53633a05-ad06-454a-b540-5fc01821ae45] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:10.963686 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-eb81cab8-6852-415e-8303-a2999aaa61c3 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:10.964672 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-eb81cab8-6852-415e-8303-a2999aaa61c3 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:10.965605 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-eb81cab8-6852-415e-8303-a2999aaa61c3 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:10.966101 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-eb81cab8-6852-415e-8303-a2999aaa61c3 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:11.103670 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-9e873d2e-3dd8-470e-a792-75b840b8b604 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:01:11.105357 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-9e873d2e-3dd8-470e-a792-75b840b8b604 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:11.113351 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-9e873d2e-3dd8-470e-a792-75b840b8b604 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:11.114110 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-9e873d2e-3dd8-470e-a792-75b840b8b604 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:11.115058 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-9e873d2e-3dd8-470e-a792-75b840b8b604 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:11.115636 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-9e873d2e-3dd8-470e-a792-75b840b8b604 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:11.299359 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-eb81cab8-6852-415e-8303-a2999aaa61c3 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:01:11.310050 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-eb81cab8-6852-415e-8303-a2999aaa61c3 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45" status: 200 len: 1512 microversion: 2.1 time: 0.360594 Nov 23 13:01:11.311297 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 154/313] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:01:10 2021] GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45 => generated 1512 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:01:11.345567 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-9e873d2e-3dd8-470e-a792-75b840b8b604 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action" status: 200 len: 28213 microversion: 2.20 time: 0.246109 Nov 23 13:01:11.350143 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 160/314] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:01:11 2021] POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action => generated 28213 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 13:01:11.488572 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-6f733342-dba4-4901-89f8-813f41a8d5e3 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:11.489454 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-6f733342-dba4-4901-89f8-813f41a8d5e3 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: da72692d-5ac7-4e8e-9b7d-11d421a1f071] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:11.501244 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6f733342-dba4-4901-89f8-813f41a8d5e3 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:11.501896 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6f733342-dba4-4901-89f8-813f41a8d5e3 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:11.503445 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6f733342-dba4-4901-89f8-813f41a8d5e3 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:11.504222 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6f733342-dba4-4901-89f8-813f41a8d5e3 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:11.638851 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-2e2705bb-0829-42ee-886a-69cebfff1d45 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:11.639547 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-2e2705bb-0829-42ee-886a-69cebfff1d45 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] [instance: 979f72d5-fadc-4b59-ace6-6b8b350a63d9] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:11.654976 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2e2705bb-0829-42ee-886a-69cebfff1d45 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:11.668308 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2e2705bb-0829-42ee-886a-69cebfff1d45 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:11.673572 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2e2705bb-0829-42ee-886a-69cebfff1d45 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:11.675617 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2e2705bb-0829-42ee-886a-69cebfff1d45 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:11.989376 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-6f733342-dba4-4901-89f8-813f41a8d5e3 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c023f89fd3da4bc8b38963bed4e5cc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a31364455dc442f8df299a8ad758a4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:01:12.000846 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-6f733342-dba4-4901-89f8-813f41a8d5e3 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/da72692d-5ac7-4e8e-9b7d-11d421a1f071" status: 200 len: 1508 microversion: 2.1 time: 0.516967 Nov 23 13:01:12.022114 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 155/315] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:01:11 2021] GET /compute/v2.1/servers/da72692d-5ac7-4e8e-9b7d-11d421a1f071 => generated 1508 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:01:12.034578 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-263006e2-a9a7-48bd-90ab-2affab3511c4 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cc2dcb04-a6ef-434d-b801-0000f81e8f29"}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:01:12.047142 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-263006e2-a9a7-48bd-90ab-2affab3511c4 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: da72692d-5ac7-4e8e-9b7d-11d421a1f071] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:12.061669 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-263006e2-a9a7-48bd-90ab-2affab3511c4 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:12.062179 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-263006e2-a9a7-48bd-90ab-2affab3511c4 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:12.063146 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-263006e2-a9a7-48bd-90ab-2affab3511c4 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:12.067344 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-263006e2-a9a7-48bd-90ab-2affab3511c4 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:12.312605 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.wsgi [None req-263006e2-a9a7-48bd-90ab-2affab3511c4 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] HTTP exception thrown: Invalid volume: volume cc2dcb04-a6ef-434d-b801-0000f81e8f29 is already attached to instances: a3b02d0f-db9d-4996-a245-7237e989670d Nov 23 13:01:12.313223 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-263006e2-a9a7-48bd-90ab-2affab3511c4 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Returning 400 to user: Invalid volume: volume cc2dcb04-a6ef-434d-b801-0000f81e8f29 is already attached to instances: a3b02d0f-db9d-4996-a245-7237e989670d {{(pid=100973) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Nov 23 13:01:12.315228 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-263006e2-a9a7-48bd-90ab-2affab3511c4 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "POST /compute/v2.1/servers/da72692d-5ac7-4e8e-9b7d-11d421a1f071/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.283938 Nov 23 13:01:12.317913 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 156/316] 10.222.0.60 () {60 vars in 1322 bytes} [Tue Nov 23 13:01:12 2021] POST /compute/v2.1/servers/da72692d-5ac7-4e8e-9b7d-11d421a1f071/os-volume_attachments => generated 174 bytes in 290 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 23 13:01:12.346197 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-2e2705bb-0829-42ee-886a-69cebfff1d45 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb98e201f2f41b18735465a450909ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d331da092466b8d717a7e039a5b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:01:12.356782 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-2e2705bb-0829-42ee-886a-69cebfff1d45 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] 10.222.0.60 "GET /compute/v2.1/servers/979f72d5-fadc-4b59-ace6-6b8b350a63d9" status: 200 len: 1315 microversion: 2.1 time: 0.723616 Nov 23 13:01:12.357372 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 161/317] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:01:11 2021] GET /compute/v2.1/servers/979f72d5-fadc-4b59-ace6-6b8b350a63d9 => generated 1315 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 13:01:12.358956 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-3accbc75-4977-44a1-8fec-73f5283ad237 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:01:12.360298 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-3accbc75-4977-44a1-8fec-73f5283ad237 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:12.370711 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-3accbc75-4977-44a1-8fec-73f5283ad237 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:12.371515 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-3accbc75-4977-44a1-8fec-73f5283ad237 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:12.372929 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-3accbc75-4977-44a1-8fec-73f5283ad237 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:12.373741 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-3accbc75-4977-44a1-8fec-73f5283ad237 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:12.464517 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-003363f1-2209-4f43-9499-0e8374633c56 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:12.465307 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-003363f1-2209-4f43-9499-0e8374633c56 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: a3b02d0f-db9d-4996-a245-7237e989670d] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:12.474638 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-003363f1-2209-4f43-9499-0e8374633c56 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:12.475416 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-003363f1-2209-4f43-9499-0e8374633c56 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:12.476516 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-003363f1-2209-4f43-9499-0e8374633c56 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:12.477332 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-003363f1-2209-4f43-9499-0e8374633c56 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:12.524013 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-3accbc75-4977-44a1-8fec-73f5283ad237 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action" status: 200 len: 28213 microversion: 2.20 time: 0.170359 Nov 23 13:01:12.528750 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 157/318] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:01:12 2021] POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action => generated 28213 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 13:01:12.686908 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.objects.instance [None req-003363f1-2209-4f43-9499-0e8374633c56 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lazy-loading 'services' on Instance uuid a3b02d0f-db9d-4996-a245-7237e989670d {{(pid=100974) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 23 13:01:12.902307 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-003363f1-2209-4f43-9499-0e8374633c56 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "DELETE /compute/v2.1/servers/a3b02d0f-db9d-4996-a245-7237e989670d/os-volume_attachments/cc2dcb04-a6ef-434d-b801-0000f81e8f29" status: 202 len: 0 microversion: 2.1 time: 0.447419 Nov 23 13:01:12.903530 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 162/319] 10.222.0.60 () {58 vars in 1415 bytes} [Tue Nov 23 13:01:12 2021] DELETE /compute/v2.1/servers/a3b02d0f-db9d-4996-a245-7237e989670d/os-volume_attachments/cc2dcb04-a6ef-434d-b801-0000f81e8f29 => generated 0 bytes in 450 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 23 13:01:12.913528 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-32602c8f-8af6-4bd0-8cd2-4a03e64cebd2 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:12.915028 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-32602c8f-8af6-4bd0-8cd2-4a03e64cebd2 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: a3b02d0f-db9d-4996-a245-7237e989670d] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:12.924432 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-32602c8f-8af6-4bd0-8cd2-4a03e64cebd2 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:12.925102 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-32602c8f-8af6-4bd0-8cd2-4a03e64cebd2 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:12.925840 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-32602c8f-8af6-4bd0-8cd2-4a03e64cebd2 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:12.926648 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-32602c8f-8af6-4bd0-8cd2-4a03e64cebd2 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:12.972640 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [req-67b37eb7-dd44-46ab-a411-79ba3f6d95be req-4d9571ef-2e8a-4f39-ba0b-4c1f094c66c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "979f72d5-fadc-4b59-ace6-6b8b350a63d9", "name": "network-vif-plugged", "status": "completed", "tag": "d1719e73-7614-4f8d-9a1c-396cfa30d9b3"}]} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:01:12.976461 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 13:01:12.976461 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: warnings.warn(msg) Nov 23 13:01:12.999637 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [req-67b37eb7-dd44-46ab-a411-79ba3f6d95be req-4d9571ef-2e8a-4f39-ba0b-4c1f094c66c8 service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:13.000010 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [req-67b37eb7-dd44-46ab-a411-79ba3f6d95be req-4d9571ef-2e8a-4f39-ba0b-4c1f094c66c8 service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:13.047454 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.compute.server_external_events [req-67b37eb7-dd44-46ab-a411-79ba3f6d95be req-4d9571ef-2e8a-4f39-ba0b-4c1f094c66c8 service nova] Creating event network-vif-plugged:d1719e73-7614-4f8d-9a1c-396cfa30d9b3 for instance 979f72d5-fadc-4b59-ace6-6b8b350a63d9 on hv-cinder-81888 Nov 23 13:01:13.056583 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [req-67b37eb7-dd44-46ab-a411-79ba3f6d95be req-4d9571ef-2e8a-4f39-ba0b-4c1f094c66c8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101928 Nov 23 13:01:13.059921 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 163/320] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Nov 23 13:01:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 13:01:13.099702 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-32602c8f-8af6-4bd0-8cd2-4a03e64cebd2 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/a3b02d0f-db9d-4996-a245-7237e989670d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.191620 Nov 23 13:01:13.102748 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 158/321] 10.222.0.60 () {58 vars in 1301 bytes} [Tue Nov 23 13:01:12 2021] GET /compute/v2.1/servers/a3b02d0f-db9d-4996-a245-7237e989670d/os-volume_attachments => generated 197 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 13:01:13.215630 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-c72966e4-6a03-4f56-a68b-11a68d886e55 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:01:13.216759 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-c72966e4-6a03-4f56-a68b-11a68d886e55 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: 53633a05-ad06-454a-b540-5fc01821ae45] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:13.224629 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c72966e4-6a03-4f56-a68b-11a68d886e55 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:13.225073 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c72966e4-6a03-4f56-a68b-11a68d886e55 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:13.225843 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c72966e4-6a03-4f56-a68b-11a68d886e55 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:13.226269 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c72966e4-6a03-4f56-a68b-11a68d886e55 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:13.300855 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.objects.instance [None req-c72966e4-6a03-4f56-a68b-11a68d886e55 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lazy-loading 'flavor' on Instance uuid 53633a05-ad06-454a-b540-5fc01821ae45 {{(pid=100974) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 23 13:01:13.382644 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-2bfa8777-ade7-49bb-b905-bcaa39a94a7b tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:13.383412 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-2bfa8777-ade7-49bb-b905-bcaa39a94a7b tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] [instance: 979f72d5-fadc-4b59-ace6-6b8b350a63d9] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:13.400024 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-2bfa8777-ade7-49bb-b905-bcaa39a94a7b tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:13.400708 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-2bfa8777-ade7-49bb-b905-bcaa39a94a7b tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:13.401852 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-2bfa8777-ade7-49bb-b905-bcaa39a94a7b tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:13.403207 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-2bfa8777-ade7-49bb-b905-bcaa39a94a7b tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:13.540397 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-c72966e4-6a03-4f56-a68b-11a68d886e55 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "POST /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45/action" status: 200 len: 32 microversion: 2.1 time: 0.328543 Nov 23 13:01:13.544771 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 164/322] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:01:13 2021] POST /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45/action => generated 32 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 13:01:13.550284 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-91b52467-2342-498b-9124-7d0caf7fbded tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:01:13.551437 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-91b52467-2342-498b-9124-7d0caf7fbded tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:13.573377 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-91b52467-2342-498b-9124-7d0caf7fbded tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:13.574284 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-91b52467-2342-498b-9124-7d0caf7fbded tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:13.575370 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-91b52467-2342-498b-9124-7d0caf7fbded tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:13.575965 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-91b52467-2342-498b-9124-7d0caf7fbded tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:13.825712 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-2bfa8777-ade7-49bb-b905-bcaa39a94a7b tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb98e201f2f41b18735465a450909ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d331da092466b8d717a7e039a5b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:01:13.836554 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-2bfa8777-ade7-49bb-b905-bcaa39a94a7b tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] 10.222.0.60 "GET /compute/v2.1/servers/979f72d5-fadc-4b59-ace6-6b8b350a63d9" status: 200 len: 1315 microversion: 2.1 time: 0.466552 Nov 23 13:01:13.837454 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 159/323] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:01:13 2021] GET /compute/v2.1/servers/979f72d5-fadc-4b59-ace6-6b8b350a63d9 => generated 1315 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:01:13.842667 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-6728d2c8-729b-4279-afb0-c8b296ba0396 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:13.843508 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-6728d2c8-729b-4279-afb0-c8b296ba0396 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: 53633a05-ad06-454a-b540-5fc01821ae45] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:13.852526 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6728d2c8-729b-4279-afb0-c8b296ba0396 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:13.853158 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6728d2c8-729b-4279-afb0-c8b296ba0396 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:13.854364 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6728d2c8-729b-4279-afb0-c8b296ba0396 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:13.855136 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6728d2c8-729b-4279-afb0-c8b296ba0396 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:14.188556 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-6728d2c8-729b-4279-afb0-c8b296ba0396 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:01:14.205733 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-6728d2c8-729b-4279-afb0-c8b296ba0396 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45" status: 200 len: 1518 microversion: 2.1 time: 0.366645 Nov 23 13:01:14.207242 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 160/324] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:01:13 2021] GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45 => generated 1518 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:01:14.214187 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-1e8a17f9-a8c4-4370-bac7-c877ea07a828 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:14.216047 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-1e8a17f9-a8c4-4370-bac7-c877ea07a828 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: a3b02d0f-db9d-4996-a245-7237e989670d] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:14.228684 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-1e8a17f9-a8c4-4370-bac7-c877ea07a828 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:14.229506 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-1e8a17f9-a8c4-4370-bac7-c877ea07a828 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:14.231304 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-1e8a17f9-a8c4-4370-bac7-c877ea07a828 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:14.232336 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-1e8a17f9-a8c4-4370-bac7-c877ea07a828 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:14.405135 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-1e8a17f9-a8c4-4370-bac7-c877ea07a828 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/a3b02d0f-db9d-4996-a245-7237e989670d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.196513 Nov 23 13:01:14.405724 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 161/325] 10.222.0.60 () {58 vars in 1301 bytes} [Tue Nov 23 13:01:14 2021] GET /compute/v2.1/servers/a3b02d0f-db9d-4996-a245-7237e989670d/os-volume_attachments => generated 197 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 13:01:14.858133 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-3a0c8b51-88f3-4e79-88f0-4b259459dc22 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:14.859473 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-3a0c8b51-88f3-4e79-88f0-4b259459dc22 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] [instance: 979f72d5-fadc-4b59-ace6-6b8b350a63d9] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:14.868371 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-3a0c8b51-88f3-4e79-88f0-4b259459dc22 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:14.869030 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-3a0c8b51-88f3-4e79-88f0-4b259459dc22 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:14.870187 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-3a0c8b51-88f3-4e79-88f0-4b259459dc22 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:14.870824 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-3a0c8b51-88f3-4e79-88f0-4b259459dc22 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:15.158873 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-3a0c8b51-88f3-4e79-88f0-4b259459dc22 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb98e201f2f41b18735465a450909ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d331da092466b8d717a7e039a5b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:01:15.176819 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-3a0c8b51-88f3-4e79-88f0-4b259459dc22 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] 10.222.0.60 "GET /compute/v2.1/servers/979f72d5-fadc-4b59-ace6-6b8b350a63d9" status: 200 len: 1315 microversion: 2.1 time: 0.326234 Nov 23 13:01:15.184289 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 162/326] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:01:14 2021] GET /compute/v2.1/servers/979f72d5-fadc-4b59-ace6-6b8b350a63d9 => generated 1315 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:01:15.224070 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-f6f73f80-9b00-475e-9cd2-ac5d2c43879d tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:15.225858 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-f6f73f80-9b00-475e-9cd2-ac5d2c43879d tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: 53633a05-ad06-454a-b540-5fc01821ae45] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:15.238165 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f6f73f80-9b00-475e-9cd2-ac5d2c43879d tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:15.239145 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f6f73f80-9b00-475e-9cd2-ac5d2c43879d tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:15.240519 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f6f73f80-9b00-475e-9cd2-ac5d2c43879d tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:15.241053 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f6f73f80-9b00-475e-9cd2-ac5d2c43879d tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:15.466580 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-f6f73f80-9b00-475e-9cd2-ac5d2c43879d tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:01:15.475603 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-f6f73f80-9b00-475e-9cd2-ac5d2c43879d tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45" status: 200 len: 1518 microversion: 2.1 time: 0.255936 Nov 23 13:01:15.486571 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 163/327] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:01:15 2021] GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45 => generated 1518 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:01:15.492678 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-19dc7efc-1bbe-4f9c-b861-dc49900abbf2 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:15.493824 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-19dc7efc-1bbe-4f9c-b861-dc49900abbf2 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: a3b02d0f-db9d-4996-a245-7237e989670d] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:15.505879 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-19dc7efc-1bbe-4f9c-b861-dc49900abbf2 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:15.506940 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-19dc7efc-1bbe-4f9c-b861-dc49900abbf2 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:15.507890 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-19dc7efc-1bbe-4f9c-b861-dc49900abbf2 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:15.508507 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-19dc7efc-1bbe-4f9c-b861-dc49900abbf2 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:15.582756 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-19dc7efc-1bbe-4f9c-b861-dc49900abbf2 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/a3b02d0f-db9d-4996-a245-7237e989670d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094315 Nov 23 13:01:15.583096 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 164/328] 10.222.0.60 () {58 vars in 1301 bytes} [Tue Nov 23 13:01:15 2021] GET /compute/v2.1/servers/a3b02d0f-db9d-4996-a245-7237e989670d/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 13:01:16.203965 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-84e61325-6da9-4297-8361-79b8db8f5e91 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:16.204916 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-84e61325-6da9-4297-8361-79b8db8f5e91 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] [instance: 979f72d5-fadc-4b59-ace6-6b8b350a63d9] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:16.213391 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-84e61325-6da9-4297-8361-79b8db8f5e91 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:16.213921 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-84e61325-6da9-4297-8361-79b8db8f5e91 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:16.215071 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-84e61325-6da9-4297-8361-79b8db8f5e91 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:16.215493 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-84e61325-6da9-4297-8361-79b8db8f5e91 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:16.497998 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-84e61325-6da9-4297-8361-79b8db8f5e91 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb98e201f2f41b18735465a450909ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d331da092466b8d717a7e039a5b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:01:16.507827 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-84e61325-6da9-4297-8361-79b8db8f5e91 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] 10.222.0.60 "GET /compute/v2.1/servers/979f72d5-fadc-4b59-ace6-6b8b350a63d9" status: 200 len: 1315 microversion: 2.1 time: 0.307527 Nov 23 13:01:16.508818 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 165/329] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:01:16 2021] GET /compute/v2.1/servers/979f72d5-fadc-4b59-ace6-6b8b350a63d9 => generated 1315 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:01:16.517434 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-4b0b16bc-d2e7-4803-82f2-d9062e5c39dd tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:16.518563 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-4b0b16bc-d2e7-4803-82f2-d9062e5c39dd tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: 53633a05-ad06-454a-b540-5fc01821ae45] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:16.530993 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4b0b16bc-d2e7-4803-82f2-d9062e5c39dd tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:16.531699 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4b0b16bc-d2e7-4803-82f2-d9062e5c39dd tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:16.532608 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4b0b16bc-d2e7-4803-82f2-d9062e5c39dd tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:16.533064 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4b0b16bc-d2e7-4803-82f2-d9062e5c39dd tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:16.814471 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-4b0b16bc-d2e7-4803-82f2-d9062e5c39dd tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:01:16.824075 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-4b0b16bc-d2e7-4803-82f2-d9062e5c39dd tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45" status: 200 len: 1518 microversion: 2.1 time: 0.313871 Nov 23 13:01:16.824808 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 166/330] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:01:16 2021] GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45 => generated 1518 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:01:16.829776 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-fb835243-5a31-4b3e-8d6d-74d6190d5440 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:16.837550 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-fb835243-5a31-4b3e-8d6d-74d6190d5440 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: a3b02d0f-db9d-4996-a245-7237e989670d] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:16.845884 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-fb835243-5a31-4b3e-8d6d-74d6190d5440 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:16.846470 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-fb835243-5a31-4b3e-8d6d-74d6190d5440 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:16.847252 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-fb835243-5a31-4b3e-8d6d-74d6190d5440 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:16.847683 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-fb835243-5a31-4b3e-8d6d-74d6190d5440 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:16.914736 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-fb835243-5a31-4b3e-8d6d-74d6190d5440 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/a3b02d0f-db9d-4996-a245-7237e989670d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088805 Nov 23 13:01:16.915297 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 167/331] 10.222.0.60 () {58 vars in 1301 bytes} [Tue Nov 23 13:01:16 2021] GET /compute/v2.1/servers/a3b02d0f-db9d-4996-a245-7237e989670d/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 13:01:17.534574 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-e34126e6-6f39-4a4d-b2ce-f32dafd2fe30 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:17.535178 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-e34126e6-6f39-4a4d-b2ce-f32dafd2fe30 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] [instance: 979f72d5-fadc-4b59-ace6-6b8b350a63d9] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:17.542314 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e34126e6-6f39-4a4d-b2ce-f32dafd2fe30 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:17.542757 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e34126e6-6f39-4a4d-b2ce-f32dafd2fe30 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:17.543521 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e34126e6-6f39-4a4d-b2ce-f32dafd2fe30 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:17.544098 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e34126e6-6f39-4a4d-b2ce-f32dafd2fe30 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:17.751924 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-e34126e6-6f39-4a4d-b2ce-f32dafd2fe30 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb98e201f2f41b18735465a450909ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d331da092466b8d717a7e039a5b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:01:17.760443 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-e34126e6-6f39-4a4d-b2ce-f32dafd2fe30 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] 10.222.0.60 "GET /compute/v2.1/servers/979f72d5-fadc-4b59-ace6-6b8b350a63d9" status: 200 len: 1315 microversion: 2.1 time: 0.229431 Nov 23 13:01:17.761008 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 168/332] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:01:17 2021] GET /compute/v2.1/servers/979f72d5-fadc-4b59-ace6-6b8b350a63d9 => generated 1315 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:01:17.841316 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-5bb78ff9-e84a-4d99-a656-83f92efc0785 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:17.841970 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-5bb78ff9-e84a-4d99-a656-83f92efc0785 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: 53633a05-ad06-454a-b540-5fc01821ae45] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:17.849246 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5bb78ff9-e84a-4d99-a656-83f92efc0785 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:17.849618 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5bb78ff9-e84a-4d99-a656-83f92efc0785 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:17.850383 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5bb78ff9-e84a-4d99-a656-83f92efc0785 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:17.850827 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5bb78ff9-e84a-4d99-a656-83f92efc0785 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:18.051971 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-5bb78ff9-e84a-4d99-a656-83f92efc0785 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:01:18.061110 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-5bb78ff9-e84a-4d99-a656-83f92efc0785 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45" status: 200 len: 1518 microversion: 2.1 time: 0.223724 Nov 23 13:01:18.061682 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 169/333] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:01:17 2021] GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45 => generated 1518 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:01:18.067076 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-103aee17-f97b-41b0-bd13-901ca72606f3 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:18.068166 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-103aee17-f97b-41b0-bd13-901ca72606f3 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: a3b02d0f-db9d-4996-a245-7237e989670d] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:18.076071 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-103aee17-f97b-41b0-bd13-901ca72606f3 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:18.076810 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-103aee17-f97b-41b0-bd13-901ca72606f3 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:18.077583 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-103aee17-f97b-41b0-bd13-901ca72606f3 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:18.078005 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-103aee17-f97b-41b0-bd13-901ca72606f3 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:18.143849 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-103aee17-f97b-41b0-bd13-901ca72606f3 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/a3b02d0f-db9d-4996-a245-7237e989670d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081091 Nov 23 13:01:18.144432 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 170/334] 10.222.0.60 () {58 vars in 1301 bytes} [Tue Nov 23 13:01:18 2021] GET /compute/v2.1/servers/a3b02d0f-db9d-4996-a245-7237e989670d/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 13:01:18.777865 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-6c6592e3-00ec-4e52-b32d-2ffa200506e0 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:18.778741 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-6c6592e3-00ec-4e52-b32d-2ffa200506e0 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] [instance: 979f72d5-fadc-4b59-ace6-6b8b350a63d9] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:18.786982 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6c6592e3-00ec-4e52-b32d-2ffa200506e0 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:18.787425 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6c6592e3-00ec-4e52-b32d-2ffa200506e0 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:18.788218 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6c6592e3-00ec-4e52-b32d-2ffa200506e0 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:18.788741 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6c6592e3-00ec-4e52-b32d-2ffa200506e0 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:19.064892 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-6c6592e3-00ec-4e52-b32d-2ffa200506e0 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb98e201f2f41b18735465a450909ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d331da092466b8d717a7e039a5b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:01:19.074594 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-6c6592e3-00ec-4e52-b32d-2ffa200506e0 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] 10.222.0.60 "GET /compute/v2.1/servers/979f72d5-fadc-4b59-ace6-6b8b350a63d9" status: 200 len: 1315 microversion: 2.1 time: 0.300351 Nov 23 13:01:19.075383 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 171/335] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:01:18 2021] GET /compute/v2.1/servers/979f72d5-fadc-4b59-ace6-6b8b350a63d9 => generated 1315 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:01:19.080757 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-c87352a0-3e49-4668-8693-0428f4879937 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:19.081354 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-c87352a0-3e49-4668-8693-0428f4879937 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: 53633a05-ad06-454a-b540-5fc01821ae45] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:19.092099 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c87352a0-3e49-4668-8693-0428f4879937 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:19.092552 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c87352a0-3e49-4668-8693-0428f4879937 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:19.093666 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c87352a0-3e49-4668-8693-0428f4879937 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:19.094140 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c87352a0-3e49-4668-8693-0428f4879937 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:19.202819 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-91b52467-2342-498b-9124-7d0caf7fbded tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action" status: 200 len: 28213 microversion: 2.20 time: 5.660084 Nov 23 13:01:19.206924 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 165/336] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:01:13 2021] POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action => generated 28213 bytes in 5663 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:01:19.210138 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-35208d27-b254-4def-921c-9e55d45d6140 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:19.211164 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-35208d27-b254-4def-921c-9e55d45d6140 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: a3b02d0f-db9d-4996-a245-7237e989670d] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:19.221129 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-35208d27-b254-4def-921c-9e55d45d6140 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:19.224390 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-35208d27-b254-4def-921c-9e55d45d6140 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:19.225477 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-35208d27-b254-4def-921c-9e55d45d6140 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:19.225682 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-35208d27-b254-4def-921c-9e55d45d6140 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:19.304943 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-35208d27-b254-4def-921c-9e55d45d6140 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/a3b02d0f-db9d-4996-a245-7237e989670d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.098831 Nov 23 13:01:19.305735 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 166/337] 10.222.0.60 () {58 vars in 1301 bytes} [Tue Nov 23 13:01:19 2021] GET /compute/v2.1/servers/a3b02d0f-db9d-4996-a245-7237e989670d/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 13:01:19.430853 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-c87352a0-3e49-4668-8693-0428f4879937 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:01:19.441074 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-c87352a0-3e49-4668-8693-0428f4879937 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45" status: 200 len: 1518 microversion: 2.1 time: 0.364398 Nov 23 13:01:19.441622 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 172/338] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:01:19 2021] GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45 => generated 1518 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:01:20.097829 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-85224f5b-2672-43d0-a192-b7837bd5d4c5 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:20.098972 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-85224f5b-2672-43d0-a192-b7837bd5d4c5 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] [instance: 979f72d5-fadc-4b59-ace6-6b8b350a63d9] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:20.108703 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-85224f5b-2672-43d0-a192-b7837bd5d4c5 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:20.109587 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-85224f5b-2672-43d0-a192-b7837bd5d4c5 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:20.110269 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-85224f5b-2672-43d0-a192-b7837bd5d4c5 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:20.110771 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-85224f5b-2672-43d0-a192-b7837bd5d4c5 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:20.215731 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-2f624304-1ef0-42ab-93aa-e616412b3995 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:01:20.217288 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-2f624304-1ef0-42ab-93aa-e616412b3995 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:20.224959 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-2f624304-1ef0-42ab-93aa-e616412b3995 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:20.225447 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-2f624304-1ef0-42ab-93aa-e616412b3995 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:20.226215 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-2f624304-1ef0-42ab-93aa-e616412b3995 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:20.226646 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-2f624304-1ef0-42ab-93aa-e616412b3995 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:20.370285 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-2f624304-1ef0-42ab-93aa-e616412b3995 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action" status: 200 len: 28213 microversion: 2.20 time: 0.159003 Nov 23 13:01:20.370951 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 173/339] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:01:20 2021] POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action => generated 28213 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:01:20.380475 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-94606b6a-f0cc-4955-8b1e-c3cb965572fe tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:20.381467 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-94606b6a-f0cc-4955-8b1e-c3cb965572fe tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: a3b02d0f-db9d-4996-a245-7237e989670d] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:20.390026 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-94606b6a-f0cc-4955-8b1e-c3cb965572fe tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:20.390468 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-94606b6a-f0cc-4955-8b1e-c3cb965572fe tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:20.391264 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-94606b6a-f0cc-4955-8b1e-c3cb965572fe tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:20.391729 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-94606b6a-f0cc-4955-8b1e-c3cb965572fe tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:20.476332 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-94606b6a-f0cc-4955-8b1e-c3cb965572fe tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/a3b02d0f-db9d-4996-a245-7237e989670d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.100793 Nov 23 13:01:20.477110 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 174/340] 10.222.0.60 () {58 vars in 1301 bytes} [Tue Nov 23 13:01:20 2021] GET /compute/v2.1/servers/a3b02d0f-db9d-4996-a245-7237e989670d/os-volume_attachments => generated 197 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 13:01:20.483489 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-85224f5b-2672-43d0-a192-b7837bd5d4c5 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb98e201f2f41b18735465a450909ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d331da092466b8d717a7e039a5b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:01:20.484728 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-f7ac1079-816e-4d34-828a-a7be7ef4a47e tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:20.485405 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-f7ac1079-816e-4d34-828a-a7be7ef4a47e tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: 53633a05-ad06-454a-b540-5fc01821ae45] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:20.491719 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-85224f5b-2672-43d0-a192-b7837bd5d4c5 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] 10.222.0.60 "GET /compute/v2.1/servers/979f72d5-fadc-4b59-ace6-6b8b350a63d9" status: 200 len: 1315 microversion: 2.1 time: 0.398118 Nov 23 13:01:20.492325 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 167/341] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:01:20 2021] GET /compute/v2.1/servers/979f72d5-fadc-4b59-ace6-6b8b350a63d9 => generated 1315 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 13:01:20.492922 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f7ac1079-816e-4d34-828a-a7be7ef4a47e tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:20.493464 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f7ac1079-816e-4d34-828a-a7be7ef4a47e tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:20.494298 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f7ac1079-816e-4d34-828a-a7be7ef4a47e tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:20.494790 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f7ac1079-816e-4d34-828a-a7be7ef4a47e tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:20.871396 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-f7ac1079-816e-4d34-828a-a7be7ef4a47e tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:01:20.882079 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-f7ac1079-816e-4d34-828a-a7be7ef4a47e tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45" status: 200 len: 1518 microversion: 2.1 time: 0.403910 Nov 23 13:01:20.883076 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 175/342] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:01:20 2021] GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45 => generated 1518 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:01:21.021951 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-805c5449-d8d3-4a97-9d42-046306e21ca5 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1086347631", "imageRef": "d01e1b62-4f14-4f64-9d63-d155732e33e8", "flavorRef": "452", "networks": [{"uuid": "a571d6c9-2f13-4763-96af-a092586944f2"}]}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:01:21.118488 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.network.neutron [None req-805c5449-d8d3-4a97-9d42-046306e21ca5 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] validate_networks() for [('a571d6c9-2f13-4763-96af-a092586944f2', None, None, None)] {{(pid=100974) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Nov 23 13:01:21.383974 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-8b736a94-7f7b-4d5e-8962-466957612b47 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:01:21.385184 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-8b736a94-7f7b-4d5e-8962-466957612b47 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:21.397867 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8b736a94-7f7b-4d5e-8962-466957612b47 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:21.399096 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8b736a94-7f7b-4d5e-8962-466957612b47 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:21.400725 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8b736a94-7f7b-4d5e-8962-466957612b47 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:21.401355 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8b736a94-7f7b-4d5e-8962-466957612b47 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:21.587434 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-8b736a94-7f7b-4d5e-8962-466957612b47 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action" status: 200 len: 28213 microversion: 2.20 time: 0.207797 Nov 23 13:01:21.588372 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 176/343] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:01:21 2021] POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action => generated 28213 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 13:01:21.596786 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-9cdf8cdb-229a-4067-9fec-f15fca1403b6 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:21.600610 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-9cdf8cdb-229a-4067-9fec-f15fca1403b6 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: a3b02d0f-db9d-4996-a245-7237e989670d] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:21.627985 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-9cdf8cdb-229a-4067-9fec-f15fca1403b6 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:21.629213 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-9cdf8cdb-229a-4067-9fec-f15fca1403b6 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:21.631580 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-9cdf8cdb-229a-4067-9fec-f15fca1403b6 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:21.633260 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-9cdf8cdb-229a-4067-9fec-f15fca1403b6 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:21.730924 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-9cdf8cdb-229a-4067-9fec-f15fca1403b6 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/a3b02d0f-db9d-4996-a245-7237e989670d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.140960 Nov 23 13:01:21.731594 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 177/344] 10.222.0.60 () {58 vars in 1301 bytes} [Tue Nov 23 13:01:21 2021] GET /compute/v2.1/servers/a3b02d0f-db9d-4996-a245-7237e989670d/os-volume_attachments => generated 25 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 13:01:21.742816 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-ba67b595-192f-4424-a584-862d9721fc86 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:21.744619 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-ba67b595-192f-4424-a584-862d9721fc86 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] [instance: 979f72d5-fadc-4b59-ace6-6b8b350a63d9] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:21.753085 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ba67b595-192f-4424-a584-862d9721fc86 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:21.753602 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ba67b595-192f-4424-a584-862d9721fc86 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:21.754460 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ba67b595-192f-4424-a584-862d9721fc86 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:21.754978 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ba67b595-192f-4424-a584-862d9721fc86 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:21.922083 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.virt.hardware [None req-805c5449-d8d3-4a97-9d42-046306e21ca5 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Flavor limits 0:0:0 {{(pid=100974) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 23 13:01:21.922786 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.virt.hardware [None req-805c5449-d8d3-4a97-9d42-046306e21ca5 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Image limits 0:0:0 {{(pid=100974) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 23 13:01:21.923263 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.virt.hardware [None req-805c5449-d8d3-4a97-9d42-046306e21ca5 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Flavor pref 0:0:0 {{(pid=100974) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 23 13:01:21.923673 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.virt.hardware [None req-805c5449-d8d3-4a97-9d42-046306e21ca5 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Image pref 0:0:0 {{(pid=100974) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 23 13:01:21.924368 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.virt.hardware [None req-805c5449-d8d3-4a97-9d42-046306e21ca5 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100974) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 23 13:01:21.951879 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-805c5449-d8d3-4a97-9d42-046306e21ca5 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:21.953630 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-805c5449-d8d3-4a97-9d42-046306e21ca5 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:21.954777 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-805c5449-d8d3-4a97-9d42-046306e21ca5 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:21.955364 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-805c5449-d8d3-4a97-9d42-046306e21ca5 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:21.980764 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.quota [None req-805c5449-d8d3-4a97-9d42-046306e21ca5 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Getting quotas for project 306daa81c2794164a38ae7bc3b322ef2. Resources: {'ram', 'cores', 'instances'} {{(pid=100974) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 13:01:21.985158 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.quota [None req-805c5449-d8d3-4a97-9d42-046306e21ca5 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Getting quotas for user ec0fe7fa96d645ecbc1e50fb5595971d and project 306daa81c2794164a38ae7bc3b322ef2. Resources: {'ram', 'cores', 'instances'} {{(pid=100974) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 13:01:22.001156 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-805c5449-d8d3-4a97-9d42-046306e21ca5 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Going to run 1 instances... {{(pid=100974) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Nov 23 13:01:22.004490 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-805c5449-d8d3-4a97-9d42-046306e21ca5 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] [instance: 0c7618d8-89ce-43e8-b243-3b6e2647e9b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d01e1b62-4f14-4f64-9d63-d155732e33e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100974) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Nov 23 13:01:22.045327 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-ba67b595-192f-4424-a584-862d9721fc86 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb98e201f2f41b18735465a450909ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d331da092466b8d717a7e039a5b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:01:22.054775 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-ba67b595-192f-4424-a584-862d9721fc86 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] 10.222.0.60 "GET /compute/v2.1/servers/979f72d5-fadc-4b59-ace6-6b8b350a63d9" status: 200 len: 1465 microversion: 2.1 time: 0.321501 Nov 23 13:01:22.065649 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-805c5449-d8d3-4a97-9d42-046306e21ca5 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.048501 Nov 23 13:01:22.067216 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 178/345] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:01:21 2021] GET /compute/v2.1/servers/979f72d5-fadc-4b59-ace6-6b8b350a63d9 => generated 1465 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:01:22.072855 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-7365f606-89b1-4b4e-a069-ad0cf4e46a83 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:22.073512 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-7365f606-89b1-4b4e-a069-ad0cf4e46a83 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: 53633a05-ad06-454a-b540-5fc01821ae45] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:22.082572 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-7365f606-89b1-4b4e-a069-ad0cf4e46a83 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:22.083014 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-7365f606-89b1-4b4e-a069-ad0cf4e46a83 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:22.083559 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 168/346] 10.222.0.60 () {60 vars in 1146 bytes} [Tue Nov 23 13:01:21 2021] POST /compute/v2.1/servers => generated 380 bytes in 1067 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 23 13:01:22.083854 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-7365f606-89b1-4b4e-a069-ad0cf4e46a83 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:22.084604 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-7365f606-89b1-4b4e-a069-ad0cf4e46a83 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:22.097993 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-6444e671-593b-4802-9532-dddcc3dd2ed6 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:22.100404 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-6444e671-593b-4802-9532-dddcc3dd2ed6 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] [instance: 0c7618d8-89ce-43e8-b243-3b6e2647e9b7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:22.230566 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-6444e671-593b-4802-9532-dddcc3dd2ed6 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0fe7fa96d645ecbc1e50fb5595971d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306daa81c2794164a38ae7bc3b322ef2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:01:22.240528 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-6444e671-593b-4802-9532-dddcc3dd2ed6 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] 10.222.0.60 "GET /compute/v2.1/servers/0c7618d8-89ce-43e8-b243-3b6e2647e9b7" status: 200 len: 1214 microversion: 2.1 time: 0.153378 Nov 23 13:01:22.241584 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 169/347] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:01:22 2021] GET /compute/v2.1/servers/0c7618d8-89ce-43e8-b243-3b6e2647e9b7 => generated 1214 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:01:22.247917 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-9c214231-c2f8-4933-9ca8-f8e9b935bcea tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1011571720", "imageRef": "d01e1b62-4f14-4f64-9d63-d155732e33e8", "flavorRef": "452", "networks": [{"uuid": "bf33958f-9165-410d-8036-71326a5124b6"}]}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:01:22.321452 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.network.neutron [None req-9c214231-c2f8-4933-9ca8-f8e9b935bcea tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] validate_networks() for [('bf33958f-9165-410d-8036-71326a5124b6', None, None, None)] {{(pid=100974) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Nov 23 13:01:22.367510 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-7365f606-89b1-4b4e-a069-ad0cf4e46a83 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:01:22.378721 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-7365f606-89b1-4b4e-a069-ad0cf4e46a83 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45" status: 200 len: 1518 microversion: 2.1 time: 0.310265 Nov 23 13:01:22.388664 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 179/348] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:01:22 2021] GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45 => generated 1518 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:01:22.394702 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-a4fbee6a-9e42-4ce6-b7ab-9db101cc1863 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:22.395450 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-a4fbee6a-9e42-4ce6-b7ab-9db101cc1863 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] [instance: 979f72d5-fadc-4b59-ace6-6b8b350a63d9] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:22.403219 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a4fbee6a-9e42-4ce6-b7ab-9db101cc1863 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:22.404260 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a4fbee6a-9e42-4ce6-b7ab-9db101cc1863 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:22.405198 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a4fbee6a-9e42-4ce6-b7ab-9db101cc1863 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:22.405624 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a4fbee6a-9e42-4ce6-b7ab-9db101cc1863 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:22.479942 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-a4fbee6a-9e42-4ce6-b7ab-9db101cc1863 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] [instance: 979f72d5-fadc-4b59-ace6-6b8b350a63d9] Going to try to terminate instance {{(pid=100973) delete /opt/stack/nova/nova/compute/api.py:2562}} Nov 23 13:01:22.646344 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-a4fbee6a-9e42-4ce6-b7ab-9db101cc1863 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] 10.222.0.60 "DELETE /compute/v2.1/servers/979f72d5-fadc-4b59-ace6-6b8b350a63d9" status: 204 len: 0 microversion: 2.1 time: 0.254898 Nov 23 13:01:22.647836 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 180/349] 10.222.0.60 () {58 vars in 1238 bytes} [Tue Nov 23 13:01:22 2021] DELETE /compute/v2.1/servers/979f72d5-fadc-4b59-ace6-6b8b350a63d9 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 23 13:01:22.655129 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-206a0689-2273-4d83-8905-6660c89f0792 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:01:22.656461 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-206a0689-2273-4d83-8905-6660c89f0792 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:22.667336 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-206a0689-2273-4d83-8905-6660c89f0792 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:22.667821 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-206a0689-2273-4d83-8905-6660c89f0792 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:22.668825 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-206a0689-2273-4d83-8905-6660c89f0792 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:22.669598 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-206a0689-2273-4d83-8905-6660c89f0792 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:22.917847 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-206a0689-2273-4d83-8905-6660c89f0792 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action" status: 200 len: 28213 microversion: 2.20 time: 0.267831 Nov 23 13:01:22.923672 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 181/350] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:01:22 2021] POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action => generated 28213 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:01:22.930174 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-c1237ea9-a562-42c8-afe5-1a556648b1f3 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:22.931271 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-c1237ea9-a562-42c8-afe5-1a556648b1f3 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] [instance: 979f72d5-fadc-4b59-ace6-6b8b350a63d9] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:22.942163 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c1237ea9-a562-42c8-afe5-1a556648b1f3 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:22.942828 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c1237ea9-a562-42c8-afe5-1a556648b1f3 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:22.944133 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c1237ea9-a562-42c8-afe5-1a556648b1f3 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:22.944746 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c1237ea9-a562-42c8-afe5-1a556648b1f3 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:23.101083 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.virt.hardware [None req-9c214231-c2f8-4933-9ca8-f8e9b935bcea tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Flavor limits 0:0:0 {{(pid=100974) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 23 13:01:23.101843 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.virt.hardware [None req-9c214231-c2f8-4933-9ca8-f8e9b935bcea tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Image limits 0:0:0 {{(pid=100974) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 23 13:01:23.101946 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.virt.hardware [None req-9c214231-c2f8-4933-9ca8-f8e9b935bcea tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Flavor pref 0:0:0 {{(pid=100974) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 23 13:01:23.102344 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.virt.hardware [None req-9c214231-c2f8-4933-9ca8-f8e9b935bcea tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Image pref 0:0:0 {{(pid=100974) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 23 13:01:23.102937 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.virt.hardware [None req-9c214231-c2f8-4933-9ca8-f8e9b935bcea tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100974) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 23 13:01:23.129136 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-9c214231-c2f8-4933-9ca8-f8e9b935bcea tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:23.130152 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-9c214231-c2f8-4933-9ca8-f8e9b935bcea tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:23.131859 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-9c214231-c2f8-4933-9ca8-f8e9b935bcea tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:23.132523 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-9c214231-c2f8-4933-9ca8-f8e9b935bcea tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:23.168359 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.quota [None req-9c214231-c2f8-4933-9ca8-f8e9b935bcea tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Getting quotas for project 9a31364455dc442f8df299a8ad758a4e. Resources: {'ram', 'cores', 'instances'} {{(pid=100974) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 13:01:23.172852 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.quota [None req-9c214231-c2f8-4933-9ca8-f8e9b935bcea tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Getting quotas for user c023f89fd3da4bc8b38963bed4e5cc63 and project 9a31364455dc442f8df299a8ad758a4e. Resources: {'ram', 'cores', 'instances'} {{(pid=100974) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 13:01:23.185226 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-9c214231-c2f8-4933-9ca8-f8e9b935bcea tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Going to run 1 instances... {{(pid=100974) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Nov 23 13:01:23.188134 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-9c214231-c2f8-4933-9ca8-f8e9b935bcea tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: 12bb9b8b-86ee-463f-a3be-95894290b739] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d01e1b62-4f14-4f64-9d63-d155732e33e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100974) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Nov 23 13:01:23.296439 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-9c214231-c2f8-4933-9ca8-f8e9b935bcea tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.051002 Nov 23 13:01:23.297167 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-c1237ea9-a562-42c8-afe5-1a556648b1f3 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb98e201f2f41b18735465a450909ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d331da092466b8d717a7e039a5b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:01:23.297666 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 170/351] 10.222.0.60 () {60 vars in 1146 bytes} [Tue Nov 23 13:01:22 2021] POST /compute/v2.1/servers => generated 380 bytes in 1055 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 23 13:01:23.303287 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-3de18c34-e90a-4d50-ac06-942868b9bbe0 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:23.304273 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-3de18c34-e90a-4d50-ac06-942868b9bbe0 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] [instance: 0c7618d8-89ce-43e8-b243-3b6e2647e9b7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:23.312519 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-c1237ea9-a562-42c8-afe5-1a556648b1f3 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] 10.222.0.60 "GET /compute/v2.1/servers/979f72d5-fadc-4b59-ace6-6b8b350a63d9" status: 200 len: 1471 microversion: 2.1 time: 0.386453 Nov 23 13:01:23.314253 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 182/352] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:01:22 2021] GET /compute/v2.1/servers/979f72d5-fadc-4b59-ace6-6b8b350a63d9 => generated 1471 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:01:23.321854 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-4bb8e91f-6c97-4f41-a096-68a5e9441623 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:23.322458 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-4bb8e91f-6c97-4f41-a096-68a5e9441623 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: 12bb9b8b-86ee-463f-a3be-95894290b739] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:23.326386 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3de18c34-e90a-4d50-ac06-942868b9bbe0 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:23.326861 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3de18c34-e90a-4d50-ac06-942868b9bbe0 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:23.327667 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3de18c34-e90a-4d50-ac06-942868b9bbe0 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:23.328090 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3de18c34-e90a-4d50-ac06-942868b9bbe0 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:23.471622 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-4bb8e91f-6c97-4f41-a096-68a5e9441623 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c023f89fd3da4bc8b38963bed4e5cc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a31364455dc442f8df299a8ad758a4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:01:23.482038 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-4bb8e91f-6c97-4f41-a096-68a5e9441623 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/12bb9b8b-86ee-463f-a3be-95894290b739" status: 200 len: 1218 microversion: 2.1 time: 0.165181 Nov 23 13:01:23.482794 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 183/353] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:01:23 2021] GET /compute/v2.1/servers/12bb9b8b-86ee-463f-a3be-95894290b739 => generated 1218 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:01:23.487668 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-8262ba2e-4376-418f-b06b-e509a9b90611 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:23.488281 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-8262ba2e-4376-418f-b06b-e509a9b90611 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: 53633a05-ad06-454a-b540-5fc01821ae45] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:23.517712 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8262ba2e-4376-418f-b06b-e509a9b90611 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:23.518154 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8262ba2e-4376-418f-b06b-e509a9b90611 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:23.518924 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8262ba2e-4376-418f-b06b-e509a9b90611 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:23.520656 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8262ba2e-4376-418f-b06b-e509a9b90611 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:23.540447 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-3de18c34-e90a-4d50-ac06-942868b9bbe0 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0fe7fa96d645ecbc1e50fb5595971d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306daa81c2794164a38ae7bc3b322ef2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:01:23.552464 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-3de18c34-e90a-4d50-ac06-942868b9bbe0 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] 10.222.0.60 "GET /compute/v2.1/servers/0c7618d8-89ce-43e8-b243-3b6e2647e9b7" status: 200 len: 1266 microversion: 2.1 time: 0.253450 Nov 23 13:01:23.553049 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 171/354] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:01:23 2021] GET /compute/v2.1/servers/0c7618d8-89ce-43e8-b243-3b6e2647e9b7 => generated 1266 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:01:23.809155 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-8262ba2e-4376-418f-b06b-e509a9b90611 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:01:23.819586 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-8262ba2e-4376-418f-b06b-e509a9b90611 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45" status: 200 len: 1518 microversion: 2.1 time: 0.335587 Nov 23 13:01:23.820176 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 184/355] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:01:23 2021] GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45 => generated 1518 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:01:23.930663 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-988dd0d5-ac2b-4ffc-814e-85fb22c0c279 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:01:23.931662 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-988dd0d5-ac2b-4ffc-814e-85fb22c0c279 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:23.939513 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-988dd0d5-ac2b-4ffc-814e-85fb22c0c279 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:23.939961 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-988dd0d5-ac2b-4ffc-814e-85fb22c0c279 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:23.940749 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-988dd0d5-ac2b-4ffc-814e-85fb22c0c279 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:23.941182 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-988dd0d5-ac2b-4ffc-814e-85fb22c0c279 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:24.331919 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-152e5487-518e-4ed3-bcc8-14c9e4d13756 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:24.332573 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-152e5487-518e-4ed3-bcc8-14c9e4d13756 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] [instance: 979f72d5-fadc-4b59-ace6-6b8b350a63d9] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:24.341045 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-152e5487-518e-4ed3-bcc8-14c9e4d13756 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:24.341233 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-152e5487-518e-4ed3-bcc8-14c9e4d13756 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:24.341977 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-152e5487-518e-4ed3-bcc8-14c9e4d13756 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:24.342404 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-152e5487-518e-4ed3-bcc8-14c9e4d13756 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:24.551374 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-152e5487-518e-4ed3-bcc8-14c9e4d13756 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb98e201f2f41b18735465a450909ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d331da092466b8d717a7e039a5b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:01:24.560024 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-152e5487-518e-4ed3-bcc8-14c9e4d13756 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] 10.222.0.60 "GET /compute/v2.1/servers/979f72d5-fadc-4b59-ace6-6b8b350a63d9" status: 200 len: 1471 microversion: 2.1 time: 0.231704 Nov 23 13:01:24.560990 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 185/356] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:01:24 2021] GET /compute/v2.1/servers/979f72d5-fadc-4b59-ace6-6b8b350a63d9 => generated 1471 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:01:24.567288 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-515fee41-c193-43bb-8a30-ab244261ff50 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:24.567872 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-515fee41-c193-43bb-8a30-ab244261ff50 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: 12bb9b8b-86ee-463f-a3be-95894290b739] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:24.578547 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-515fee41-c193-43bb-8a30-ab244261ff50 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:24.578995 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-515fee41-c193-43bb-8a30-ab244261ff50 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:24.579766 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-515fee41-c193-43bb-8a30-ab244261ff50 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:24.580188 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-515fee41-c193-43bb-8a30-ab244261ff50 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:24.700660 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-515fee41-c193-43bb-8a30-ab244261ff50 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c023f89fd3da4bc8b38963bed4e5cc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a31364455dc442f8df299a8ad758a4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:01:24.709712 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-515fee41-c193-43bb-8a30-ab244261ff50 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/12bb9b8b-86ee-463f-a3be-95894290b739" status: 200 len: 1222 microversion: 2.1 time: 0.147262 Nov 23 13:01:24.710312 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 186/357] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:01:24 2021] GET /compute/v2.1/servers/12bb9b8b-86ee-463f-a3be-95894290b739 => generated 1222 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:01:24.714603 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-0e64db24-6ea6-4f52-ada9-2c1f7bbcae73 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:24.715175 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-0e64db24-6ea6-4f52-ada9-2c1f7bbcae73 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] [instance: 0c7618d8-89ce-43e8-b243-3b6e2647e9b7] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:24.722971 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0e64db24-6ea6-4f52-ada9-2c1f7bbcae73 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:24.723415 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0e64db24-6ea6-4f52-ada9-2c1f7bbcae73 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:24.724192 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0e64db24-6ea6-4f52-ada9-2c1f7bbcae73 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:24.724653 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0e64db24-6ea6-4f52-ada9-2c1f7bbcae73 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:24.839898 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-0e64db24-6ea6-4f52-ada9-2c1f7bbcae73 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0fe7fa96d645ecbc1e50fb5595971d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306daa81c2794164a38ae7bc3b322ef2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:01:24.848511 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-0e64db24-6ea6-4f52-ada9-2c1f7bbcae73 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] 10.222.0.60 "GET /compute/v2.1/servers/0c7618d8-89ce-43e8-b243-3b6e2647e9b7" status: 200 len: 1266 microversion: 2.1 time: 0.137156 Nov 23 13:01:24.849111 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 187/358] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:01:24 2021] GET /compute/v2.1/servers/0c7618d8-89ce-43e8-b243-3b6e2647e9b7 => generated 1266 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:01:24.853391 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-9b4f5642-a61a-4236-9aa7-a03a2d8371c4 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:24.853995 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-9b4f5642-a61a-4236-9aa7-a03a2d8371c4 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: 53633a05-ad06-454a-b540-5fc01821ae45] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:24.861638 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-9b4f5642-a61a-4236-9aa7-a03a2d8371c4 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:24.862084 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-9b4f5642-a61a-4236-9aa7-a03a2d8371c4 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:24.862847 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-9b4f5642-a61a-4236-9aa7-a03a2d8371c4 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:24.863283 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-9b4f5642-a61a-4236-9aa7-a03a2d8371c4 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:25.077622 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-9b4f5642-a61a-4236-9aa7-a03a2d8371c4 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:01:25.086566 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-9b4f5642-a61a-4236-9aa7-a03a2d8371c4 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45" status: 200 len: 1518 microversion: 2.1 time: 0.236458 Nov 23 13:01:25.087189 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 188/359] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:01:24 2021] GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45 => generated 1518 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:01:25.578039 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-2fe52458-ba12-4926-bb36-700e990bb3ba tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:25.578766 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-2fe52458-ba12-4926-bb36-700e990bb3ba tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] [instance: 979f72d5-fadc-4b59-ace6-6b8b350a63d9] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:25.590169 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-2fe52458-ba12-4926-bb36-700e990bb3ba tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:25.590643 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-2fe52458-ba12-4926-bb36-700e990bb3ba tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:25.592423 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-2fe52458-ba12-4926-bb36-700e990bb3ba tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:25.593142 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-2fe52458-ba12-4926-bb36-700e990bb3ba tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:25.801720 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-2fe52458-ba12-4926-bb36-700e990bb3ba tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb98e201f2f41b18735465a450909ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d331da092466b8d717a7e039a5b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:01:25.810573 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-2fe52458-ba12-4926-bb36-700e990bb3ba tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] 10.222.0.60 "GET /compute/v2.1/servers/979f72d5-fadc-4b59-ace6-6b8b350a63d9" status: 200 len: 1471 microversion: 2.1 time: 0.236570 Nov 23 13:01:25.818805 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 189/360] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:01:25 2021] GET /compute/v2.1/servers/979f72d5-fadc-4b59-ace6-6b8b350a63d9 => generated 1471 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 13:01:25.818805 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-e03785e2-a883-457b-9c4a-883b10555e58 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:25.818805 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-e03785e2-a883-457b-9c4a-883b10555e58 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: 12bb9b8b-86ee-463f-a3be-95894290b739] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:25.823668 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e03785e2-a883-457b-9c4a-883b10555e58 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:25.824189 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e03785e2-a883-457b-9c4a-883b10555e58 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:25.825086 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e03785e2-a883-457b-9c4a-883b10555e58 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:25.825642 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e03785e2-a883-457b-9c4a-883b10555e58 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:25.937514 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-e03785e2-a883-457b-9c4a-883b10555e58 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c023f89fd3da4bc8b38963bed4e5cc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a31364455dc442f8df299a8ad758a4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:01:25.946111 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-e03785e2-a883-457b-9c4a-883b10555e58 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/12bb9b8b-86ee-463f-a3be-95894290b739" status: 200 len: 1222 microversion: 2.1 time: 0.133883 Nov 23 13:01:25.946672 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 190/361] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:01:25 2021] GET /compute/v2.1/servers/12bb9b8b-86ee-463f-a3be-95894290b739 => generated 1222 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:01:25.951423 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-206c33ce-9796-4b6d-8437-20f8e1dd2192 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:25.952804 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-206c33ce-9796-4b6d-8437-20f8e1dd2192 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] [instance: 0c7618d8-89ce-43e8-b243-3b6e2647e9b7] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:25.961214 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-206c33ce-9796-4b6d-8437-20f8e1dd2192 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:25.961658 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-206c33ce-9796-4b6d-8437-20f8e1dd2192 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:25.962441 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-206c33ce-9796-4b6d-8437-20f8e1dd2192 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:25.962866 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-206c33ce-9796-4b6d-8437-20f8e1dd2192 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:26.090241 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-206c33ce-9796-4b6d-8437-20f8e1dd2192 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0fe7fa96d645ecbc1e50fb5595971d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306daa81c2794164a38ae7bc3b322ef2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:01:26.099255 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-206c33ce-9796-4b6d-8437-20f8e1dd2192 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] 10.222.0.60 "GET /compute/v2.1/servers/0c7618d8-89ce-43e8-b243-3b6e2647e9b7" status: 200 len: 1266 microversion: 2.1 time: 0.151559 Nov 23 13:01:26.099831 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 191/362] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:01:25 2021] GET /compute/v2.1/servers/0c7618d8-89ce-43e8-b243-3b6e2647e9b7 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:01:26.104313 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-91282c1d-4bef-4a67-ac11-cac5f3281fc3 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:26.104899 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-91282c1d-4bef-4a67-ac11-cac5f3281fc3 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: 53633a05-ad06-454a-b540-5fc01821ae45] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:26.112451 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-91282c1d-4bef-4a67-ac11-cac5f3281fc3 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:26.112890 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-91282c1d-4bef-4a67-ac11-cac5f3281fc3 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:26.113645 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-91282c1d-4bef-4a67-ac11-cac5f3281fc3 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:26.114070 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-91282c1d-4bef-4a67-ac11-cac5f3281fc3 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:26.325888 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-91282c1d-4bef-4a67-ac11-cac5f3281fc3 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:01:26.335144 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-91282c1d-4bef-4a67-ac11-cac5f3281fc3 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45" status: 200 len: 1518 microversion: 2.1 time: 0.234263 Nov 23 13:01:26.335715 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 192/363] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:01:26 2021] GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45 => generated 1518 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:01:26.830458 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-c486615a-55e7-4b06-8bad-505c02d9571e tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:26.831513 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-c486615a-55e7-4b06-8bad-505c02d9571e tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] [instance: 979f72d5-fadc-4b59-ace6-6b8b350a63d9] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:26.839630 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c486615a-55e7-4b06-8bad-505c02d9571e tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:26.840188 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c486615a-55e7-4b06-8bad-505c02d9571e tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:26.841430 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c486615a-55e7-4b06-8bad-505c02d9571e tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:26.842141 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c486615a-55e7-4b06-8bad-505c02d9571e tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:27.102327 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-c486615a-55e7-4b06-8bad-505c02d9571e tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb98e201f2f41b18735465a450909ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d331da092466b8d717a7e039a5b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:01:27.113889 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-c486615a-55e7-4b06-8bad-505c02d9571e tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] 10.222.0.60 "GET /compute/v2.1/servers/979f72d5-fadc-4b59-ace6-6b8b350a63d9" status: 200 len: 1471 microversion: 2.1 time: 0.288221 Nov 23 13:01:27.115620 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 193/364] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:01:26 2021] GET /compute/v2.1/servers/979f72d5-fadc-4b59-ace6-6b8b350a63d9 => generated 1471 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 13:01:27.120470 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-f76c5ce5-bc9b-4c7f-8076-a8c365dd3214 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:27.121093 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-f76c5ce5-bc9b-4c7f-8076-a8c365dd3214 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: 12bb9b8b-86ee-463f-a3be-95894290b739] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:27.129970 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f76c5ce5-bc9b-4c7f-8076-a8c365dd3214 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:27.130408 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f76c5ce5-bc9b-4c7f-8076-a8c365dd3214 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:27.131201 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f76c5ce5-bc9b-4c7f-8076-a8c365dd3214 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:27.131634 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f76c5ce5-bc9b-4c7f-8076-a8c365dd3214 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:27.277480 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-f76c5ce5-bc9b-4c7f-8076-a8c365dd3214 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c023f89fd3da4bc8b38963bed4e5cc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a31364455dc442f8df299a8ad758a4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:01:27.290783 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-f76c5ce5-bc9b-4c7f-8076-a8c365dd3214 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/12bb9b8b-86ee-463f-a3be-95894290b739" status: 200 len: 1222 microversion: 2.1 time: 0.173933 Nov 23 13:01:27.291386 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 194/365] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:01:27 2021] GET /compute/v2.1/servers/12bb9b8b-86ee-463f-a3be-95894290b739 => generated 1222 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:01:27.296064 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-b5e11d44-10ff-493b-9850-665e430e0a1b tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:27.296692 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-b5e11d44-10ff-493b-9850-665e430e0a1b tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] [instance: 0c7618d8-89ce-43e8-b243-3b6e2647e9b7] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:27.305114 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b5e11d44-10ff-493b-9850-665e430e0a1b tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:27.305577 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b5e11d44-10ff-493b-9850-665e430e0a1b tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:27.306348 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b5e11d44-10ff-493b-9850-665e430e0a1b tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:27.306783 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b5e11d44-10ff-493b-9850-665e430e0a1b tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:27.434427 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-b5e11d44-10ff-493b-9850-665e430e0a1b tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0fe7fa96d645ecbc1e50fb5595971d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306daa81c2794164a38ae7bc3b322ef2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:01:27.450378 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-b5e11d44-10ff-493b-9850-665e430e0a1b tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] 10.222.0.60 "GET /compute/v2.1/servers/0c7618d8-89ce-43e8-b243-3b6e2647e9b7" status: 200 len: 1266 microversion: 2.1 time: 0.157431 Nov 23 13:01:27.451749 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 195/366] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:01:27 2021] GET /compute/v2.1/servers/0c7618d8-89ce-43e8-b243-3b6e2647e9b7 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:01:27.457522 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-06007950-0f3c-414d-8af2-d23b6958ffb5 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:27.458260 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-06007950-0f3c-414d-8af2-d23b6958ffb5 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: 53633a05-ad06-454a-b540-5fc01821ae45] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:27.466021 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-06007950-0f3c-414d-8af2-d23b6958ffb5 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:27.466816 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-06007950-0f3c-414d-8af2-d23b6958ffb5 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:27.467608 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-06007950-0f3c-414d-8af2-d23b6958ffb5 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:27.468015 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-06007950-0f3c-414d-8af2-d23b6958ffb5 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:27.668031 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-06007950-0f3c-414d-8af2-d23b6958ffb5 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:01:27.677412 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-06007950-0f3c-414d-8af2-d23b6958ffb5 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45" status: 200 len: 1518 microversion: 2.1 time: 0.224644 Nov 23 13:01:27.677986 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 196/367] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:01:27 2021] GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45 => generated 1518 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:01:28.136557 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-4f626761-978a-4770-b05b-a6103a588fce tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:28.137669 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-4f626761-978a-4770-b05b-a6103a588fce tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] [instance: 979f72d5-fadc-4b59-ace6-6b8b350a63d9] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:28.145810 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4f626761-978a-4770-b05b-a6103a588fce tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:28.146271 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4f626761-978a-4770-b05b-a6103a588fce tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:28.147032 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4f626761-978a-4770-b05b-a6103a588fce tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:28.147478 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4f626761-978a-4770-b05b-a6103a588fce tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:28.279856 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-988dd0d5-ac2b-4ffc-814e-85fb22c0c279 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action" status: 200 len: 28213 microversion: 2.20 time: 4.352245 Nov 23 13:01:28.283606 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 172/368] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:01:23 2021] POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action => generated 28213 bytes in 4357 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:01:28.308874 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-bfacbcac-f936-4c4b-a4b0-76eee365a479 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:28.309739 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-bfacbcac-f936-4c4b-a4b0-76eee365a479 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: 12bb9b8b-86ee-463f-a3be-95894290b739] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:28.318800 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-bfacbcac-f936-4c4b-a4b0-76eee365a479 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:28.318800 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-bfacbcac-f936-4c4b-a4b0-76eee365a479 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:28.319626 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-bfacbcac-f936-4c4b-a4b0-76eee365a479 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:28.320298 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-bfacbcac-f936-4c4b-a4b0-76eee365a479 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:28.373270 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-4f626761-978a-4770-b05b-a6103a588fce tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb98e201f2f41b18735465a450909ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d331da092466b8d717a7e039a5b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:01:28.382329 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-4f626761-978a-4770-b05b-a6103a588fce tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] 10.222.0.60 "GET /compute/v2.1/servers/979f72d5-fadc-4b59-ace6-6b8b350a63d9" status: 200 len: 1471 microversion: 2.1 time: 0.252234 Nov 23 13:01:28.383291 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 197/369] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:01:28 2021] GET /compute/v2.1/servers/979f72d5-fadc-4b59-ace6-6b8b350a63d9 => generated 1471 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:01:28.442177 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-bfacbcac-f936-4c4b-a4b0-76eee365a479 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c023f89fd3da4bc8b38963bed4e5cc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a31364455dc442f8df299a8ad758a4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:01:28.458848 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-bfacbcac-f936-4c4b-a4b0-76eee365a479 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/12bb9b8b-86ee-463f-a3be-95894290b739" status: 200 len: 1222 microversion: 2.1 time: 0.154099 Nov 23 13:01:28.459618 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 173/370] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:01:28 2021] GET /compute/v2.1/servers/12bb9b8b-86ee-463f-a3be-95894290b739 => generated 1222 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:01:28.473657 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-759ce811-8480-4228-ba70-d66fd0857363 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:28.474330 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-759ce811-8480-4228-ba70-d66fd0857363 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] [instance: 0c7618d8-89ce-43e8-b243-3b6e2647e9b7] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:28.482369 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-759ce811-8480-4228-ba70-d66fd0857363 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:28.482895 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-759ce811-8480-4228-ba70-d66fd0857363 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:28.483728 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-759ce811-8480-4228-ba70-d66fd0857363 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:28.484224 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-759ce811-8480-4228-ba70-d66fd0857363 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:28.638615 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-759ce811-8480-4228-ba70-d66fd0857363 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0fe7fa96d645ecbc1e50fb5595971d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306daa81c2794164a38ae7bc3b322ef2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:01:28.647659 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-759ce811-8480-4228-ba70-d66fd0857363 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] 10.222.0.60 "GET /compute/v2.1/servers/0c7618d8-89ce-43e8-b243-3b6e2647e9b7" status: 200 len: 1274 microversion: 2.1 time: 0.178224 Nov 23 13:01:28.648819 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 198/371] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:01:28 2021] GET /compute/v2.1/servers/0c7618d8-89ce-43e8-b243-3b6e2647e9b7 => generated 1274 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:01:28.697511 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-d2f07da1-c409-4a18-b403-e80ef6cbadb1 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:28.698036 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-d2f07da1-c409-4a18-b403-e80ef6cbadb1 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: 53633a05-ad06-454a-b540-5fc01821ae45] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:28.708677 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d2f07da1-c409-4a18-b403-e80ef6cbadb1 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:28.709134 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d2f07da1-c409-4a18-b403-e80ef6cbadb1 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:28.709938 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d2f07da1-c409-4a18-b403-e80ef6cbadb1 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:28.710401 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d2f07da1-c409-4a18-b403-e80ef6cbadb1 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:29.018182 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-d2f07da1-c409-4a18-b403-e80ef6cbadb1 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:01:29.027364 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-d2f07da1-c409-4a18-b403-e80ef6cbadb1 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45" status: 200 len: 1518 microversion: 2.1 time: 0.334099 Nov 23 13:01:29.027944 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 174/372] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:01:28 2021] GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45 => generated 1518 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:01:29.294925 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-27532b08-3abb-4e56-96f3-c3021431ae13 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:01:29.296164 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-27532b08-3abb-4e56-96f3-c3021431ae13 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:29.305155 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-27532b08-3abb-4e56-96f3-c3021431ae13 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:29.305609 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-27532b08-3abb-4e56-96f3-c3021431ae13 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:29.306395 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-27532b08-3abb-4e56-96f3-c3021431ae13 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:29.306827 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-27532b08-3abb-4e56-96f3-c3021431ae13 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:29.398822 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-feb91183-2457-4bc0-bb9a-f387c7355eb0 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:29.399429 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-feb91183-2457-4bc0-bb9a-f387c7355eb0 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] [instance: 979f72d5-fadc-4b59-ace6-6b8b350a63d9] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:29.407125 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-feb91183-2457-4bc0-bb9a-f387c7355eb0 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:29.407593 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-feb91183-2457-4bc0-bb9a-f387c7355eb0 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:29.408405 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-feb91183-2457-4bc0-bb9a-f387c7355eb0 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:29.408837 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-feb91183-2457-4bc0-bb9a-f387c7355eb0 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:29.511635 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-27532b08-3abb-4e56-96f3-c3021431ae13 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action" status: 200 len: 28213 microversion: 2.20 time: 0.220469 Nov 23 13:01:29.512625 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 199/373] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:01:29 2021] POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action => generated 28213 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:01:29.521311 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-f0b159c9-6fea-4c67-8ac1-a749cb9767e6 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:29.522022 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-f0b159c9-6fea-4c67-8ac1-a749cb9767e6 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: 12bb9b8b-86ee-463f-a3be-95894290b739] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:29.530757 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f0b159c9-6fea-4c67-8ac1-a749cb9767e6 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:29.531204 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f0b159c9-6fea-4c67-8ac1-a749cb9767e6 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:29.531985 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f0b159c9-6fea-4c67-8ac1-a749cb9767e6 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:29.532451 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f0b159c9-6fea-4c67-8ac1-a749cb9767e6 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:29.659421 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-f0b159c9-6fea-4c67-8ac1-a749cb9767e6 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c023f89fd3da4bc8b38963bed4e5cc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a31364455dc442f8df299a8ad758a4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:01:29.670148 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-f0b159c9-6fea-4c67-8ac1-a749cb9767e6 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/12bb9b8b-86ee-463f-a3be-95894290b739" status: 200 len: 1278 microversion: 2.1 time: 0.152801 Nov 23 13:01:29.670857 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 200/374] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:01:29 2021] GET /compute/v2.1/servers/12bb9b8b-86ee-463f-a3be-95894290b739 => generated 1278 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:01:29.675568 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-108aefe1-dd01-4dbc-bb2d-861dcdfaa686 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:29.676322 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-108aefe1-dd01-4dbc-bb2d-861dcdfaa686 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] [instance: 0c7618d8-89ce-43e8-b243-3b6e2647e9b7] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:29.684947 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-108aefe1-dd01-4dbc-bb2d-861dcdfaa686 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:29.685567 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-108aefe1-dd01-4dbc-bb2d-861dcdfaa686 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:29.686430 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-108aefe1-dd01-4dbc-bb2d-861dcdfaa686 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:29.686928 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-108aefe1-dd01-4dbc-bb2d-861dcdfaa686 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:29.725686 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-feb91183-2457-4bc0-bb9a-f387c7355eb0 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb98e201f2f41b18735465a450909ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d331da092466b8d717a7e039a5b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:01:29.738232 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-feb91183-2457-4bc0-bb9a-f387c7355eb0 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] 10.222.0.60 "GET /compute/v2.1/servers/979f72d5-fadc-4b59-ace6-6b8b350a63d9" status: 200 len: 1471 microversion: 2.1 time: 0.342378 Nov 23 13:01:29.739205 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 175/375] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:01:29 2021] GET /compute/v2.1/servers/979f72d5-fadc-4b59-ace6-6b8b350a63d9 => generated 1471 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 13:01:29.932916 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-108aefe1-dd01-4dbc-bb2d-861dcdfaa686 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0fe7fa96d645ecbc1e50fb5595971d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306daa81c2794164a38ae7bc3b322ef2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:01:29.942548 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-108aefe1-dd01-4dbc-bb2d-861dcdfaa686 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] 10.222.0.60 "GET /compute/v2.1/servers/0c7618d8-89ce-43e8-b243-3b6e2647e9b7" status: 200 len: 1314 microversion: 2.1 time: 0.270500 Nov 23 13:01:29.943126 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 201/376] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:01:29 2021] GET /compute/v2.1/servers/0c7618d8-89ce-43e8-b243-3b6e2647e9b7 => generated 1314 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:01:30.045408 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-fc7b57ca-b818-4aed-bd02-c02bf43b4463 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:30.046199 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-fc7b57ca-b818-4aed-bd02-c02bf43b4463 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: 53633a05-ad06-454a-b540-5fc01821ae45] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:30.057454 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-fc7b57ca-b818-4aed-bd02-c02bf43b4463 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:30.058008 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-fc7b57ca-b818-4aed-bd02-c02bf43b4463 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:30.058675 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-fc7b57ca-b818-4aed-bd02-c02bf43b4463 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:30.059482 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-fc7b57ca-b818-4aed-bd02-c02bf43b4463 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:30.524174 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-9df1c887-155f-4136-9d7f-2950506ad1fa tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:01:30.525236 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-9df1c887-155f-4136-9d7f-2950506ad1fa tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:30.533260 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-9df1c887-155f-4136-9d7f-2950506ad1fa tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:30.533697 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-9df1c887-155f-4136-9d7f-2950506ad1fa tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:30.534474 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-9df1c887-155f-4136-9d7f-2950506ad1fa tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:30.534894 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-9df1c887-155f-4136-9d7f-2950506ad1fa tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:30.611360 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-fc7b57ca-b818-4aed-bd02-c02bf43b4463 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:01:30.620115 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-fc7b57ca-b818-4aed-bd02-c02bf43b4463 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45" status: 200 len: 1518 microversion: 2.1 time: 0.578557 Nov 23 13:01:30.620932 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 176/377] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:01:30 2021] GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45 => generated 1518 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:01:30.687644 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-4a0436d9-d230-4000-81f3-b7bc45c082b2 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:30.688536 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-4a0436d9-d230-4000-81f3-b7bc45c082b2 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: 12bb9b8b-86ee-463f-a3be-95894290b739] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:30.696042 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-4a0436d9-d230-4000-81f3-b7bc45c082b2 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:30.696518 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-4a0436d9-d230-4000-81f3-b7bc45c082b2 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:30.697490 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-4a0436d9-d230-4000-81f3-b7bc45c082b2 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:30.697926 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-4a0436d9-d230-4000-81f3-b7bc45c082b2 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:30.908988 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-4a0436d9-d230-4000-81f3-b7bc45c082b2 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c023f89fd3da4bc8b38963bed4e5cc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a31364455dc442f8df299a8ad758a4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:01:30.917935 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-4a0436d9-d230-4000-81f3-b7bc45c082b2 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/12bb9b8b-86ee-463f-a3be-95894290b739" status: 200 len: 1276 microversion: 2.1 time: 0.234513 Nov 23 13:01:30.918629 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 177/378] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:01:30 2021] GET /compute/v2.1/servers/12bb9b8b-86ee-463f-a3be-95894290b739 => generated 1276 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:01:30.924452 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-e150cf5b-7b0d-4dc3-9003-24cd9bf29c48 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:30.925181 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-e150cf5b-7b0d-4dc3-9003-24cd9bf29c48 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] [instance: 979f72d5-fadc-4b59-ace6-6b8b350a63d9] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:30.933215 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e150cf5b-7b0d-4dc3-9003-24cd9bf29c48 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:30.933872 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e150cf5b-7b0d-4dc3-9003-24cd9bf29c48 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:30.935160 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e150cf5b-7b0d-4dc3-9003-24cd9bf29c48 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:30.935854 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e150cf5b-7b0d-4dc3-9003-24cd9bf29c48 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:30.939359 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-9df1c887-155f-4136-9d7f-2950506ad1fa tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action" status: 200 len: 28213 microversion: 2.20 time: 0.418613 Nov 23 13:01:30.940715 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 202/379] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:01:30 2021] POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action => generated 28213 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 13:01:30.960081 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-4f1054b8-119f-4189-8d5e-215b7a389e2b tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:30.960969 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-4f1054b8-119f-4189-8d5e-215b7a389e2b tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] [instance: 0c7618d8-89ce-43e8-b243-3b6e2647e9b7] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:30.970249 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4f1054b8-119f-4189-8d5e-215b7a389e2b tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:30.971105 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4f1054b8-119f-4189-8d5e-215b7a389e2b tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:30.972045 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4f1054b8-119f-4189-8d5e-215b7a389e2b tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:30.972504 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4f1054b8-119f-4189-8d5e-215b7a389e2b tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:31.350574 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-4f1054b8-119f-4189-8d5e-215b7a389e2b tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0fe7fa96d645ecbc1e50fb5595971d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306daa81c2794164a38ae7bc3b322ef2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:01:31.361652 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-4f1054b8-119f-4189-8d5e-215b7a389e2b tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] 10.222.0.60 "GET /compute/v2.1/servers/0c7618d8-89ce-43e8-b243-3b6e2647e9b7" status: 200 len: 1314 microversion: 2.1 time: 0.406212 Nov 23 13:01:31.372312 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 203/380] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:01:30 2021] GET /compute/v2.1/servers/0c7618d8-89ce-43e8-b243-3b6e2647e9b7 => generated 1314 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 13:01:31.638683 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-e150cf5b-7b0d-4dc3-9003-24cd9bf29c48 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb98e201f2f41b18735465a450909ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d331da092466b8d717a7e039a5b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:01:31.646425 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-924fd4c6-80a0-47e2-aefd-8786a6702135 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:31.647586 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-924fd4c6-80a0-47e2-aefd-8786a6702135 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: 53633a05-ad06-454a-b540-5fc01821ae45] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:31.655188 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-e150cf5b-7b0d-4dc3-9003-24cd9bf29c48 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] 10.222.0.60 "GET /compute/v2.1/servers/979f72d5-fadc-4b59-ace6-6b8b350a63d9" status: 200 len: 1471 microversion: 2.1 time: 0.735064 Nov 23 13:01:31.665478 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 178/381] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:01:30 2021] GET /compute/v2.1/servers/979f72d5-fadc-4b59-ace6-6b8b350a63d9 => generated 1471 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:01:31.670167 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-924fd4c6-80a0-47e2-aefd-8786a6702135 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:31.670969 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-924fd4c6-80a0-47e2-aefd-8786a6702135 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:31.673385 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-924fd4c6-80a0-47e2-aefd-8786a6702135 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:31.673707 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-924fd4c6-80a0-47e2-aefd-8786a6702135 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:31.935675 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-7c11b7dd-a99c-4327-9f54-9003394c4e82 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:31.936511 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-7c11b7dd-a99c-4327-9f54-9003394c4e82 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: 12bb9b8b-86ee-463f-a3be-95894290b739] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:31.949381 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7c11b7dd-a99c-4327-9f54-9003394c4e82 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:31.951105 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7c11b7dd-a99c-4327-9f54-9003394c4e82 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:31.954641 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7c11b7dd-a99c-4327-9f54-9003394c4e82 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:31.955727 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7c11b7dd-a99c-4327-9f54-9003394c4e82 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:32.513025 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-924fd4c6-80a0-47e2-aefd-8786a6702135 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:01:32.525988 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-924fd4c6-80a0-47e2-aefd-8786a6702135 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45" status: 200 len: 1518 microversion: 2.1 time: 0.888947 Nov 23 13:01:32.526817 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 204/382] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:01:31 2021] GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45 => generated 1518 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:01:32.541699 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-cd442ab8-69a2-4eb6-bc5b-a9a7f8f3de29 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:01:32.541699 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-cd442ab8-69a2-4eb6-bc5b-a9a7f8f3de29 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:32.565499 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-cd442ab8-69a2-4eb6-bc5b-a9a7f8f3de29 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:32.565948 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-cd442ab8-69a2-4eb6-bc5b-a9a7f8f3de29 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:32.566952 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-cd442ab8-69a2-4eb6-bc5b-a9a7f8f3de29 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:32.567393 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-cd442ab8-69a2-4eb6-bc5b-a9a7f8f3de29 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:32.807512 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-cd442ab8-69a2-4eb6-bc5b-a9a7f8f3de29 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action" status: 200 len: 28213 microversion: 2.20 time: 0.277628 Nov 23 13:01:32.808602 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 205/383] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:01:32 2021] POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action => generated 28213 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:01:32.817412 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-5daf5644-052b-42a8-898b-2c88d5bb48dd tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:32.818443 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-5daf5644-052b-42a8-898b-2c88d5bb48dd tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] [instance: 0c7618d8-89ce-43e8-b243-3b6e2647e9b7] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:32.840776 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5daf5644-052b-42a8-898b-2c88d5bb48dd tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:32.841535 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5daf5644-052b-42a8-898b-2c88d5bb48dd tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:32.842526 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5daf5644-052b-42a8-898b-2c88d5bb48dd tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:32.843107 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5daf5644-052b-42a8-898b-2c88d5bb48dd tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:33.249776 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-7c11b7dd-a99c-4327-9f54-9003394c4e82 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c023f89fd3da4bc8b38963bed4e5cc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a31364455dc442f8df299a8ad758a4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:01:33.257854 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-5daf5644-052b-42a8-898b-2c88d5bb48dd tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0fe7fa96d645ecbc1e50fb5595971d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306daa81c2794164a38ae7bc3b322ef2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:01:33.270850 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-5daf5644-052b-42a8-898b-2c88d5bb48dd tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] 10.222.0.60 "GET /compute/v2.1/servers/0c7618d8-89ce-43e8-b243-3b6e2647e9b7" status: 200 len: 1314 microversion: 2.1 time: 0.459399 Nov 23 13:01:33.272377 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 206/384] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:01:32 2021] GET /compute/v2.1/servers/0c7618d8-89ce-43e8-b243-3b6e2647e9b7 => generated 1314 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:01:33.285040 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-7c11b7dd-a99c-4327-9f54-9003394c4e82 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/12bb9b8b-86ee-463f-a3be-95894290b739" status: 200 len: 1318 microversion: 2.1 time: 1.351929 Nov 23 13:01:33.286043 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [req-41eb81fd-45e7-4c0c-999b-9e0e58c82db8 req-3b0e7c91-ff12-4a45-aabd-3173f67a3bf1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c7618d8-89ce-43e8-b243-3b6e2647e9b7", "tag": "56555464-8803-4bc7-b12c-00625c5092d6"}]} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:01:33.286669 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 179/385] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:01:31 2021] GET /compute/v2.1/servers/12bb9b8b-86ee-463f-a3be-95894290b739 => generated 1318 bytes in 1356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 13:01:33.301956 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-a2e81520-6d9c-4313-8927-a42a6d926cf0 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:33.304092 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 13:01:33.304092 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: warnings.warn(msg) Nov 23 13:01:33.305376 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-a2e81520-6d9c-4313-8927-a42a6d926cf0 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] [instance: 979f72d5-fadc-4b59-ace6-6b8b350a63d9] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:33.316082 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a2e81520-6d9c-4313-8927-a42a6d926cf0 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:33.316417 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [req-41eb81fd-45e7-4c0c-999b-9e0e58c82db8 req-3b0e7c91-ff12-4a45-aabd-3173f67a3bf1 service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:33.316766 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [req-41eb81fd-45e7-4c0c-999b-9e0e58c82db8 req-3b0e7c91-ff12-4a45-aabd-3173f67a3bf1 service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:33.317231 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a2e81520-6d9c-4313-8927-a42a6d926cf0 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:33.318301 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a2e81520-6d9c-4313-8927-a42a6d926cf0 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:33.318988 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a2e81520-6d9c-4313-8927-a42a6d926cf0 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:33.357527 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.compute.server_external_events [req-41eb81fd-45e7-4c0c-999b-9e0e58c82db8 req-3b0e7c91-ff12-4a45-aabd-3173f67a3bf1 service nova] Creating event network-changed:56555464-8803-4bc7-b12c-00625c5092d6 for instance 0c7618d8-89ce-43e8-b243-3b6e2647e9b7 on hv-cinder-81888 Nov 23 13:01:33.363081 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [req-41eb81fd-45e7-4c0c-999b-9e0e58c82db8 req-3b0e7c91-ff12-4a45-aabd-3173f67a3bf1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087989 Nov 23 13:01:33.368494 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 207/386] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Nov 23 13:01:33 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 13:01:33.374735 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [req-d32e133d-88de-4f4b-95b0-f38f97a17232 req-93fb7510-b50f-46f4-9999-1d21e24ad88f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "979f72d5-fadc-4b59-ace6-6b8b350a63d9", "name": "network-vif-deleted", "tag": "d1719e73-7614-4f8d-9a1c-396cfa30d9b3"}]} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:01:33.376456 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 13:01:33.376456 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: warnings.warn(msg) Nov 23 13:01:33.386093 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [req-d32e133d-88de-4f4b-95b0-f38f97a17232 req-93fb7510-b50f-46f4-9999-1d21e24ad88f service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:33.386768 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [req-d32e133d-88de-4f4b-95b0-f38f97a17232 req-93fb7510-b50f-46f4-9999-1d21e24ad88f service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:33.401004 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a2e81520-6d9c-4313-8927-a42a6d926cf0 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:33.401489 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a2e81520-6d9c-4313-8927-a42a6d926cf0 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:33.401999 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.objects.instance [None req-a2e81520-6d9c-4313-8927-a42a6d926cf0 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lazy-loading 'fault' on Instance uuid 979f72d5-fadc-4b59-ace6-6b8b350a63d9 {{(pid=100974) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 23 13:01:33.407332 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.compute.server_external_events [req-d32e133d-88de-4f4b-95b0-f38f97a17232 req-93fb7510-b50f-46f4-9999-1d21e24ad88f service nova] Creating event network-vif-deleted:d1719e73-7614-4f8d-9a1c-396cfa30d9b3 for instance 979f72d5-fadc-4b59-ace6-6b8b350a63d9 on hv-cinder-81888 Nov 23 13:01:33.417587 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [req-d32e133d-88de-4f4b-95b0-f38f97a17232 req-93fb7510-b50f-46f4-9999-1d21e24ad88f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047394 Nov 23 13:01:33.419226 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 208/387] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Nov 23 13:01:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 13:01:33.544282 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-c3a45f63-394f-4b63-9ce9-24903d42d27a tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:33.545165 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-c3a45f63-394f-4b63-9ce9-24903d42d27a tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: 53633a05-ad06-454a-b540-5fc01821ae45] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:33.554204 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c3a45f63-394f-4b63-9ce9-24903d42d27a tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:33.554807 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c3a45f63-394f-4b63-9ce9-24903d42d27a tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:33.555688 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c3a45f63-394f-4b63-9ce9-24903d42d27a tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:33.556300 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c3a45f63-394f-4b63-9ce9-24903d42d27a tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:33.598935 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-a2e81520-6d9c-4313-8927-a42a6d926cf0 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb98e201f2f41b18735465a450909ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727d331da092466b8d717a7e039a5b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:01:33.617613 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-a2e81520-6d9c-4313-8927-a42a6d926cf0 tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] 10.222.0.60 "GET /compute/v2.1/servers/979f72d5-fadc-4b59-ace6-6b8b350a63d9" status: 200 len: 1305 microversion: 2.1 time: 0.328600 Nov 23 13:01:33.618464 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 180/388] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:01:33 2021] GET /compute/v2.1/servers/979f72d5-fadc-4b59-ace6-6b8b350a63d9 => generated 1305 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:01:33.819875 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-4bef27c8-f45f-4d49-88ac-2af442c7af62 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:01:33.820908 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-4bef27c8-f45f-4d49-88ac-2af442c7af62 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:33.834568 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-4bef27c8-f45f-4d49-88ac-2af442c7af62 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:33.835281 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-4bef27c8-f45f-4d49-88ac-2af442c7af62 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:33.839947 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-4bef27c8-f45f-4d49-88ac-2af442c7af62 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:33.840609 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-4bef27c8-f45f-4d49-88ac-2af442c7af62 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:33.948204 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-c3a45f63-394f-4b63-9ce9-24903d42d27a tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:01:33.958450 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-c3a45f63-394f-4b63-9ce9-24903d42d27a tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45" status: 200 len: 1518 microversion: 2.1 time: 0.418948 Nov 23 13:01:33.962756 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 209/389] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:01:33 2021] GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45 => generated 1518 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 13:01:34.054509 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-4bef27c8-f45f-4d49-88ac-2af442c7af62 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action" status: 200 len: 28213 microversion: 2.20 time: 0.238873 Nov 23 13:01:34.055113 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 181/390] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:01:33 2021] POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action => generated 28213 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 13:01:34.288580 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-0a58ea46-9201-4593-84c1-99372aab1e18 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:34.289291 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-0a58ea46-9201-4593-84c1-99372aab1e18 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] [instance: 0c7618d8-89ce-43e8-b243-3b6e2647e9b7] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:34.303238 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-3d99edae-de72-42e4-b4bd-4a7a4ff068a2 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:34.304231 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-3d99edae-de72-42e4-b4bd-4a7a4ff068a2 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: 12bb9b8b-86ee-463f-a3be-95894290b739] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:34.307849 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0a58ea46-9201-4593-84c1-99372aab1e18 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:34.308256 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0a58ea46-9201-4593-84c1-99372aab1e18 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:34.309156 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0a58ea46-9201-4593-84c1-99372aab1e18 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:34.309517 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0a58ea46-9201-4593-84c1-99372aab1e18 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:34.313274 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3d99edae-de72-42e4-b4bd-4a7a4ff068a2 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:34.313823 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3d99edae-de72-42e4-b4bd-4a7a4ff068a2 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:34.314770 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3d99edae-de72-42e4-b4bd-4a7a4ff068a2 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:34.315173 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3d99edae-de72-42e4-b4bd-4a7a4ff068a2 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:34.570064 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-0a58ea46-9201-4593-84c1-99372aab1e18 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0fe7fa96d645ecbc1e50fb5595971d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306daa81c2794164a38ae7bc3b322ef2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:01:34.579131 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-0a58ea46-9201-4593-84c1-99372aab1e18 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] 10.222.0.60 "GET /compute/v2.1/servers/0c7618d8-89ce-43e8-b243-3b6e2647e9b7" status: 200 len: 1314 microversion: 2.1 time: 0.294729 Nov 23 13:01:34.579791 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 210/391] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:01:34 2021] GET /compute/v2.1/servers/0c7618d8-89ce-43e8-b243-3b6e2647e9b7 => generated 1314 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:01:34.635429 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-0136a564-6667-420f-8f85-15344017ba3f tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:34.636038 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-0136a564-6667-420f-8f85-15344017ba3f tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] [instance: 979f72d5-fadc-4b59-ace6-6b8b350a63d9] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:34.646253 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0136a564-6667-420f-8f85-15344017ba3f tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:34.647011 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0136a564-6667-420f-8f85-15344017ba3f tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:34.647859 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0136a564-6667-420f-8f85-15344017ba3f tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:34.648525 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0136a564-6667-420f-8f85-15344017ba3f tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:34.730799 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.wsgi [None req-0136a564-6667-420f-8f85-15344017ba3f tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] HTTP exception thrown: Instance 979f72d5-fadc-4b59-ace6-6b8b350a63d9 could not be found. Nov 23 13:01:34.731734 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-0136a564-6667-420f-8f85-15344017ba3f tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] Returning 404 to user: Instance 979f72d5-fadc-4b59-ace6-6b8b350a63d9 could not be found. {{(pid=100973) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Nov 23 13:01:34.732910 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-0136a564-6667-420f-8f85-15344017ba3f tempest-VolumesNegativeTest-1606870771 tempest-VolumesNegativeTest-1606870771-project] 10.222.0.60 "GET /compute/v2.1/servers/979f72d5-fadc-4b59-ace6-6b8b350a63d9" status: 404 len: 111 microversion: 2.1 time: 0.101564 Nov 23 13:01:34.735092 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 211/392] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:01:34 2021] GET /compute/v2.1/servers/979f72d5-fadc-4b59-ace6-6b8b350a63d9 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 23 13:01:34.982077 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-44690137-6c55-4e39-aab7-7f3a0212081e tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:34.982754 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-44690137-6c55-4e39-aab7-7f3a0212081e tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: 53633a05-ad06-454a-b540-5fc01821ae45] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:34.998165 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-44690137-6c55-4e39-aab7-7f3a0212081e tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:34.998618 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-44690137-6c55-4e39-aab7-7f3a0212081e tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:35.002681 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-44690137-6c55-4e39-aab7-7f3a0212081e tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:35.003643 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-44690137-6c55-4e39-aab7-7f3a0212081e tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:35.078151 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-3d99edae-de72-42e4-b4bd-4a7a4ff068a2 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c023f89fd3da4bc8b38963bed4e5cc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a31364455dc442f8df299a8ad758a4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:01:35.100000 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-3d99edae-de72-42e4-b4bd-4a7a4ff068a2 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/12bb9b8b-86ee-463f-a3be-95894290b739" status: 200 len: 1318 microversion: 2.1 time: 0.799826 Nov 23 13:01:35.101811 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 182/393] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:01:34 2021] GET /compute/v2.1/servers/12bb9b8b-86ee-463f-a3be-95894290b739 => generated 1318 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:01:35.115548 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-84c4acf5-e9f7-4650-a214-b99e3ab706f2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:01:35.117874 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-84c4acf5-e9f7-4650-a214-b99e3ab706f2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:35.128195 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-84c4acf5-e9f7-4650-a214-b99e3ab706f2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:35.129231 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-84c4acf5-e9f7-4650-a214-b99e3ab706f2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:35.130224 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-84c4acf5-e9f7-4650-a214-b99e3ab706f2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:35.130871 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-84c4acf5-e9f7-4650-a214-b99e3ab706f2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:35.435353 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-84c4acf5-e9f7-4650-a214-b99e3ab706f2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action" status: 200 len: 28213 microversion: 2.20 time: 0.331997 Nov 23 13:01:35.436092 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 183/394] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:01:35 2021] POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action => generated 28213 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:01:35.446366 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [req-e1321e2b-b756-48e5-8f47-f4b12472aafc req-e0c04463-4962-4d17-96ba-5dbd6b6a268c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12bb9b8b-86ee-463f-a3be-95894290b739", "tag": "a7974570-e152-43f9-91ff-1ff60c761971"}]} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:01:35.448399 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 13:01:35.448399 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: warnings.warn(msg) Nov 23 13:01:35.457342 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-44690137-6c55-4e39-aab7-7f3a0212081e tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:01:35.458161 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [req-e1321e2b-b756-48e5-8f47-f4b12472aafc req-e0c04463-4962-4d17-96ba-5dbd6b6a268c service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:35.458814 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [req-e1321e2b-b756-48e5-8f47-f4b12472aafc req-e0c04463-4962-4d17-96ba-5dbd6b6a268c service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:35.467987 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-44690137-6c55-4e39-aab7-7f3a0212081e tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45" status: 200 len: 1518 microversion: 2.1 time: 0.492477 Nov 23 13:01:35.470953 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 212/395] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:01:34 2021] GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45 => generated 1518 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:01:35.494886 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.compute.server_external_events [req-e1321e2b-b756-48e5-8f47-f4b12472aafc req-e0c04463-4962-4d17-96ba-5dbd6b6a268c service nova] Creating event network-changed:a7974570-e152-43f9-91ff-1ff60c761971 for instance 12bb9b8b-86ee-463f-a3be-95894290b739 on hv-cinder-81888 Nov 23 13:01:35.504955 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [req-e1321e2b-b756-48e5-8f47-f4b12472aafc req-e0c04463-4962-4d17-96ba-5dbd6b6a268c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060881 Nov 23 13:01:35.506327 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 184/396] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Nov 23 13:01:35 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 13:01:35.598503 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-e258f0af-08e6-4ba1-ab2f-958d6f5c99d6 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:35.599608 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-e258f0af-08e6-4ba1-ab2f-958d6f5c99d6 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] [instance: 0c7618d8-89ce-43e8-b243-3b6e2647e9b7] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:35.610201 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e258f0af-08e6-4ba1-ab2f-958d6f5c99d6 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:35.610887 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e258f0af-08e6-4ba1-ab2f-958d6f5c99d6 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:35.612061 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e258f0af-08e6-4ba1-ab2f-958d6f5c99d6 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:35.612861 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e258f0af-08e6-4ba1-ab2f-958d6f5c99d6 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:35.949968 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-e258f0af-08e6-4ba1-ab2f-958d6f5c99d6 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0fe7fa96d645ecbc1e50fb5595971d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306daa81c2794164a38ae7bc3b322ef2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:01:35.964624 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-e258f0af-08e6-4ba1-ab2f-958d6f5c99d6 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] 10.222.0.60 "GET /compute/v2.1/servers/0c7618d8-89ce-43e8-b243-3b6e2647e9b7" status: 200 len: 1314 microversion: 2.1 time: 0.371714 Nov 23 13:01:35.971601 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 213/397] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:01:35 2021] GET /compute/v2.1/servers/0c7618d8-89ce-43e8-b243-3b6e2647e9b7 => generated 1314 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:01:36.119557 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-b2478d98-92b2-4c25-9a18-5c80f21d41e2 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:36.120647 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-b2478d98-92b2-4c25-9a18-5c80f21d41e2 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: 12bb9b8b-86ee-463f-a3be-95894290b739] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:36.131269 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b2478d98-92b2-4c25-9a18-5c80f21d41e2 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:36.132679 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b2478d98-92b2-4c25-9a18-5c80f21d41e2 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:36.133880 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b2478d98-92b2-4c25-9a18-5c80f21d41e2 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:36.134812 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b2478d98-92b2-4c25-9a18-5c80f21d41e2 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:36.447267 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-0060f67e-3e09-4526-86e2-21d660602bf8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:01:36.448576 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-0060f67e-3e09-4526-86e2-21d660602bf8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:36.465916 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0060f67e-3e09-4526-86e2-21d660602bf8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:36.466692 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0060f67e-3e09-4526-86e2-21d660602bf8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:36.467937 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0060f67e-3e09-4526-86e2-21d660602bf8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:36.470450 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0060f67e-3e09-4526-86e2-21d660602bf8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:36.636562 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-0060f67e-3e09-4526-86e2-21d660602bf8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action" status: 200 len: 28213 microversion: 2.20 time: 0.193032 Nov 23 13:01:36.641218 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 214/398] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:01:36 2021] POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action => generated 28213 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 13:01:36.646051 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-4e51da5e-40a9-4041-ae24-b048a812c14f tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:36.646767 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-4e51da5e-40a9-4041-ae24-b048a812c14f tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: 53633a05-ad06-454a-b540-5fc01821ae45] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:36.670166 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4e51da5e-40a9-4041-ae24-b048a812c14f tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:36.670805 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4e51da5e-40a9-4041-ae24-b048a812c14f tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:36.675695 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4e51da5e-40a9-4041-ae24-b048a812c14f tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:36.676961 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4e51da5e-40a9-4041-ae24-b048a812c14f tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:36.809915 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-b2478d98-92b2-4c25-9a18-5c80f21d41e2 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c023f89fd3da4bc8b38963bed4e5cc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a31364455dc442f8df299a8ad758a4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:01:36.820052 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-b2478d98-92b2-4c25-9a18-5c80f21d41e2 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/12bb9b8b-86ee-463f-a3be-95894290b739" status: 200 len: 1318 microversion: 2.1 time: 0.706365 Nov 23 13:01:36.832720 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 185/399] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:01:36 2021] GET /compute/v2.1/servers/12bb9b8b-86ee-463f-a3be-95894290b739 => generated 1318 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:01:36.984838 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-fffd2176-6ce9-4425-82b1-08080cabf315 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:36.988406 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-fffd2176-6ce9-4425-82b1-08080cabf315 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] [instance: 0c7618d8-89ce-43e8-b243-3b6e2647e9b7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:36.998682 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-fffd2176-6ce9-4425-82b1-08080cabf315 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:36.999215 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-fffd2176-6ce9-4425-82b1-08080cabf315 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:37.000353 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-fffd2176-6ce9-4425-82b1-08080cabf315 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:37.001172 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-fffd2176-6ce9-4425-82b1-08080cabf315 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:37.091778 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-4e51da5e-40a9-4041-ae24-b048a812c14f tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:01:37.113176 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-4e51da5e-40a9-4041-ae24-b048a812c14f tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45" status: 200 len: 1518 microversion: 2.1 time: 0.463826 Nov 23 13:01:37.114410 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 215/400] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:01:36 2021] GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45 => generated 1518 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:01:37.464716 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-fffd2176-6ce9-4425-82b1-08080cabf315 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0fe7fa96d645ecbc1e50fb5595971d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306daa81c2794164a38ae7bc3b322ef2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:01:37.483463 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-fffd2176-6ce9-4425-82b1-08080cabf315 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] 10.222.0.60 "GET /compute/v2.1/servers/0c7618d8-89ce-43e8-b243-3b6e2647e9b7" status: 200 len: 1314 microversion: 2.1 time: 0.504144 Nov 23 13:01:37.484867 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 186/401] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:01:36 2021] GET /compute/v2.1/servers/0c7618d8-89ce-43e8-b243-3b6e2647e9b7 => generated 1314 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:01:37.650079 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-fafb3bb0-a245-47f2-ba2b-d2fd6299e896 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:01:37.652346 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-fafb3bb0-a245-47f2-ba2b-d2fd6299e896 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:37.676107 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-fafb3bb0-a245-47f2-ba2b-d2fd6299e896 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:37.676845 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-fafb3bb0-a245-47f2-ba2b-d2fd6299e896 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:37.677851 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-fafb3bb0-a245-47f2-ba2b-d2fd6299e896 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:37.678260 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-fafb3bb0-a245-47f2-ba2b-d2fd6299e896 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:37.836695 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-e3e55ac2-8fde-4a74-a1a4-9dabd81e67e7 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:37.837338 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-e3e55ac2-8fde-4a74-a1a4-9dabd81e67e7 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: 12bb9b8b-86ee-463f-a3be-95894290b739] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:37.853455 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e3e55ac2-8fde-4a74-a1a4-9dabd81e67e7 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:37.854142 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e3e55ac2-8fde-4a74-a1a4-9dabd81e67e7 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:37.855168 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e3e55ac2-8fde-4a74-a1a4-9dabd81e67e7 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:37.855543 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e3e55ac2-8fde-4a74-a1a4-9dabd81e67e7 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:37.991681 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-fafb3bb0-a245-47f2-ba2b-d2fd6299e896 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action" status: 200 len: 28213 microversion: 2.20 time: 0.345987 Nov 23 13:01:37.992421 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 216/402] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:01:37 2021] POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action => generated 28213 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 13:01:38.136031 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-bf1f5e38-b6b8-4950-a99d-a722a4842405 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:38.136778 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-bf1f5e38-b6b8-4950-a99d-a722a4842405 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: 53633a05-ad06-454a-b540-5fc01821ae45] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:38.145400 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-bf1f5e38-b6b8-4950-a99d-a722a4842405 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:38.145987 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-bf1f5e38-b6b8-4950-a99d-a722a4842405 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:38.146969 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-bf1f5e38-b6b8-4950-a99d-a722a4842405 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:38.147472 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-bf1f5e38-b6b8-4950-a99d-a722a4842405 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:38.359669 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-e3e55ac2-8fde-4a74-a1a4-9dabd81e67e7 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c023f89fd3da4bc8b38963bed4e5cc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a31364455dc442f8df299a8ad758a4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:01:38.374462 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-e3e55ac2-8fde-4a74-a1a4-9dabd81e67e7 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/12bb9b8b-86ee-463f-a3be-95894290b739" status: 200 len: 1318 microversion: 2.1 time: 0.541422 Nov 23 13:01:38.375177 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 187/403] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:01:37 2021] GET /compute/v2.1/servers/12bb9b8b-86ee-463f-a3be-95894290b739 => generated 1318 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:01:38.502750 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-46ac6ed4-a504-4010-86c0-b9241167c0fe tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:38.503358 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-46ac6ed4-a504-4010-86c0-b9241167c0fe tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] [instance: 0c7618d8-89ce-43e8-b243-3b6e2647e9b7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:38.515331 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-46ac6ed4-a504-4010-86c0-b9241167c0fe tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:38.515937 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-46ac6ed4-a504-4010-86c0-b9241167c0fe tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:38.516605 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-46ac6ed4-a504-4010-86c0-b9241167c0fe tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:38.517053 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-46ac6ed4-a504-4010-86c0-b9241167c0fe tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:38.526009 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-bf1f5e38-b6b8-4950-a99d-a722a4842405 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:01:38.536732 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-bf1f5e38-b6b8-4950-a99d-a722a4842405 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45" status: 200 len: 1518 microversion: 2.1 time: 0.408283 Nov 23 13:01:38.537359 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 217/404] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:01:38 2021] GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45 => generated 1518 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 13:01:38.779235 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-46ac6ed4-a504-4010-86c0-b9241167c0fe tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0fe7fa96d645ecbc1e50fb5595971d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306daa81c2794164a38ae7bc3b322ef2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:01:38.788171 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-46ac6ed4-a504-4010-86c0-b9241167c0fe tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] 10.222.0.60 "GET /compute/v2.1/servers/0c7618d8-89ce-43e8-b243-3b6e2647e9b7" status: 200 len: 1314 microversion: 2.1 time: 0.289582 Nov 23 13:01:38.789059 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 188/405] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:01:38 2021] GET /compute/v2.1/servers/0c7618d8-89ce-43e8-b243-3b6e2647e9b7 => generated 1314 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 13:01:39.004854 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-e9e96087-f4d8-4ec2-b7fb-1680f5c42bec tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:01:39.006041 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-e9e96087-f4d8-4ec2-b7fb-1680f5c42bec tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:39.017474 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e9e96087-f4d8-4ec2-b7fb-1680f5c42bec tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:39.017967 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e9e96087-f4d8-4ec2-b7fb-1680f5c42bec tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:39.018925 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e9e96087-f4d8-4ec2-b7fb-1680f5c42bec tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:39.019358 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e9e96087-f4d8-4ec2-b7fb-1680f5c42bec tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:39.219856 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-e9e96087-f4d8-4ec2-b7fb-1680f5c42bec tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action" status: 200 len: 28213 microversion: 2.20 time: 0.220176 Nov 23 13:01:39.220607 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 218/406] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:01:38 2021] POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action => generated 28213 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:01:39.395706 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-78742ab3-25bc-4440-b971-b34249042b66 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:39.397073 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-78742ab3-25bc-4440-b971-b34249042b66 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: 12bb9b8b-86ee-463f-a3be-95894290b739] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:39.412010 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-78742ab3-25bc-4440-b971-b34249042b66 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:39.413524 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-78742ab3-25bc-4440-b971-b34249042b66 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:39.414469 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-78742ab3-25bc-4440-b971-b34249042b66 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:39.418310 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-78742ab3-25bc-4440-b971-b34249042b66 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:39.557393 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-d11de75f-f453-4f2d-87c8-246ad8b962a4 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:39.558363 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-d11de75f-f453-4f2d-87c8-246ad8b962a4 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: 53633a05-ad06-454a-b540-5fc01821ae45] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:39.567986 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d11de75f-f453-4f2d-87c8-246ad8b962a4 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:39.568936 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d11de75f-f453-4f2d-87c8-246ad8b962a4 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:39.569958 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d11de75f-f453-4f2d-87c8-246ad8b962a4 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:39.570591 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d11de75f-f453-4f2d-87c8-246ad8b962a4 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:39.861100 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-78742ab3-25bc-4440-b971-b34249042b66 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c023f89fd3da4bc8b38963bed4e5cc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a31364455dc442f8df299a8ad758a4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:01:39.873555 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-78742ab3-25bc-4440-b971-b34249042b66 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/12bb9b8b-86ee-463f-a3be-95894290b739" status: 200 len: 1318 microversion: 2.1 time: 0.483966 Nov 23 13:01:39.874707 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 189/407] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:01:39 2021] GET /compute/v2.1/servers/12bb9b8b-86ee-463f-a3be-95894290b739 => generated 1318 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:01:39.892029 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-4233278c-2499-495c-8801-48c517a71a04 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:39.897097 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-4233278c-2499-495c-8801-48c517a71a04 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] [instance: 0c7618d8-89ce-43e8-b243-3b6e2647e9b7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:39.905872 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-4233278c-2499-495c-8801-48c517a71a04 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:39.907257 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-4233278c-2499-495c-8801-48c517a71a04 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:39.908274 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-4233278c-2499-495c-8801-48c517a71a04 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:39.908929 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-4233278c-2499-495c-8801-48c517a71a04 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:40.200196 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-d11de75f-f453-4f2d-87c8-246ad8b962a4 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:01:40.210389 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-d11de75f-f453-4f2d-87c8-246ad8b962a4 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45" status: 200 len: 1518 microversion: 2.1 time: 0.658623 Nov 23 13:01:40.211026 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 219/408] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:01:39 2021] GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45 => generated 1518 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:01:40.279641 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-8b886c40-1567-42e0-8d6e-9bbbffb0e9df tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:01:40.281242 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-8b886c40-1567-42e0-8d6e-9bbbffb0e9df tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:40.293545 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8b886c40-1567-42e0-8d6e-9bbbffb0e9df tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:40.294245 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8b886c40-1567-42e0-8d6e-9bbbffb0e9df tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:40.295265 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8b886c40-1567-42e0-8d6e-9bbbffb0e9df tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:40.295930 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8b886c40-1567-42e0-8d6e-9bbbffb0e9df tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:40.310975 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-4233278c-2499-495c-8801-48c517a71a04 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0fe7fa96d645ecbc1e50fb5595971d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306daa81c2794164a38ae7bc3b322ef2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:01:40.327216 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-4233278c-2499-495c-8801-48c517a71a04 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] 10.222.0.60 "GET /compute/v2.1/servers/0c7618d8-89ce-43e8-b243-3b6e2647e9b7" status: 200 len: 1314 microversion: 2.1 time: 0.437749 Nov 23 13:01:40.328616 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 190/409] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:01:39 2021] GET /compute/v2.1/servers/0c7618d8-89ce-43e8-b243-3b6e2647e9b7 => generated 1314 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:01:40.469194 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-8b886c40-1567-42e0-8d6e-9bbbffb0e9df tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action" status: 200 len: 28213 microversion: 2.20 time: 0.211594 Nov 23 13:01:40.471329 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 220/410] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:01:40 2021] POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action => generated 28213 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:01:40.893782 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-c12656a2-38fc-4b51-b007-8a42ace2d8ac tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:40.895202 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-c12656a2-38fc-4b51-b007-8a42ace2d8ac tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: 12bb9b8b-86ee-463f-a3be-95894290b739] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:40.918671 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c12656a2-38fc-4b51-b007-8a42ace2d8ac tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:40.919320 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c12656a2-38fc-4b51-b007-8a42ace2d8ac tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:40.920800 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c12656a2-38fc-4b51-b007-8a42ace2d8ac tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:40.921553 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c12656a2-38fc-4b51-b007-8a42ace2d8ac tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:41.227389 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-baf38583-b6f0-49f0-b028-a618fbcd6730 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:41.228792 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-baf38583-b6f0-49f0-b028-a618fbcd6730 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: 53633a05-ad06-454a-b540-5fc01821ae45] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:41.241857 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-baf38583-b6f0-49f0-b028-a618fbcd6730 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:41.242714 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-baf38583-b6f0-49f0-b028-a618fbcd6730 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:41.243697 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-baf38583-b6f0-49f0-b028-a618fbcd6730 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:41.244389 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-baf38583-b6f0-49f0-b028-a618fbcd6730 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:41.279914 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-c12656a2-38fc-4b51-b007-8a42ace2d8ac tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c023f89fd3da4bc8b38963bed4e5cc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a31364455dc442f8df299a8ad758a4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:01:41.292497 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-c12656a2-38fc-4b51-b007-8a42ace2d8ac tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/12bb9b8b-86ee-463f-a3be-95894290b739" status: 200 len: 1318 microversion: 2.1 time: 0.405060 Nov 23 13:01:41.295389 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 191/411] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:01:40 2021] GET /compute/v2.1/servers/12bb9b8b-86ee-463f-a3be-95894290b739 => generated 1318 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:01:41.345286 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-024e84b0-f436-4b70-b0dd-452ee407ab40 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:41.346324 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-024e84b0-f436-4b70-b0dd-452ee407ab40 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] [instance: 0c7618d8-89ce-43e8-b243-3b6e2647e9b7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:41.372767 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-024e84b0-f436-4b70-b0dd-452ee407ab40 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:41.379231 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-024e84b0-f436-4b70-b0dd-452ee407ab40 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:41.382393 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-024e84b0-f436-4b70-b0dd-452ee407ab40 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:41.382901 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-024e84b0-f436-4b70-b0dd-452ee407ab40 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:41.658635 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-024e84b0-f436-4b70-b0dd-452ee407ab40 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0fe7fa96d645ecbc1e50fb5595971d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306daa81c2794164a38ae7bc3b322ef2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:01:41.674708 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-baf38583-b6f0-49f0-b028-a618fbcd6730 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:01:41.678497 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-024e84b0-f436-4b70-b0dd-452ee407ab40 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] 10.222.0.60 "GET /compute/v2.1/servers/0c7618d8-89ce-43e8-b243-3b6e2647e9b7" status: 200 len: 1314 microversion: 2.1 time: 0.337030 Nov 23 13:01:41.683516 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-baf38583-b6f0-49f0-b028-a618fbcd6730 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45" status: 200 len: 1518 microversion: 2.1 time: 0.460244 Nov 23 13:01:41.684134 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 221/412] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:01:41 2021] GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45 => generated 1518 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:01:41.688865 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-c6f8083d-3fbb-4176-8839-9dd789122e77 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:01:41.689018 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 192/413] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:01:41 2021] GET /compute/v2.1/servers/0c7618d8-89ce-43e8-b243-3b6e2647e9b7 => generated 1314 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 13:01:41.690174 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-c6f8083d-3fbb-4176-8839-9dd789122e77 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:41.698740 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c6f8083d-3fbb-4176-8839-9dd789122e77 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:41.699264 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c6f8083d-3fbb-4176-8839-9dd789122e77 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:41.700314 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c6f8083d-3fbb-4176-8839-9dd789122e77 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:41.701187 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c6f8083d-3fbb-4176-8839-9dd789122e77 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:41.881503 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-c6f8083d-3fbb-4176-8839-9dd789122e77 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action" status: 200 len: 28502 microversion: 2.20 time: 0.194983 Nov 23 13:01:41.883219 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 222/414] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:01:41 2021] POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action => generated 28502 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:01:42.313165 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-7db123ff-33d3-4f94-bb16-d3e49420b10e tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:42.313781 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-7db123ff-33d3-4f94-bb16-d3e49420b10e tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: 12bb9b8b-86ee-463f-a3be-95894290b739] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:42.322326 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7db123ff-33d3-4f94-bb16-d3e49420b10e tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:42.323079 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7db123ff-33d3-4f94-bb16-d3e49420b10e tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:42.323997 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7db123ff-33d3-4f94-bb16-d3e49420b10e tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:42.324551 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7db123ff-33d3-4f94-bb16-d3e49420b10e tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:42.571785 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-7db123ff-33d3-4f94-bb16-d3e49420b10e tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c023f89fd3da4bc8b38963bed4e5cc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a31364455dc442f8df299a8ad758a4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:01:42.586248 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-7db123ff-33d3-4f94-bb16-d3e49420b10e tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/12bb9b8b-86ee-463f-a3be-95894290b739" status: 200 len: 1318 microversion: 2.1 time: 0.277126 Nov 23 13:01:42.586825 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 193/415] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:01:42 2021] GET /compute/v2.1/servers/12bb9b8b-86ee-463f-a3be-95894290b739 => generated 1318 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:01:42.700730 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-ed042f56-8d20-47b4-8c42-dfd35b4cd43e tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:42.701521 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-3df86a7f-f990-4605-88db-9fec1d7a50c3 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:42.701719 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-3df86a7f-f990-4605-88db-9fec1d7a50c3 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: 53633a05-ad06-454a-b540-5fc01821ae45] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:42.704542 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-ed042f56-8d20-47b4-8c42-dfd35b4cd43e tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] [instance: 0c7618d8-89ce-43e8-b243-3b6e2647e9b7] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:42.711437 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3df86a7f-f990-4605-88db-9fec1d7a50c3 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:42.712072 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3df86a7f-f990-4605-88db-9fec1d7a50c3 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:42.713060 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3df86a7f-f990-4605-88db-9fec1d7a50c3 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:42.713715 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3df86a7f-f990-4605-88db-9fec1d7a50c3 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:42.727737 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ed042f56-8d20-47b4-8c42-dfd35b4cd43e tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:42.729420 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ed042f56-8d20-47b4-8c42-dfd35b4cd43e tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:42.731547 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ed042f56-8d20-47b4-8c42-dfd35b4cd43e tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:42.732687 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ed042f56-8d20-47b4-8c42-dfd35b4cd43e tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:43.158622 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-3df86a7f-f990-4605-88db-9fec1d7a50c3 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:01:43.163578 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-ed042f56-8d20-47b4-8c42-dfd35b4cd43e tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0fe7fa96d645ecbc1e50fb5595971d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306daa81c2794164a38ae7bc3b322ef2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:01:43.170804 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-3df86a7f-f990-4605-88db-9fec1d7a50c3 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45" status: 200 len: 1498 microversion: 2.1 time: 0.471477 Nov 23 13:01:43.171759 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 194/416] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:01:42 2021] GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45 => generated 1498 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:01:43.174058 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-ed042f56-8d20-47b4-8c42-dfd35b4cd43e tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] 10.222.0.60 "GET /compute/v2.1/servers/0c7618d8-89ce-43e8-b243-3b6e2647e9b7" status: 200 len: 1314 microversion: 2.1 time: 0.482332 Nov 23 13:01:43.175779 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 223/417] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:01:42 2021] GET /compute/v2.1/servers/0c7618d8-89ce-43e8-b243-3b6e2647e9b7 => generated 1314 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:01:43.180302 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-d2831ce0-b025-4545-98f9-02fa152d0f6a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:01:43.182536 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-d2831ce0-b025-4545-98f9-02fa152d0f6a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:43.189287 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-9e95438a-969c-4238-9378-af61f468f444 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b3a2fa28-f75c-4297-b743-499b77efab4a"}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:01:43.190514 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-9e95438a-969c-4238-9378-af61f468f444 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: 53633a05-ad06-454a-b540-5fc01821ae45] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:43.198585 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-9e95438a-969c-4238-9378-af61f468f444 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:43.199290 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-9e95438a-969c-4238-9378-af61f468f444 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:43.200219 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-9e95438a-969c-4238-9378-af61f468f444 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:43.200889 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-9e95438a-969c-4238-9378-af61f468f444 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:43.219438 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d2831ce0-b025-4545-98f9-02fa152d0f6a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:43.220522 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d2831ce0-b025-4545-98f9-02fa152d0f6a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:43.222982 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d2831ce0-b025-4545-98f9-02fa152d0f6a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:43.223689 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d2831ce0-b025-4545-98f9-02fa152d0f6a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:43.320598 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.wsgi [None req-9e95438a-969c-4238-9378-af61f468f444 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] HTTP exception thrown: Cannot 'attach_volume' instance 53633a05-ad06-454a-b540-5fc01821ae45 while it is in vm_state rescued Nov 23 13:01:43.323967 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-9e95438a-969c-4238-9378-af61f468f444 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Returning 409 to user: Cannot 'attach_volume' instance 53633a05-ad06-454a-b540-5fc01821ae45 while it is in vm_state rescued {{(pid=100973) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Nov 23 13:01:43.324975 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-9e95438a-969c-4238-9378-af61f468f444 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "POST /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.139727 Nov 23 13:01:43.325564 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 224/418] 10.222.0.60 () {60 vars in 1322 bytes} [Tue Nov 23 13:01:43 2021] POST /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45/os-volume_attachments => generated 152 bytes in 141 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 23 13:01:43.337332 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [req-79931e7a-24c7-4902-9975-56a79b00fcbd req-f269c282-4c0f-4ee2-a90c-67fe4b8511aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c7618d8-89ce-43e8-b243-3b6e2647e9b7", "name": "network-vif-plugged", "status": "completed", "tag": "56555464-8803-4bc7-b12c-00625c5092d6"}]} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:01:43.339245 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 13:01:43.339245 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: warnings.warn(msg) Nov 23 13:01:43.349825 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [req-79931e7a-24c7-4902-9975-56a79b00fcbd req-f269c282-4c0f-4ee2-a90c-67fe4b8511aa service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:43.350564 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [req-79931e7a-24c7-4902-9975-56a79b00fcbd req-f269c282-4c0f-4ee2-a90c-67fe4b8511aa service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:43.371257 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.compute.server_external_events [req-79931e7a-24c7-4902-9975-56a79b00fcbd req-f269c282-4c0f-4ee2-a90c-67fe4b8511aa service nova] Creating event network-vif-plugged:56555464-8803-4bc7-b12c-00625c5092d6 for instance 0c7618d8-89ce-43e8-b243-3b6e2647e9b7 on hv-cinder-81888 Nov 23 13:01:43.376874 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [req-79931e7a-24c7-4902-9975-56a79b00fcbd req-f269c282-4c0f-4ee2-a90c-67fe4b8511aa service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047304 Nov 23 13:01:43.377718 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 225/419] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Nov 23 13:01:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 13:01:43.384300 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-f198b0a6-9cac-483b-b2a3-dded731a81a9 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:01:43.384911 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-f198b0a6-9cac-483b-b2a3-dded731a81a9 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: 53633a05-ad06-454a-b540-5fc01821ae45] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:43.400490 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-d2831ce0-b025-4545-98f9-02fa152d0f6a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action" status: 200 len: 28502 microversion: 2.20 time: 0.226900 Nov 23 13:01:43.402333 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 195/420] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:01:43 2021] POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action => generated 28502 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:01:43.405177 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f198b0a6-9cac-483b-b2a3-dded731a81a9 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:43.406424 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f198b0a6-9cac-483b-b2a3-dded731a81a9 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:43.407248 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f198b0a6-9cac-483b-b2a3-dded731a81a9 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:43.408881 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f198b0a6-9cac-483b-b2a3-dded731a81a9 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:43.598243 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-f198b0a6-9cac-483b-b2a3-dded731a81a9 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "POST /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45/action" status: 202 len: 0 microversion: 2.1 time: 0.217817 Nov 23 13:01:43.603336 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 226/421] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:01:43 2021] POST /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45/action => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:01:43.605101 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-f8e0a165-2c4d-4d62-9644-a276a367227f tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:43.606013 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-f8e0a165-2c4d-4d62-9644-a276a367227f tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: 12bb9b8b-86ee-463f-a3be-95894290b739] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:43.609922 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-05af46cd-677a-41d2-925a-e7516697bf0f tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:43.610975 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-05af46cd-677a-41d2-925a-e7516697bf0f tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: 53633a05-ad06-454a-b540-5fc01821ae45] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:43.620348 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f8e0a165-2c4d-4d62-9644-a276a367227f tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:43.621783 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-05af46cd-677a-41d2-925a-e7516697bf0f tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:43.622443 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f8e0a165-2c4d-4d62-9644-a276a367227f tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:43.623040 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-05af46cd-677a-41d2-925a-e7516697bf0f tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:43.624352 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f8e0a165-2c4d-4d62-9644-a276a367227f tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:43.624869 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-05af46cd-677a-41d2-925a-e7516697bf0f tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:43.625302 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-05af46cd-677a-41d2-925a-e7516697bf0f tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:43.625928 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f8e0a165-2c4d-4d62-9644-a276a367227f tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:43.931309 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-05af46cd-677a-41d2-925a-e7516697bf0f tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:01:43.940967 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-05af46cd-677a-41d2-925a-e7516697bf0f tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45" status: 200 len: 1506 microversion: 2.1 time: 0.335737 Nov 23 13:01:43.942338 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 227/422] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:01:43 2021] GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45 => generated 1506 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:01:44.191539 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-2e47fd30-5406-4fd7-b6e1-611dc211191b tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:44.192554 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-2e47fd30-5406-4fd7-b6e1-611dc211191b tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] [instance: 0c7618d8-89ce-43e8-b243-3b6e2647e9b7] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:44.202816 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-2e47fd30-5406-4fd7-b6e1-611dc211191b tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:44.203621 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-2e47fd30-5406-4fd7-b6e1-611dc211191b tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:44.204526 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-2e47fd30-5406-4fd7-b6e1-611dc211191b tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:44.204986 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-2e47fd30-5406-4fd7-b6e1-611dc211191b tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:44.266102 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-f8e0a165-2c4d-4d62-9644-a276a367227f tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c023f89fd3da4bc8b38963bed4e5cc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a31364455dc442f8df299a8ad758a4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:01:44.278930 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-f8e0a165-2c4d-4d62-9644-a276a367227f tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/12bb9b8b-86ee-463f-a3be-95894290b739" status: 200 len: 1318 microversion: 2.1 time: 0.679210 Nov 23 13:01:44.283795 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 196/423] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:01:43 2021] GET /compute/v2.1/servers/12bb9b8b-86ee-463f-a3be-95894290b739 => generated 1318 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:01:44.412734 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-e3a5bbea-18cd-4ce9-8fe1-bf161d4316f8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:01:44.414499 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-e3a5bbea-18cd-4ce9-8fe1-bf161d4316f8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:44.429494 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e3a5bbea-18cd-4ce9-8fe1-bf161d4316f8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:44.430865 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e3a5bbea-18cd-4ce9-8fe1-bf161d4316f8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:44.431779 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e3a5bbea-18cd-4ce9-8fe1-bf161d4316f8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:44.434066 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e3a5bbea-18cd-4ce9-8fe1-bf161d4316f8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:44.434178 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-2e47fd30-5406-4fd7-b6e1-611dc211191b tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0fe7fa96d645ecbc1e50fb5595971d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306daa81c2794164a38ae7bc3b322ef2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:01:44.445472 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-2e47fd30-5406-4fd7-b6e1-611dc211191b tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] 10.222.0.60 "GET /compute/v2.1/servers/0c7618d8-89ce-43e8-b243-3b6e2647e9b7" status: 200 len: 1314 microversion: 2.1 time: 0.259004 Nov 23 13:01:44.449813 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 228/424] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:01:44 2021] GET /compute/v2.1/servers/0c7618d8-89ce-43e8-b243-3b6e2647e9b7 => generated 1314 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 13:01:44.813062 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-e3a5bbea-18cd-4ce9-8fe1-bf161d4316f8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action" status: 200 len: 28670 microversion: 2.20 time: 0.403985 Nov 23 13:01:44.813926 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 197/425] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:01:44 2021] POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action => generated 28670 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 13:01:44.961497 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-8179b9a3-dff1-4a4f-a660-4901552e3f01 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:44.962880 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-8179b9a3-dff1-4a4f-a660-4901552e3f01 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: 53633a05-ad06-454a-b540-5fc01821ae45] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:44.982152 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8179b9a3-dff1-4a4f-a660-4901552e3f01 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:44.982698 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8179b9a3-dff1-4a4f-a660-4901552e3f01 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:44.988512 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8179b9a3-dff1-4a4f-a660-4901552e3f01 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:44.988512 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8179b9a3-dff1-4a4f-a660-4901552e3f01 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:45.241470 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-8179b9a3-dff1-4a4f-a660-4901552e3f01 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:01:45.251186 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-8179b9a3-dff1-4a4f-a660-4901552e3f01 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45" status: 200 len: 1506 microversion: 2.1 time: 0.293665 Nov 23 13:01:45.252407 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 229/426] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:01:44 2021] GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45 => generated 1506 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:01:45.303195 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-73a37a28-b473-4270-b485-e08d0e5a202a tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:45.304222 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-73a37a28-b473-4270-b485-e08d0e5a202a tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: 12bb9b8b-86ee-463f-a3be-95894290b739] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:45.314871 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-73a37a28-b473-4270-b485-e08d0e5a202a tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:45.316003 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-73a37a28-b473-4270-b485-e08d0e5a202a tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:45.317220 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-73a37a28-b473-4270-b485-e08d0e5a202a tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:45.317915 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-73a37a28-b473-4270-b485-e08d0e5a202a tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:45.391781 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [req-90c33809-2a26-41db-a443-d68df6e79687 req-eb2a6186-d502-4e97-90c8-21e5d796ee94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12bb9b8b-86ee-463f-a3be-95894290b739", "name": "network-vif-plugged", "status": "completed", "tag": "a7974570-e152-43f9-91ff-1ff60c761971"}]} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:01:45.393897 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 13:01:45.393897 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: warnings.warn(msg) Nov 23 13:01:45.411514 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [req-90c33809-2a26-41db-a443-d68df6e79687 req-eb2a6186-d502-4e97-90c8-21e5d796ee94 service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:45.415533 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [req-90c33809-2a26-41db-a443-d68df6e79687 req-eb2a6186-d502-4e97-90c8-21e5d796ee94 service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:45.438352 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.compute.server_external_events [req-90c33809-2a26-41db-a443-d68df6e79687 req-eb2a6186-d502-4e97-90c8-21e5d796ee94 service nova] Creating event network-vif-plugged:a7974570-e152-43f9-91ff-1ff60c761971 for instance 12bb9b8b-86ee-463f-a3be-95894290b739 on hv-cinder-81888 Nov 23 13:01:45.443988 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [req-90c33809-2a26-41db-a443-d68df6e79687 req-eb2a6186-d502-4e97-90c8-21e5d796ee94 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056127 Nov 23 13:01:45.445159 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 230/427] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Nov 23 13:01:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 13:01:45.466266 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-bcc7cffc-985c-4fe0-9d44-2b47ca4db079 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:45.467362 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-bcc7cffc-985c-4fe0-9d44-2b47ca4db079 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] [instance: 0c7618d8-89ce-43e8-b243-3b6e2647e9b7] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:45.476548 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-bcc7cffc-985c-4fe0-9d44-2b47ca4db079 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:45.477351 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-bcc7cffc-985c-4fe0-9d44-2b47ca4db079 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:45.478351 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-bcc7cffc-985c-4fe0-9d44-2b47ca4db079 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:45.478974 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-bcc7cffc-985c-4fe0-9d44-2b47ca4db079 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:45.753488 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-73a37a28-b473-4270-b485-e08d0e5a202a tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c023f89fd3da4bc8b38963bed4e5cc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a31364455dc442f8df299a8ad758a4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:01:45.763388 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-73a37a28-b473-4270-b485-e08d0e5a202a tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/12bb9b8b-86ee-463f-a3be-95894290b739" status: 200 len: 1318 microversion: 2.1 time: 0.466722 Nov 23 13:01:45.776611 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 198/428] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:01:45 2021] GET /compute/v2.1/servers/12bb9b8b-86ee-463f-a3be-95894290b739 => generated 1318 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:01:45.793860 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-bcc7cffc-985c-4fe0-9d44-2b47ca4db079 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0fe7fa96d645ecbc1e50fb5595971d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306daa81c2794164a38ae7bc3b322ef2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:01:45.804708 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-bcc7cffc-985c-4fe0-9d44-2b47ca4db079 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] 10.222.0.60 "GET /compute/v2.1/servers/0c7618d8-89ce-43e8-b243-3b6e2647e9b7" status: 200 len: 1314 microversion: 2.1 time: 0.343010 Nov 23 13:01:45.805726 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 231/429] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:01:45 2021] GET /compute/v2.1/servers/0c7618d8-89ce-43e8-b243-3b6e2647e9b7 => generated 1314 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:01:45.870409 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-f56527ad-e949-47ab-88e0-4ec4370750f8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:01:45.871873 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-f56527ad-e949-47ab-88e0-4ec4370750f8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:45.883647 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f56527ad-e949-47ab-88e0-4ec4370750f8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:45.884094 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f56527ad-e949-47ab-88e0-4ec4370750f8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:45.884934 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f56527ad-e949-47ab-88e0-4ec4370750f8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:45.885352 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f56527ad-e949-47ab-88e0-4ec4370750f8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:46.270155 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-7f43c233-c715-4c2d-a084-a89eda167753 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:46.271624 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-7f43c233-c715-4c2d-a084-a89eda167753 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: 53633a05-ad06-454a-b540-5fc01821ae45] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:46.284623 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-7f43c233-c715-4c2d-a084-a89eda167753 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:46.284623 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-7f43c233-c715-4c2d-a084-a89eda167753 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:46.284623 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-7f43c233-c715-4c2d-a084-a89eda167753 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:46.284623 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-7f43c233-c715-4c2d-a084-a89eda167753 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:46.542149 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-7f43c233-c715-4c2d-a084-a89eda167753 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:01:46.551772 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-7f43c233-c715-4c2d-a084-a89eda167753 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45" status: 200 len: 1506 microversion: 2.1 time: 0.286199 Nov 23 13:01:46.552632 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 232/430] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:01:46 2021] GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45 => generated 1506 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:01:46.701005 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-f56527ad-e949-47ab-88e0-4ec4370750f8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action" status: 200 len: 28670 microversion: 2.20 time: 0.834034 Nov 23 13:01:46.701967 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 199/431] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:01:45 2021] POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action => generated 28670 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:01:46.782211 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-139ab22e-de50-4cee-820d-cbc9e02fd6ea tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:46.782962 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-139ab22e-de50-4cee-820d-cbc9e02fd6ea tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: 12bb9b8b-86ee-463f-a3be-95894290b739] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:46.805927 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-139ab22e-de50-4cee-820d-cbc9e02fd6ea tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:46.806929 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-139ab22e-de50-4cee-820d-cbc9e02fd6ea tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:46.808003 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-139ab22e-de50-4cee-820d-cbc9e02fd6ea tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:46.808806 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-139ab22e-de50-4cee-820d-cbc9e02fd6ea tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:46.826800 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-5a75e554-79bb-4442-ab5a-c8507eacc8c1 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:46.827496 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-5a75e554-79bb-4442-ab5a-c8507eacc8c1 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] [instance: 0c7618d8-89ce-43e8-b243-3b6e2647e9b7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:46.845177 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5a75e554-79bb-4442-ab5a-c8507eacc8c1 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:46.846040 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5a75e554-79bb-4442-ab5a-c8507eacc8c1 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:46.851254 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5a75e554-79bb-4442-ab5a-c8507eacc8c1 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:46.852133 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5a75e554-79bb-4442-ab5a-c8507eacc8c1 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:47.211337 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-139ab22e-de50-4cee-820d-cbc9e02fd6ea tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c023f89fd3da4bc8b38963bed4e5cc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a31364455dc442f8df299a8ad758a4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:01:47.221260 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-139ab22e-de50-4cee-820d-cbc9e02fd6ea tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/12bb9b8b-86ee-463f-a3be-95894290b739" status: 200 len: 1318 microversion: 2.1 time: 0.443825 Nov 23 13:01:47.229678 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 233/432] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:01:46 2021] GET /compute/v2.1/servers/12bb9b8b-86ee-463f-a3be-95894290b739 => generated 1318 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:01:47.384268 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-5a75e554-79bb-4442-ab5a-c8507eacc8c1 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0fe7fa96d645ecbc1e50fb5595971d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306daa81c2794164a38ae7bc3b322ef2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:01:47.393582 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-5a75e554-79bb-4442-ab5a-c8507eacc8c1 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] 10.222.0.60 "GET /compute/v2.1/servers/0c7618d8-89ce-43e8-b243-3b6e2647e9b7" status: 200 len: 1314 microversion: 2.1 time: 0.573961 Nov 23 13:01:47.394156 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 200/433] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:01:46 2021] GET /compute/v2.1/servers/0c7618d8-89ce-43e8-b243-3b6e2647e9b7 => generated 1314 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 13:01:47.572395 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-2f06f72e-c6f9-47eb-b528-c40815ac9c32 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:47.572395 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-2f06f72e-c6f9-47eb-b528-c40815ac9c32 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: 53633a05-ad06-454a-b540-5fc01821ae45] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:47.580757 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-2f06f72e-c6f9-47eb-b528-c40815ac9c32 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:47.581439 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-2f06f72e-c6f9-47eb-b528-c40815ac9c32 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:47.582461 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-2f06f72e-c6f9-47eb-b528-c40815ac9c32 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:47.583092 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-2f06f72e-c6f9-47eb-b528-c40815ac9c32 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:47.714562 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-8b4eb192-26b9-4dfa-9d9f-e65915d0cb21 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:01:47.716194 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-8b4eb192-26b9-4dfa-9d9f-e65915d0cb21 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:47.726383 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8b4eb192-26b9-4dfa-9d9f-e65915d0cb21 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:47.727143 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8b4eb192-26b9-4dfa-9d9f-e65915d0cb21 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:47.728391 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8b4eb192-26b9-4dfa-9d9f-e65915d0cb21 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:47.728981 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8b4eb192-26b9-4dfa-9d9f-e65915d0cb21 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:47.848709 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-2f06f72e-c6f9-47eb-b528-c40815ac9c32 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:01:47.859844 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-2f06f72e-c6f9-47eb-b528-c40815ac9c32 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45" status: 200 len: 1506 microversion: 2.1 time: 0.293910 Nov 23 13:01:47.860460 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 234/434] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:01:47 2021] GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45 => generated 1506 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:01:48.238208 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-e989492e-61d6-47e5-96e4-27264e01f85e tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:48.238813 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-e989492e-61d6-47e5-96e4-27264e01f85e tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: 12bb9b8b-86ee-463f-a3be-95894290b739] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:48.248541 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e989492e-61d6-47e5-96e4-27264e01f85e tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:48.249021 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e989492e-61d6-47e5-96e4-27264e01f85e tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:48.249840 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e989492e-61d6-47e5-96e4-27264e01f85e tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:48.250276 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e989492e-61d6-47e5-96e4-27264e01f85e tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:48.506487 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-e989492e-61d6-47e5-96e4-27264e01f85e tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c023f89fd3da4bc8b38963bed4e5cc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a31364455dc442f8df299a8ad758a4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:01:48.516142 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-e989492e-61d6-47e5-96e4-27264e01f85e tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/12bb9b8b-86ee-463f-a3be-95894290b739" status: 200 len: 1318 microversion: 2.1 time: 0.281665 Nov 23 13:01:48.526138 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 235/435] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:01:48 2021] GET /compute/v2.1/servers/12bb9b8b-86ee-463f-a3be-95894290b739 => generated 1318 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:01:48.531277 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-badd0eb3-35e6-4e20-942f-cfbbb29836a0 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:48.531887 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-badd0eb3-35e6-4e20-942f-cfbbb29836a0 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] [instance: 0c7618d8-89ce-43e8-b243-3b6e2647e9b7] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:48.539218 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-badd0eb3-35e6-4e20-942f-cfbbb29836a0 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:48.539681 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-badd0eb3-35e6-4e20-942f-cfbbb29836a0 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:48.540484 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-badd0eb3-35e6-4e20-942f-cfbbb29836a0 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:48.540923 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-badd0eb3-35e6-4e20-942f-cfbbb29836a0 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:48.763997 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-badd0eb3-35e6-4e20-942f-cfbbb29836a0 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0fe7fa96d645ecbc1e50fb5595971d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306daa81c2794164a38ae7bc3b322ef2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:01:48.779213 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-badd0eb3-35e6-4e20-942f-cfbbb29836a0 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] 10.222.0.60 "GET /compute/v2.1/servers/0c7618d8-89ce-43e8-b243-3b6e2647e9b7" status: 200 len: 1497 microversion: 2.1 time: 0.251539 Nov 23 13:01:48.780442 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 236/436] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:01:48 2021] GET /compute/v2.1/servers/0c7618d8-89ce-43e8-b243-3b6e2647e9b7 => generated 1497 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:01:48.879774 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-a4220cd7-ad12-4e05-9483-8ca997364052 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:48.880603 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-a4220cd7-ad12-4e05-9483-8ca997364052 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: 53633a05-ad06-454a-b540-5fc01821ae45] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:48.890423 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a4220cd7-ad12-4e05-9483-8ca997364052 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:48.891122 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a4220cd7-ad12-4e05-9483-8ca997364052 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:48.891900 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a4220cd7-ad12-4e05-9483-8ca997364052 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:48.892360 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a4220cd7-ad12-4e05-9483-8ca997364052 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:49.111601 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-a4220cd7-ad12-4e05-9483-8ca997364052 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:01:49.120974 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-a4220cd7-ad12-4e05-9483-8ca997364052 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45" status: 200 len: 1506 microversion: 2.1 time: 0.246778 Nov 23 13:01:49.121577 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 237/437] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:01:48 2021] GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45 => generated 1506 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:01:49.533739 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-1d8ef9ad-6272-4510-908f-d1908bda7063 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:49.534343 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-1d8ef9ad-6272-4510-908f-d1908bda7063 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: 12bb9b8b-86ee-463f-a3be-95894290b739] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:49.541968 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-1d8ef9ad-6272-4510-908f-d1908bda7063 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:49.542330 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-1d8ef9ad-6272-4510-908f-d1908bda7063 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:49.543529 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-1d8ef9ad-6272-4510-908f-d1908bda7063 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:49.543885 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-1d8ef9ad-6272-4510-908f-d1908bda7063 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:49.769754 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-1d8ef9ad-6272-4510-908f-d1908bda7063 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c023f89fd3da4bc8b38963bed4e5cc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a31364455dc442f8df299a8ad758a4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:01:49.779318 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-1d8ef9ad-6272-4510-908f-d1908bda7063 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/12bb9b8b-86ee-463f-a3be-95894290b739" status: 200 len: 1318 microversion: 2.1 time: 0.249162 Nov 23 13:01:49.780487 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 238/438] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:01:49 2021] GET /compute/v2.1/servers/12bb9b8b-86ee-463f-a3be-95894290b739 => generated 1318 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 13:01:50.140764 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-8dad189a-3c33-4f1b-956e-35d987c3ce8a tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:50.141791 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-8dad189a-3c33-4f1b-956e-35d987c3ce8a tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: 53633a05-ad06-454a-b540-5fc01821ae45] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:50.151087 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8dad189a-3c33-4f1b-956e-35d987c3ce8a tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:50.152062 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8dad189a-3c33-4f1b-956e-35d987c3ce8a tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:50.153258 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8dad189a-3c33-4f1b-956e-35d987c3ce8a tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:50.153847 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8dad189a-3c33-4f1b-956e-35d987c3ce8a tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:50.747589 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-8dad189a-3c33-4f1b-956e-35d987c3ce8a tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:01:50.758922 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-8dad189a-3c33-4f1b-956e-35d987c3ce8a tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45" status: 200 len: 1506 microversion: 2.1 time: 0.623590 Nov 23 13:01:50.760676 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 239/439] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:01:50 2021] GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45 => generated 1506 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 13:01:50.798102 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-7b45ac2a-9199-4510-bfd4-d959390e9fc1 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:50.800816 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-7b45ac2a-9199-4510-bfd4-d959390e9fc1 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: 12bb9b8b-86ee-463f-a3be-95894290b739] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:50.815945 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-7b45ac2a-9199-4510-bfd4-d959390e9fc1 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:50.816443 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-7b45ac2a-9199-4510-bfd4-d959390e9fc1 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:50.817230 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-7b45ac2a-9199-4510-bfd4-d959390e9fc1 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:50.817665 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-7b45ac2a-9199-4510-bfd4-d959390e9fc1 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:51.006609 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-8b4eb192-26b9-4dfa-9d9f-e65915d0cb21 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action" status: 200 len: 28670 microversion: 2.20 time: 3.293779 Nov 23 13:01:51.008337 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 201/440] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:01:47 2021] POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action => generated 28670 bytes in 3299 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 13:01:51.349346 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-7b45ac2a-9199-4510-bfd4-d959390e9fc1 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c023f89fd3da4bc8b38963bed4e5cc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a31364455dc442f8df299a8ad758a4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:01:51.365368 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-7b45ac2a-9199-4510-bfd4-d959390e9fc1 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/12bb9b8b-86ee-463f-a3be-95894290b739" status: 200 len: 1318 microversion: 2.1 time: 0.572031 Nov 23 13:01:51.365964 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 240/441] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:01:50 2021] GET /compute/v2.1/servers/12bb9b8b-86ee-463f-a3be-95894290b739 => generated 1318 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:01:51.782179 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-458171a2-8080-47cd-b8c3-22ae5453d4b1 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:51.783705 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-458171a2-8080-47cd-b8c3-22ae5453d4b1 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: 53633a05-ad06-454a-b540-5fc01821ae45] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:51.796692 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-458171a2-8080-47cd-b8c3-22ae5453d4b1 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:51.797436 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-458171a2-8080-47cd-b8c3-22ae5453d4b1 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:51.798325 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-458171a2-8080-47cd-b8c3-22ae5453d4b1 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:51.798922 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-458171a2-8080-47cd-b8c3-22ae5453d4b1 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:52.025972 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-957e54f0-b280-4914-bc9d-b90091158d58 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:01:52.029597 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-957e54f0-b280-4914-bc9d-b90091158d58 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:52.047224 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-957e54f0-b280-4914-bc9d-b90091158d58 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:52.049816 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-957e54f0-b280-4914-bc9d-b90091158d58 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:52.050702 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-957e54f0-b280-4914-bc9d-b90091158d58 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:52.053547 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-957e54f0-b280-4914-bc9d-b90091158d58 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:52.213198 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-458171a2-8080-47cd-b8c3-22ae5453d4b1 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:01:52.227015 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-458171a2-8080-47cd-b8c3-22ae5453d4b1 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45" status: 200 len: 1506 microversion: 2.1 time: 0.452948 Nov 23 13:01:52.231603 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 202/442] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:01:51 2021] GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45 => generated 1506 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:01:52.242684 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-8dda5fcf-f25b-4aec-b7e3-8d6bfd040d93 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:52.248764 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-8dda5fcf-f25b-4aec-b7e3-8d6bfd040d93 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] [instance: 0c7618d8-89ce-43e8-b243-3b6e2647e9b7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:52.268224 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8dda5fcf-f25b-4aec-b7e3-8d6bfd040d93 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:52.268956 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8dda5fcf-f25b-4aec-b7e3-8d6bfd040d93 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:52.270128 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8dda5fcf-f25b-4aec-b7e3-8d6bfd040d93 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:52.271198 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8dda5fcf-f25b-4aec-b7e3-8d6bfd040d93 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:52.359196 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-8dda5fcf-f25b-4aec-b7e3-8d6bfd040d93 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] [instance: 0c7618d8-89ce-43e8-b243-3b6e2647e9b7] Going to try to terminate instance {{(pid=100974) delete /opt/stack/nova/nova/compute/api.py:2562}} Nov 23 13:01:52.423444 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-957e54f0-b280-4914-bc9d-b90091158d58 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action" status: 200 len: 28670 microversion: 2.20 time: 0.407603 Nov 23 13:01:52.425502 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 241/443] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:01:52 2021] POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action => generated 28670 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:01:52.439526 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-16c1ca1d-938a-413c-b12e-dee5017df789 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:52.443595 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-16c1ca1d-938a-413c-b12e-dee5017df789 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: 12bb9b8b-86ee-463f-a3be-95894290b739] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:52.462571 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-16c1ca1d-938a-413c-b12e-dee5017df789 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:52.466384 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-16c1ca1d-938a-413c-b12e-dee5017df789 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:52.469118 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-16c1ca1d-938a-413c-b12e-dee5017df789 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:52.469641 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-16c1ca1d-938a-413c-b12e-dee5017df789 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:52.669936 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-8dda5fcf-f25b-4aec-b7e3-8d6bfd040d93 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] 10.222.0.60 "DELETE /compute/v2.1/servers/0c7618d8-89ce-43e8-b243-3b6e2647e9b7" status: 204 len: 0 microversion: 2.1 time: 0.435924 Nov 23 13:01:52.671014 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 203/444] 10.222.0.60 () {58 vars in 1238 bytes} [Tue Nov 23 13:01:52 2021] DELETE /compute/v2.1/servers/0c7618d8-89ce-43e8-b243-3b6e2647e9b7 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 23 13:01:52.680969 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-a99f2fbe-ed4d-4eeb-917b-8a14378a10e0 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:52.681662 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-a99f2fbe-ed4d-4eeb-917b-8a14378a10e0 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] [instance: 0c7618d8-89ce-43e8-b243-3b6e2647e9b7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:52.697210 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a99f2fbe-ed4d-4eeb-917b-8a14378a10e0 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:52.697659 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a99f2fbe-ed4d-4eeb-917b-8a14378a10e0 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:52.698578 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a99f2fbe-ed4d-4eeb-917b-8a14378a10e0 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:52.699018 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a99f2fbe-ed4d-4eeb-917b-8a14378a10e0 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:53.026631 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-a99f2fbe-ed4d-4eeb-917b-8a14378a10e0 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0fe7fa96d645ecbc1e50fb5595971d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306daa81c2794164a38ae7bc3b322ef2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:01:53.035449 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-a99f2fbe-ed4d-4eeb-917b-8a14378a10e0 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] 10.222.0.60 "GET /compute/v2.1/servers/0c7618d8-89ce-43e8-b243-3b6e2647e9b7" status: 200 len: 1503 microversion: 2.1 time: 0.360133 Nov 23 13:01:53.036498 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 204/445] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:01:52 2021] GET /compute/v2.1/servers/0c7618d8-89ce-43e8-b243-3b6e2647e9b7 => generated 1503 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 13:01:53.062946 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-16c1ca1d-938a-413c-b12e-dee5017df789 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c023f89fd3da4bc8b38963bed4e5cc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a31364455dc442f8df299a8ad758a4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:01:53.075079 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-16c1ca1d-938a-413c-b12e-dee5017df789 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/12bb9b8b-86ee-463f-a3be-95894290b739" status: 200 len: 1508 microversion: 2.1 time: 0.645676 Nov 23 13:01:53.075897 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 242/446] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:01:52 2021] GET /compute/v2.1/servers/12bb9b8b-86ee-463f-a3be-95894290b739 => generated 1508 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:01:53.249729 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-94bd7bdc-1c47-4a8b-9adf-b83f0fb403fb tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:53.251799 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-94bd7bdc-1c47-4a8b-9adf-b83f0fb403fb tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: 53633a05-ad06-454a-b540-5fc01821ae45] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:53.261953 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-94bd7bdc-1c47-4a8b-9adf-b83f0fb403fb tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:53.262720 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-94bd7bdc-1c47-4a8b-9adf-b83f0fb403fb tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:53.263696 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-94bd7bdc-1c47-4a8b-9adf-b83f0fb403fb tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:53.264317 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-94bd7bdc-1c47-4a8b-9adf-b83f0fb403fb tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:53.437901 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-800d3e70-b409-49d2-8731-b14691d8babb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:01:53.439179 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-800d3e70-b409-49d2-8731-b14691d8babb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:53.447269 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-800d3e70-b409-49d2-8731-b14691d8babb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:53.447845 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-800d3e70-b409-49d2-8731-b14691d8babb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:53.448649 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-800d3e70-b409-49d2-8731-b14691d8babb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:53.451371 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-800d3e70-b409-49d2-8731-b14691d8babb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:53.655278 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-94bd7bdc-1c47-4a8b-9adf-b83f0fb403fb tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:01:53.667311 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-94bd7bdc-1c47-4a8b-9adf-b83f0fb403fb tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45" status: 200 len: 1506 microversion: 2.1 time: 0.423979 Nov 23 13:01:53.671932 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 205/447] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:01:53 2021] GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45 => generated 1506 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:01:54.047991 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-800d3e70-b409-49d2-8731-b14691d8babb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action" status: 200 len: 28670 microversion: 2.20 time: 0.615005 Nov 23 13:01:54.053339 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-9b01672a-ff41-409b-a751-f8a3da75d4c6 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:54.053512 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-9b01672a-ff41-409b-a751-f8a3da75d4c6 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] [instance: 0c7618d8-89ce-43e8-b243-3b6e2647e9b7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:54.061823 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 243/448] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:01:53 2021] POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action => generated 28670 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:01:54.080804 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-9b01672a-ff41-409b-a751-f8a3da75d4c6 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:54.081247 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-9b01672a-ff41-409b-a751-f8a3da75d4c6 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:54.082028 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-9b01672a-ff41-409b-a751-f8a3da75d4c6 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:54.082455 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-9b01672a-ff41-409b-a751-f8a3da75d4c6 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:54.355285 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-9b01672a-ff41-409b-a751-f8a3da75d4c6 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0fe7fa96d645ecbc1e50fb5595971d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306daa81c2794164a38ae7bc3b322ef2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:01:54.364790 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-9b01672a-ff41-409b-a751-f8a3da75d4c6 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] 10.222.0.60 "GET /compute/v2.1/servers/0c7618d8-89ce-43e8-b243-3b6e2647e9b7" status: 200 len: 1503 microversion: 2.1 time: 0.315387 Nov 23 13:01:54.365669 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 206/449] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:01:54 2021] GET /compute/v2.1/servers/0c7618d8-89ce-43e8-b243-3b6e2647e9b7 => generated 1503 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:01:54.691746 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-f5e3d2d3-78f4-4377-aa5b-be8f14ca7b2b tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:54.693223 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-f5e3d2d3-78f4-4377-aa5b-be8f14ca7b2b tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: 53633a05-ad06-454a-b540-5fc01821ae45] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:54.702604 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f5e3d2d3-78f4-4377-aa5b-be8f14ca7b2b tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:54.703053 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f5e3d2d3-78f4-4377-aa5b-be8f14ca7b2b tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:54.704050 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f5e3d2d3-78f4-4377-aa5b-be8f14ca7b2b tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:54.704722 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f5e3d2d3-78f4-4377-aa5b-be8f14ca7b2b tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:54.746338 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-e32960f5-759d-4a40-86ac-6c7df9d069e1 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b927f869-c09a-4e1a-99f8-347c729aa925"}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:01:54.748222 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-e32960f5-759d-4a40-86ac-6c7df9d069e1 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: 12bb9b8b-86ee-463f-a3be-95894290b739] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:54.760306 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e32960f5-759d-4a40-86ac-6c7df9d069e1 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:54.761385 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e32960f5-759d-4a40-86ac-6c7df9d069e1 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:54.762670 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e32960f5-759d-4a40-86ac-6c7df9d069e1 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:54.763402 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e32960f5-759d-4a40-86ac-6c7df9d069e1 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:55.087115 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-f5e3d2d3-78f4-4377-aa5b-be8f14ca7b2b tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:01:55.101094 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-f5e3d2d3-78f4-4377-aa5b-be8f14ca7b2b tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45" status: 200 len: 1512 microversion: 2.1 time: 0.413307 Nov 23 13:01:55.104921 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 244/450] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:01:54 2021] GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45 => generated 1512 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:01:55.121608 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-8e2b53ed-ae97-4c3a-a47d-d38d8507b950 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:01:55.122955 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-8e2b53ed-ae97-4c3a-a47d-d38d8507b950 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:55.132020 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8e2b53ed-ae97-4c3a-a47d-d38d8507b950 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:55.132771 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8e2b53ed-ae97-4c3a-a47d-d38d8507b950 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:55.133645 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8e2b53ed-ae97-4c3a-a47d-d38d8507b950 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:55.134114 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8e2b53ed-ae97-4c3a-a47d-d38d8507b950 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:55.342445 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-8e2b53ed-ae97-4c3a-a47d-d38d8507b950 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action" status: 200 len: 28670 microversion: 2.20 time: 0.223515 Nov 23 13:01:55.343745 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 245/451] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:01:55 2021] POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action => generated 28670 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:01:55.383856 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-bb02238f-ee83-4c42-8403-a04e3c36e4a1 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:55.384583 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-bb02238f-ee83-4c42-8403-a04e3c36e4a1 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] [instance: 0c7618d8-89ce-43e8-b243-3b6e2647e9b7] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:55.397311 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-bb02238f-ee83-4c42-8403-a04e3c36e4a1 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:55.398869 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-bb02238f-ee83-4c42-8403-a04e3c36e4a1 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:55.401479 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-bb02238f-ee83-4c42-8403-a04e3c36e4a1 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:55.402917 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-bb02238f-ee83-4c42-8403-a04e3c36e4a1 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:55.815077 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-bb02238f-ee83-4c42-8403-a04e3c36e4a1 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0fe7fa96d645ecbc1e50fb5595971d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306daa81c2794164a38ae7bc3b322ef2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:01:55.828015 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-bb02238f-ee83-4c42-8403-a04e3c36e4a1 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] 10.222.0.60 "GET /compute/v2.1/servers/0c7618d8-89ce-43e8-b243-3b6e2647e9b7" status: 200 len: 1503 microversion: 2.1 time: 0.446677 Nov 23 13:01:55.831831 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 246/452] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:01:55 2021] GET /compute/v2.1/servers/0c7618d8-89ce-43e8-b243-3b6e2647e9b7 => generated 1503 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:01:55.848463 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-e32960f5-759d-4a40-86ac-6c7df9d069e1 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "POST /compute/v2.1/servers/12bb9b8b-86ee-463f-a3be-95894290b739/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.104543 Nov 23 13:01:55.860836 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 207/453] 10.222.0.60 () {60 vars in 1322 bytes} [Tue Nov 23 13:01:54 2021] POST /compute/v2.1/servers/12bb9b8b-86ee-463f-a3be-95894290b739/os-volume_attachments => generated 194 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 13:01:56.354780 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-38d880df-a1e4-450c-97cf-69a6f74461d0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:01:56.356417 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-38d880df-a1e4-450c-97cf-69a6f74461d0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:56.365555 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-38d880df-a1e4-450c-97cf-69a6f74461d0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:56.366370 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-38d880df-a1e4-450c-97cf-69a6f74461d0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:56.367230 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-38d880df-a1e4-450c-97cf-69a6f74461d0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:56.367855 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-38d880df-a1e4-450c-97cf-69a6f74461d0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:56.545314 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-38d880df-a1e4-450c-97cf-69a6f74461d0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action" status: 200 len: 28670 microversion: 2.20 time: 0.193674 Nov 23 13:01:56.547633 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 247/454] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:01:56 2021] POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action => generated 28670 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:01:56.849969 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-4195a53d-dcfe-4a7e-8780-2a11e4a67113 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:56.851734 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-4195a53d-dcfe-4a7e-8780-2a11e4a67113 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] [instance: 0c7618d8-89ce-43e8-b243-3b6e2647e9b7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:56.885923 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-4195a53d-dcfe-4a7e-8780-2a11e4a67113 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:56.888336 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-4195a53d-dcfe-4a7e-8780-2a11e4a67113 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:56.890153 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-4195a53d-dcfe-4a7e-8780-2a11e4a67113 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:56.891974 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-4195a53d-dcfe-4a7e-8780-2a11e4a67113 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:57.103033 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-7310681e-98c0-426a-8238-03aa427e355e tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:57.105272 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-7310681e-98c0-426a-8238-03aa427e355e tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: 53633a05-ad06-454a-b540-5fc01821ae45] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:57.114649 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-7310681e-98c0-426a-8238-03aa427e355e tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:57.115507 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-7310681e-98c0-426a-8238-03aa427e355e tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:57.116535 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-7310681e-98c0-426a-8238-03aa427e355e tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:57.117211 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-7310681e-98c0-426a-8238-03aa427e355e tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:57.241774 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-4195a53d-dcfe-4a7e-8780-2a11e4a67113 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0fe7fa96d645ecbc1e50fb5595971d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306daa81c2794164a38ae7bc3b322ef2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:01:57.252094 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-4195a53d-dcfe-4a7e-8780-2a11e4a67113 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] 10.222.0.60 "GET /compute/v2.1/servers/0c7618d8-89ce-43e8-b243-3b6e2647e9b7" status: 200 len: 1461 microversion: 2.1 time: 0.407851 Nov 23 13:01:57.258110 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 208/455] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:01:56 2021] GET /compute/v2.1/servers/0c7618d8-89ce-43e8-b243-3b6e2647e9b7 => generated 1461 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:01:57.298643 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [req-b14726ff-43cf-4fec-9449-f6bf20b9a681 req-91611dc4-46b2-4bdb-aef7-387dcd926c06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c7618d8-89ce-43e8-b243-3b6e2647e9b7", "name": "network-vif-deleted", "tag": "56555464-8803-4bc7-b12c-00625c5092d6"}]} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:01:57.300773 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 13:01:57.300773 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: warnings.warn(msg) Nov 23 13:01:57.324715 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [req-b14726ff-43cf-4fec-9449-f6bf20b9a681 req-91611dc4-46b2-4bdb-aef7-387dcd926c06 service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:57.325178 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [req-b14726ff-43cf-4fec-9449-f6bf20b9a681 req-91611dc4-46b2-4bdb-aef7-387dcd926c06 service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:57.366482 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.compute.server_external_events [req-b14726ff-43cf-4fec-9449-f6bf20b9a681 req-91611dc4-46b2-4bdb-aef7-387dcd926c06 service nova] Creating event network-vif-deleted:56555464-8803-4bc7-b12c-00625c5092d6 for instance 0c7618d8-89ce-43e8-b243-3b6e2647e9b7 on hv-cinder-81888 Nov 23 13:01:57.375821 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [req-b14726ff-43cf-4fec-9449-f6bf20b9a681 req-91611dc4-46b2-4bdb-aef7-387dcd926c06 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091187 Nov 23 13:01:57.376863 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 209/456] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Nov 23 13:01:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 13:01:57.560230 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-b904fd91-8faa-433c-be49-2f3c80450bb2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:01:57.561721 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-b904fd91-8faa-433c-be49-2f3c80450bb2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:57.575858 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b904fd91-8faa-433c-be49-2f3c80450bb2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:57.576708 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b904fd91-8faa-433c-be49-2f3c80450bb2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:57.577974 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b904fd91-8faa-433c-be49-2f3c80450bb2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:57.578619 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b904fd91-8faa-433c-be49-2f3c80450bb2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:57.710168 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-7310681e-98c0-426a-8238-03aa427e355e tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:01:57.727493 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-7310681e-98c0-426a-8238-03aa427e355e tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45" status: 200 len: 1512 microversion: 2.1 time: 0.631993 Nov 23 13:01:57.737280 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 248/457] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:01:57 2021] GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45 => generated 1512 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:01:57.757563 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-78f81b9e-7cd2-4659-90fb-62f459877acd tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9fcbca04-cca7-4f8c-870b-68ef0dca1710"}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:01:57.758977 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-78f81b9e-7cd2-4659-90fb-62f459877acd tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: 53633a05-ad06-454a-b540-5fc01821ae45] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:57.770818 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-78f81b9e-7cd2-4659-90fb-62f459877acd tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:57.771016 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-b904fd91-8faa-433c-be49-2f3c80450bb2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action" status: 200 len: 28670 microversion: 2.20 time: 0.215778 Nov 23 13:01:57.771596 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-78f81b9e-7cd2-4659-90fb-62f459877acd tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:57.772273 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 210/458] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:01:57 2021] POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action => generated 28670 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 13:01:57.772876 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-78f81b9e-7cd2-4659-90fb-62f459877acd tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:57.773485 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-78f81b9e-7cd2-4659-90fb-62f459877acd tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:58.270610 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-016939af-8778-478c-ab15-ed77b794efa7 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:58.271478 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-016939af-8778-478c-ab15-ed77b794efa7 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] [instance: 0c7618d8-89ce-43e8-b243-3b6e2647e9b7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:58.289456 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-016939af-8778-478c-ab15-ed77b794efa7 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:58.289912 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-016939af-8778-478c-ab15-ed77b794efa7 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:58.290727 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-016939af-8778-478c-ab15-ed77b794efa7 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:58.291164 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-016939af-8778-478c-ab15-ed77b794efa7 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:58.363071 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.wsgi [None req-016939af-8778-478c-ab15-ed77b794efa7 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] HTTP exception thrown: Instance 0c7618d8-89ce-43e8-b243-3b6e2647e9b7 could not be found. Nov 23 13:01:58.363687 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-016939af-8778-478c-ab15-ed77b794efa7 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Returning 404 to user: Instance 0c7618d8-89ce-43e8-b243-3b6e2647e9b7 could not be found. {{(pid=100974) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Nov 23 13:01:58.364567 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-016939af-8778-478c-ab15-ed77b794efa7 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] 10.222.0.60 "GET /compute/v2.1/servers/0c7618d8-89ce-43e8-b243-3b6e2647e9b7" status: 404 len: 111 microversion: 2.1 time: 0.098782 Nov 23 13:01:58.365729 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 211/459] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:01:58 2021] GET /compute/v2.1/servers/0c7618d8-89ce-43e8-b243-3b6e2647e9b7 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 13:01:58.539971 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-6f5a61a4-6c82-459a-8043-532faec185ba tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-618694059", "imageRef": "d01e1b62-4f14-4f64-9d63-d155732e33e8", "flavorRef": "452", "networks": [{"uuid": "a571d6c9-2f13-4763-96af-a092586944f2"}]}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:01:58.575417 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-78f81b9e-7cd2-4659-90fb-62f459877acd tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "POST /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.821312 Nov 23 13:01:58.577500 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 249/460] 10.222.0.60 () {60 vars in 1322 bytes} [Tue Nov 23 13:01:57 2021] POST /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45/os-volume_attachments => generated 194 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 13:01:58.696064 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.network.neutron [None req-6f5a61a4-6c82-459a-8043-532faec185ba tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] validate_networks() for [('a571d6c9-2f13-4763-96af-a092586944f2', None, None, None)] {{(pid=100974) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Nov 23 13:01:58.785806 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-310675df-4c0e-4003-8fdb-79dd05e50155 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:01:58.787863 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-310675df-4c0e-4003-8fdb-79dd05e50155 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:58.806760 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-310675df-4c0e-4003-8fdb-79dd05e50155 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:58.807886 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-310675df-4c0e-4003-8fdb-79dd05e50155 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:58.809683 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-310675df-4c0e-4003-8fdb-79dd05e50155 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:58.810354 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-310675df-4c0e-4003-8fdb-79dd05e50155 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:58.957931 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-310675df-4c0e-4003-8fdb-79dd05e50155 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action" status: 200 len: 28670 microversion: 2.20 time: 0.177148 Nov 23 13:01:58.962072 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 250/461] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:01:58 2021] POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action => generated 28670 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:01:59.674824 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.virt.hardware [None req-6f5a61a4-6c82-459a-8043-532faec185ba tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Flavor limits 0:0:0 {{(pid=100974) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 23 13:01:59.675830 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.virt.hardware [None req-6f5a61a4-6c82-459a-8043-532faec185ba tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Image limits 0:0:0 {{(pid=100974) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 23 13:01:59.676502 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.virt.hardware [None req-6f5a61a4-6c82-459a-8043-532faec185ba tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Flavor pref 0:0:0 {{(pid=100974) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 23 13:01:59.677094 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.virt.hardware [None req-6f5a61a4-6c82-459a-8043-532faec185ba tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Image pref 0:0:0 {{(pid=100974) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 23 13:01:59.677660 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.virt.hardware [None req-6f5a61a4-6c82-459a-8043-532faec185ba tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100974) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 23 13:01:59.692957 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-6f5a61a4-6c82-459a-8043-532faec185ba tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:59.694020 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-6f5a61a4-6c82-459a-8043-532faec185ba tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:59.695630 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-6f5a61a4-6c82-459a-8043-532faec185ba tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:01:59.696515 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-6f5a61a4-6c82-459a-8043-532faec185ba tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:01:59.743415 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.quota [None req-6f5a61a4-6c82-459a-8043-532faec185ba tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Getting quotas for project 306daa81c2794164a38ae7bc3b322ef2. Resources: {'ram', 'cores', 'instances'} {{(pid=100974) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 13:01:59.751124 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.quota [None req-6f5a61a4-6c82-459a-8043-532faec185ba tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Getting quotas for user ec0fe7fa96d645ecbc1e50fb5595971d and project 306daa81c2794164a38ae7bc3b322ef2. Resources: {'ram', 'cores', 'instances'} {{(pid=100974) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 13:01:59.768599 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-6f5a61a4-6c82-459a-8043-532faec185ba tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Going to run 1 instances... {{(pid=100974) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Nov 23 13:01:59.771593 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-6f5a61a4-6c82-459a-8043-532faec185ba tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] [instance: f44f7229-5fd0-4fbd-9d2a-a4c5a929670e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d01e1b62-4f14-4f64-9d63-d155732e33e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100974) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Nov 23 13:01:59.899919 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-6f5a61a4-6c82-459a-8043-532faec185ba tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.364081 Nov 23 13:01:59.900789 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 212/462] 10.222.0.60 () {60 vars in 1146 bytes} [Tue Nov 23 13:01:58 2021] POST /compute/v2.1/servers => generated 380 bytes in 1366 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 23 13:01:59.922748 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-2df5d4ab-f5e4-42fa-b59b-83ebf7a7d5d1 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:01:59.928449 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-2df5d4ab-f5e4-42fa-b59b-83ebf7a7d5d1 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] [instance: f44f7229-5fd0-4fbd-9d2a-a4c5a929670e] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:01:59.970567 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-7138087b-fb9a-469f-aa59-9e417f87feb5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:01:59.971601 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-7138087b-fb9a-469f-aa59-9e417f87feb5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:00.008966 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7138087b-fb9a-469f-aa59-9e417f87feb5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:00.009956 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7138087b-fb9a-469f-aa59-9e417f87feb5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:00.014735 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7138087b-fb9a-469f-aa59-9e417f87feb5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:00.015334 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7138087b-fb9a-469f-aa59-9e417f87feb5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:00.261917 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-7138087b-fb9a-469f-aa59-9e417f87feb5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action" status: 200 len: 28670 microversion: 2.20 time: 0.294741 Nov 23 13:02:00.262659 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 213/463] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:01:59 2021] POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action => generated 28670 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:02:00.277902 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-2df5d4ab-f5e4-42fa-b59b-83ebf7a7d5d1 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0fe7fa96d645ecbc1e50fb5595971d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306daa81c2794164a38ae7bc3b322ef2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:02:00.300867 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-2df5d4ab-f5e4-42fa-b59b-83ebf7a7d5d1 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] 10.222.0.60 "GET /compute/v2.1/servers/f44f7229-5fd0-4fbd-9d2a-a4c5a929670e" status: 200 len: 1213 microversion: 2.1 time: 0.392759 Nov 23 13:02:00.309985 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 251/464] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:01:59 2021] GET /compute/v2.1/servers/f44f7229-5fd0-4fbd-9d2a-a4c5a929670e => generated 1213 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:02:01.281939 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-d55677b5-8fa8-4ac0-8e3e-168475f84dc2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:02:01.285141 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-d55677b5-8fa8-4ac0-8e3e-168475f84dc2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:01.317132 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-4b4a6c74-8560-4fe4-ae20-8cbf25f5a88e tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:02:01.318119 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-4b4a6c74-8560-4fe4-ae20-8cbf25f5a88e tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] [instance: f44f7229-5fd0-4fbd-9d2a-a4c5a929670e] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:01.324629 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d55677b5-8fa8-4ac0-8e3e-168475f84dc2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:01.325389 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d55677b5-8fa8-4ac0-8e3e-168475f84dc2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:01.327033 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d55677b5-8fa8-4ac0-8e3e-168475f84dc2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:01.327652 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d55677b5-8fa8-4ac0-8e3e-168475f84dc2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:01.338556 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4b4a6c74-8560-4fe4-ae20-8cbf25f5a88e tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:01.339282 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4b4a6c74-8560-4fe4-ae20-8cbf25f5a88e tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:01.340467 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4b4a6c74-8560-4fe4-ae20-8cbf25f5a88e tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:01.341066 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4b4a6c74-8560-4fe4-ae20-8cbf25f5a88e tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:01.568340 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-d55677b5-8fa8-4ac0-8e3e-168475f84dc2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action" status: 200 len: 28670 microversion: 2.20 time: 0.297108 Nov 23 13:02:01.569284 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 214/465] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:02:01 2021] POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action => generated 28670 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:02:01.649496 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-4b4a6c74-8560-4fe4-ae20-8cbf25f5a88e tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0fe7fa96d645ecbc1e50fb5595971d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306daa81c2794164a38ae7bc3b322ef2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:02:01.664755 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-4b4a6c74-8560-4fe4-ae20-8cbf25f5a88e tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] 10.222.0.60 "GET /compute/v2.1/servers/f44f7229-5fd0-4fbd-9d2a-a4c5a929670e" status: 200 len: 1265 microversion: 2.1 time: 0.351250 Nov 23 13:02:01.666616 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 252/466] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:02:01 2021] GET /compute/v2.1/servers/f44f7229-5fd0-4fbd-9d2a-a4c5a929670e => generated 1265 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 13:02:02.583854 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-63242071-f45f-4f43-afa0-9e8f0783b043 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:02:02.585789 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-63242071-f45f-4f43-afa0-9e8f0783b043 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:02.610423 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-63242071-f45f-4f43-afa0-9e8f0783b043 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:02.615186 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-63242071-f45f-4f43-afa0-9e8f0783b043 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:02.616526 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-63242071-f45f-4f43-afa0-9e8f0783b043 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:02.617072 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-63242071-f45f-4f43-afa0-9e8f0783b043 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:02.683706 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-fbb17500-fb1e-42e4-9e5f-bbb8fe8c948c tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:02:02.685965 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-fbb17500-fb1e-42e4-9e5f-bbb8fe8c948c tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] [instance: f44f7229-5fd0-4fbd-9d2a-a4c5a929670e] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:02.697016 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-fbb17500-fb1e-42e4-9e5f-bbb8fe8c948c tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:02.697729 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-fbb17500-fb1e-42e4-9e5f-bbb8fe8c948c tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:02.698659 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-fbb17500-fb1e-42e4-9e5f-bbb8fe8c948c tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:02.699268 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-fbb17500-fb1e-42e4-9e5f-bbb8fe8c948c tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:02.926604 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-fbb17500-fb1e-42e4-9e5f-bbb8fe8c948c tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0fe7fa96d645ecbc1e50fb5595971d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306daa81c2794164a38ae7bc3b322ef2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:02:02.939801 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-fbb17500-fb1e-42e4-9e5f-bbb8fe8c948c tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] 10.222.0.60 "GET /compute/v2.1/servers/f44f7229-5fd0-4fbd-9d2a-a4c5a929670e" status: 200 len: 1271 microversion: 2.1 time: 0.260393 Nov 23 13:02:02.940479 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 253/467] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:02:02 2021] GET /compute/v2.1/servers/f44f7229-5fd0-4fbd-9d2a-a4c5a929670e => generated 1271 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:02:02.978842 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-63242071-f45f-4f43-afa0-9e8f0783b043 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action" status: 200 len: 28670 microversion: 2.20 time: 0.401081 Nov 23 13:02:02.979511 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 215/468] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:02:02 2021] POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action => generated 28670 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:02:03.974886 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-229c4575-e9cf-48f3-8cf9-d821a31f818b tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:02:03.975515 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-229c4575-e9cf-48f3-8cf9-d821a31f818b tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] [instance: f44f7229-5fd0-4fbd-9d2a-a4c5a929670e] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:03.995754 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-8f7bb7c8-b0c2-4e34-9376-0764f39bdaa6 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:02:03.998886 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-8f7bb7c8-b0c2-4e34-9376-0764f39bdaa6 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:04.016121 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-229c4575-e9cf-48f3-8cf9-d821a31f818b tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:04.017316 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8f7bb7c8-b0c2-4e34-9376-0764f39bdaa6 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:04.017916 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8f7bb7c8-b0c2-4e34-9376-0764f39bdaa6 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:04.019905 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8f7bb7c8-b0c2-4e34-9376-0764f39bdaa6 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:04.021466 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-229c4575-e9cf-48f3-8cf9-d821a31f818b tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:04.021650 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8f7bb7c8-b0c2-4e34-9376-0764f39bdaa6 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:04.024755 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-229c4575-e9cf-48f3-8cf9-d821a31f818b tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:04.028676 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-229c4575-e9cf-48f3-8cf9-d821a31f818b tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:04.235801 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-8f7bb7c8-b0c2-4e34-9376-0764f39bdaa6 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action" status: 200 len: 28670 microversion: 2.20 time: 0.247237 Nov 23 13:02:04.237221 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 216/469] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:02:03 2021] POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action => generated 28670 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 13:02:04.611999 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-229c4575-e9cf-48f3-8cf9-d821a31f818b tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0fe7fa96d645ecbc1e50fb5595971d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306daa81c2794164a38ae7bc3b322ef2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:02:04.632615 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-229c4575-e9cf-48f3-8cf9-d821a31f818b tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] 10.222.0.60 "GET /compute/v2.1/servers/f44f7229-5fd0-4fbd-9d2a-a4c5a929670e" status: 200 len: 1313 microversion: 2.1 time: 0.678880 Nov 23 13:02:04.640669 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 254/470] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:02:03 2021] GET /compute/v2.1/servers/f44f7229-5fd0-4fbd-9d2a-a4c5a929670e => generated 1313 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:02:04.708490 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-62f2e1e8-cb97-471d-9e43-e4cb863b57a6 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b927f869-c09a-4e1a-99f8-347c729aa925"}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:02:04.710840 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-62f2e1e8-cb97-471d-9e43-e4cb863b57a6 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: 12bb9b8b-86ee-463f-a3be-95894290b739] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:04.721340 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-62f2e1e8-cb97-471d-9e43-e4cb863b57a6 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:04.722059 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-62f2e1e8-cb97-471d-9e43-e4cb863b57a6 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:04.723084 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-62f2e1e8-cb97-471d-9e43-e4cb863b57a6 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:04.724290 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-62f2e1e8-cb97-471d-9e43-e4cb863b57a6 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:05.044950 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.wsgi [None req-62f2e1e8-cb97-471d-9e43-e4cb863b57a6 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] HTTP exception thrown: Invalid volume: volume b927f869-c09a-4e1a-99f8-347c729aa925 is already attached to instances: 12bb9b8b-86ee-463f-a3be-95894290b739 Nov 23 13:02:05.045628 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-62f2e1e8-cb97-471d-9e43-e4cb863b57a6 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Returning 400 to user: Invalid volume: volume b927f869-c09a-4e1a-99f8-347c729aa925 is already attached to instances: 12bb9b8b-86ee-463f-a3be-95894290b739 {{(pid=100974) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Nov 23 13:02:05.046394 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-62f2e1e8-cb97-471d-9e43-e4cb863b57a6 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "POST /compute/v2.1/servers/12bb9b8b-86ee-463f-a3be-95894290b739/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.358686 Nov 23 13:02:05.051602 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 217/471] 10.222.0.60 () {60 vars in 1322 bytes} [Tue Nov 23 13:02:04 2021] POST /compute/v2.1/servers/12bb9b8b-86ee-463f-a3be-95894290b739/os-volume_attachments => generated 174 bytes in 365 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 23 13:02:05.248691 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-b4895cf9-15ae-45d9-81b2-408b4adc3e93 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:02:05.250012 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-bdcc7f53-7f9a-4686-9df1-62bccc480a0a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:02:05.251359 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-b4895cf9-15ae-45d9-81b2-408b4adc3e93 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: 12bb9b8b-86ee-463f-a3be-95894290b739] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:05.251519 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-bdcc7f53-7f9a-4686-9df1-62bccc480a0a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:05.268429 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b4895cf9-15ae-45d9-81b2-408b4adc3e93 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:05.269356 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b4895cf9-15ae-45d9-81b2-408b4adc3e93 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:05.270393 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b4895cf9-15ae-45d9-81b2-408b4adc3e93 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:05.271286 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b4895cf9-15ae-45d9-81b2-408b4adc3e93 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:05.272152 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-bdcc7f53-7f9a-4686-9df1-62bccc480a0a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:05.276054 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-bdcc7f53-7f9a-4686-9df1-62bccc480a0a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:05.277976 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-bdcc7f53-7f9a-4686-9df1-62bccc480a0a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:05.278485 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-bdcc7f53-7f9a-4686-9df1-62bccc480a0a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:05.445202 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-bdcc7f53-7f9a-4686-9df1-62bccc480a0a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action" status: 200 len: 28670 microversion: 2.20 time: 0.199356 Nov 23 13:02:05.448282 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 218/472] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:02:05 2021] POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action => generated 28670 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 13:02:05.601537 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.objects.instance [None req-b4895cf9-15ae-45d9-81b2-408b4adc3e93 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lazy-loading 'services' on Instance uuid 12bb9b8b-86ee-463f-a3be-95894290b739 {{(pid=100973) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 23 13:02:05.658368 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-f08791e2-5f83-4388-a968-8c311b256a02 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:02:05.659785 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-f08791e2-5f83-4388-a968-8c311b256a02 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] [instance: f44f7229-5fd0-4fbd-9d2a-a4c5a929670e] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:05.679130 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f08791e2-5f83-4388-a968-8c311b256a02 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:05.682487 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f08791e2-5f83-4388-a968-8c311b256a02 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:05.683852 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f08791e2-5f83-4388-a968-8c311b256a02 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:05.684502 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f08791e2-5f83-4388-a968-8c311b256a02 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:05.934501 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-b4895cf9-15ae-45d9-81b2-408b4adc3e93 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "DELETE /compute/v2.1/servers/12bb9b8b-86ee-463f-a3be-95894290b739/os-volume_attachments/b927f869-c09a-4e1a-99f8-347c729aa925" status: 202 len: 0 microversion: 2.1 time: 0.690194 Nov 23 13:02:05.938697 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 255/473] 10.222.0.60 () {58 vars in 1415 bytes} [Tue Nov 23 13:02:05 2021] DELETE /compute/v2.1/servers/12bb9b8b-86ee-463f-a3be-95894290b739/os-volume_attachments/b927f869-c09a-4e1a-99f8-347c729aa925 => generated 0 bytes in 696 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:02:05.963220 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-e62c7030-d6ba-4589-8aa5-d6856116ab10 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:02:05.977048 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-e62c7030-d6ba-4589-8aa5-d6856116ab10 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: 12bb9b8b-86ee-463f-a3be-95894290b739] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:05.995825 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e62c7030-d6ba-4589-8aa5-d6856116ab10 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:05.995825 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e62c7030-d6ba-4589-8aa5-d6856116ab10 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:05.995825 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e62c7030-d6ba-4589-8aa5-d6856116ab10 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:05.995825 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e62c7030-d6ba-4589-8aa5-d6856116ab10 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:06.106317 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-e62c7030-d6ba-4589-8aa5-d6856116ab10 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/12bb9b8b-86ee-463f-a3be-95894290b739/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.166116 Nov 23 13:02:06.107573 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 256/474] 10.222.0.60 () {58 vars in 1301 bytes} [Tue Nov 23 13:02:05 2021] GET /compute/v2.1/servers/12bb9b8b-86ee-463f-a3be-95894290b739/os-volume_attachments => generated 197 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 13:02:06.483131 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-f08791e2-5f83-4388-a968-8c311b256a02 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0fe7fa96d645ecbc1e50fb5595971d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306daa81c2794164a38ae7bc3b322ef2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:02:06.492055 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-eb515364-0beb-4130-9596-620f428d3756 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Action: 'create', calling method: .version_select at 0x7f18706d6700>, body: {"keypair": {"name": "tempest-TestShelveInstance-984203030"}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:02:06.509321 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-f08791e2-5f83-4388-a968-8c311b256a02 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] 10.222.0.60 "GET /compute/v2.1/servers/f44f7229-5fd0-4fbd-9d2a-a4c5a929670e" status: 200 len: 1313 microversion: 2.1 time: 0.855983 Nov 23 13:02:06.524043 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 219/475] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:02:05 2021] GET /compute/v2.1/servers/f44f7229-5fd0-4fbd-9d2a-a4c5a929670e => generated 1313 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 13:02:06.524493 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-702f3b4b-7daa-4c0b-b932-237d6694c75c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:02:06.526499 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-702f3b4b-7daa-4c0b-b932-237d6694c75c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:06.543824 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-702f3b4b-7daa-4c0b-b932-237d6694c75c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:06.545186 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-702f3b4b-7daa-4c0b-b932-237d6694c75c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:06.548203 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-702f3b4b-7daa-4c0b-b932-237d6694c75c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:06.550031 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-702f3b4b-7daa-4c0b-b932-237d6694c75c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:06.556052 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.quota [None req-eb515364-0beb-4130-9596-620f428d3756 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Getting quotas for project a76cd93551c243ffac2329a86c7fce12. Resources: {'key_pairs'} {{(pid=100973) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 13:02:06.560645 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.quota [None req-eb515364-0beb-4130-9596-620f428d3756 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Getting quotas for user e1f010313d3e4875994e8537e8c9c558 and project a76cd93551c243ffac2329a86c7fce12. Resources: {'key_pairs'} {{(pid=100973) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 13:02:06.729147 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-702f3b4b-7daa-4c0b-b932-237d6694c75c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action" status: 200 len: 28670 microversion: 2.20 time: 0.210634 Nov 23 13:02:06.731171 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 220/476] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:02:06 2021] POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action => generated 28670 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:02:06.740971 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [req-9ee24a78-3e60-4934-9623-9672c8eb2378 req-71de220e-63aa-44ea-b178-db2abfb35d26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f44f7229-5fd0-4fbd-9d2a-a4c5a929670e", "tag": "72d7fc77-8138-47bc-aa6c-3a989004e0ed"}]} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:02:06.742776 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 13:02:06.742776 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: warnings.warn(msg) Nov 23 13:02:06.753888 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [req-9ee24a78-3e60-4934-9623-9672c8eb2378 req-71de220e-63aa-44ea-b178-db2abfb35d26 service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:06.755597 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [req-9ee24a78-3e60-4934-9623-9672c8eb2378 req-71de220e-63aa-44ea-b178-db2abfb35d26 service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:06.777751 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.compute.server_external_events [req-9ee24a78-3e60-4934-9623-9672c8eb2378 req-71de220e-63aa-44ea-b178-db2abfb35d26 service nova] Creating event network-changed:72d7fc77-8138-47bc-aa6c-3a989004e0ed for instance f44f7229-5fd0-4fbd-9d2a-a4c5a929670e on hv-cinder-81888 Nov 23 13:02:06.782801 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [req-9ee24a78-3e60-4934-9623-9672c8eb2378 req-71de220e-63aa-44ea-b178-db2abfb35d26 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046803 Nov 23 13:02:06.783644 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 221/477] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Nov 23 13:02:06 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 13:02:06.895277 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.quota [None req-eb515364-0beb-4130-9596-620f428d3756 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Getting quotas for project a76cd93551c243ffac2329a86c7fce12. Resources: {'key_pairs'} {{(pid=100973) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 13:02:06.899730 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.quota [None req-eb515364-0beb-4130-9596-620f428d3756 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Getting quotas for user e1f010313d3e4875994e8537e8c9c558 and project a76cd93551c243ffac2329a86c7fce12. Resources: {'key_pairs'} {{(pid=100973) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 13:02:06.913533 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-eb515364-0beb-4130-9596-620f428d3756 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 2311 microversion: 2.1 time: 0.804624 Nov 23 13:02:06.914386 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 257/478] 10.222.0.60 () {60 vars in 1157 bytes} [Tue Nov 23 13:02:06 2021] POST /compute/v2.1/os-keypairs => generated 2311 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:02:07.119730 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-945bc30f-84f8-4dd6-ba10-fcc9ee9fa776 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:02:07.121056 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-945bc30f-84f8-4dd6-ba10-fcc9ee9fa776 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: 12bb9b8b-86ee-463f-a3be-95894290b739] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:07.130963 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-945bc30f-84f8-4dd6-ba10-fcc9ee9fa776 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:07.131572 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-945bc30f-84f8-4dd6-ba10-fcc9ee9fa776 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:07.132511 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-945bc30f-84f8-4dd6-ba10-fcc9ee9fa776 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:07.133056 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-945bc30f-84f8-4dd6-ba10-fcc9ee9fa776 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:07.209541 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-945bc30f-84f8-4dd6-ba10-fcc9ee9fa776 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/12bb9b8b-86ee-463f-a3be-95894290b739/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094248 Nov 23 13:02:07.210588 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 222/479] 10.222.0.60 () {58 vars in 1301 bytes} [Tue Nov 23 13:02:07 2021] GET /compute/v2.1/servers/12bb9b8b-86ee-463f-a3be-95894290b739/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 13:02:07.532026 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-53290830-84a5-4e2b-a435-984fae701a15 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:02:07.533323 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-53290830-84a5-4e2b-a435-984fae701a15 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] [instance: f44f7229-5fd0-4fbd-9d2a-a4c5a929670e] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:07.543019 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-53290830-84a5-4e2b-a435-984fae701a15 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:07.543813 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-53290830-84a5-4e2b-a435-984fae701a15 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:07.544852 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-53290830-84a5-4e2b-a435-984fae701a15 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:07.545441 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-53290830-84a5-4e2b-a435-984fae701a15 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:07.742881 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-466c3368-4675-46c0-855f-e94f6e24d149 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:02:07.743853 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-466c3368-4675-46c0-855f-e94f6e24d149 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:07.753305 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-466c3368-4675-46c0-855f-e94f6e24d149 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:07.753750 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-466c3368-4675-46c0-855f-e94f6e24d149 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:07.754753 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-466c3368-4675-46c0-855f-e94f6e24d149 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:07.755184 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-466c3368-4675-46c0-855f-e94f6e24d149 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:07.928587 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-53290830-84a5-4e2b-a435-984fae701a15 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0fe7fa96d645ecbc1e50fb5595971d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306daa81c2794164a38ae7bc3b322ef2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:02:07.941756 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-53290830-84a5-4e2b-a435-984fae701a15 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] 10.222.0.60 "GET /compute/v2.1/servers/f44f7229-5fd0-4fbd-9d2a-a4c5a929670e" status: 200 len: 1313 microversion: 2.1 time: 0.413756 Nov 23 13:02:07.943080 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 258/480] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:02:07 2021] GET /compute/v2.1/servers/f44f7229-5fd0-4fbd-9d2a-a4c5a929670e => generated 1313 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:02:07.966465 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-466c3368-4675-46c0-855f-e94f6e24d149 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action" status: 200 len: 28670 microversion: 2.20 time: 0.227230 Nov 23 13:02:07.967788 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 223/481] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:02:07 2021] POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action => generated 28670 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:02:08.221848 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-92181886-4ec2-40a7-ae4b-1f85142b32c4 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:02:08.222813 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-92181886-4ec2-40a7-ae4b-1f85142b32c4 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: 12bb9b8b-86ee-463f-a3be-95894290b739] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:08.233843 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-92181886-4ec2-40a7-ae4b-1f85142b32c4 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:08.240083 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-92181886-4ec2-40a7-ae4b-1f85142b32c4 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:08.241269 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-92181886-4ec2-40a7-ae4b-1f85142b32c4 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:08.241716 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-92181886-4ec2-40a7-ae4b-1f85142b32c4 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:08.350474 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-92181886-4ec2-40a7-ae4b-1f85142b32c4 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/12bb9b8b-86ee-463f-a3be-95894290b739/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.132823 Nov 23 13:02:08.355238 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 259/482] 10.222.0.60 () {58 vars in 1301 bytes} [Tue Nov 23 13:02:08 2021] GET /compute/v2.1/servers/12bb9b8b-86ee-463f-a3be-95894290b739/os-volume_attachments => generated 197 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 13:02:08.961795 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-079e8fca-ae41-4448-9a94-d8452125df1b tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:02:08.963111 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-079e8fca-ae41-4448-9a94-d8452125df1b tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] [instance: f44f7229-5fd0-4fbd-9d2a-a4c5a929670e] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:08.974887 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-079e8fca-ae41-4448-9a94-d8452125df1b tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:08.975693 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-079e8fca-ae41-4448-9a94-d8452125df1b tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:08.976714 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-079e8fca-ae41-4448-9a94-d8452125df1b tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:08.977664 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-079e8fca-ae41-4448-9a94-d8452125df1b tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:08.978121 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-523f264a-32f3-4f4f-af36-aaa507cae5eb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:02:08.979041 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-523f264a-32f3-4f4f-af36-aaa507cae5eb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:08.991719 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-523f264a-32f3-4f4f-af36-aaa507cae5eb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:08.992056 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-523f264a-32f3-4f4f-af36-aaa507cae5eb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:08.993153 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-523f264a-32f3-4f4f-af36-aaa507cae5eb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:08.999258 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-523f264a-32f3-4f4f-af36-aaa507cae5eb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:09.203542 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-523f264a-32f3-4f4f-af36-aaa507cae5eb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action" status: 200 len: 28670 microversion: 2.20 time: 0.228820 Nov 23 13:02:09.209194 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 260/483] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:02:08 2021] POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action => generated 28670 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 13:02:09.269448 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-079e8fca-ae41-4448-9a94-d8452125df1b tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0fe7fa96d645ecbc1e50fb5595971d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306daa81c2794164a38ae7bc3b322ef2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:02:09.278603 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-079e8fca-ae41-4448-9a94-d8452125df1b tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] 10.222.0.60 "GET /compute/v2.1/servers/f44f7229-5fd0-4fbd-9d2a-a4c5a929670e" status: 200 len: 1313 microversion: 2.1 time: 0.323144 Nov 23 13:02:09.286893 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 224/484] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:02:08 2021] GET /compute/v2.1/servers/f44f7229-5fd0-4fbd-9d2a-a4c5a929670e => generated 1313 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:02:09.364793 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-9866c2a2-32ae-4f76-b0c8-7037f5023f52 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:02:09.365832 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-9866c2a2-32ae-4f76-b0c8-7037f5023f52 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: 12bb9b8b-86ee-463f-a3be-95894290b739] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:09.374944 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-9866c2a2-32ae-4f76-b0c8-7037f5023f52 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:09.375391 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-9866c2a2-32ae-4f76-b0c8-7037f5023f52 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:09.376560 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-9866c2a2-32ae-4f76-b0c8-7037f5023f52 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:09.376990 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-9866c2a2-32ae-4f76-b0c8-7037f5023f52 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:09.461961 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-9866c2a2-32ae-4f76-b0c8-7037f5023f52 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/12bb9b8b-86ee-463f-a3be-95894290b739/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.101976 Nov 23 13:02:09.466568 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 261/485] 10.222.0.60 () {58 vars in 1301 bytes} [Tue Nov 23 13:02:09 2021] GET /compute/v2.1/servers/12bb9b8b-86ee-463f-a3be-95894290b739/os-volume_attachments => generated 197 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 13:02:10.217458 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-0ca2b2b4-ce0b-4234-9da0-8a99e189bb07 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:02:10.218424 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-0ca2b2b4-ce0b-4234-9da0-8a99e189bb07 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:10.233880 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0ca2b2b4-ce0b-4234-9da0-8a99e189bb07 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:10.234317 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0ca2b2b4-ce0b-4234-9da0-8a99e189bb07 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:10.235108 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0ca2b2b4-ce0b-4234-9da0-8a99e189bb07 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:10.236461 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0ca2b2b4-ce0b-4234-9da0-8a99e189bb07 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:10.296219 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-424a73d2-a009-4aa3-83c8-3de23e2c55b3 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:02:10.297546 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-424a73d2-a009-4aa3-83c8-3de23e2c55b3 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] [instance: f44f7229-5fd0-4fbd-9d2a-a4c5a929670e] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:10.312744 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-424a73d2-a009-4aa3-83c8-3de23e2c55b3 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:10.313621 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-424a73d2-a009-4aa3-83c8-3de23e2c55b3 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:10.314617 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-424a73d2-a009-4aa3-83c8-3de23e2c55b3 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:10.318980 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-424a73d2-a009-4aa3-83c8-3de23e2c55b3 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:10.469988 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-0ca2b2b4-ce0b-4234-9da0-8a99e189bb07 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action" status: 200 len: 28670 microversion: 2.20 time: 0.256334 Nov 23 13:02:10.471410 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 225/486] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:02:10 2021] POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action => generated 28670 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:02:10.480623 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-dffc2f6d-1276-4801-a1c0-003eb4330983 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:02:10.483525 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-dffc2f6d-1276-4801-a1c0-003eb4330983 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: 12bb9b8b-86ee-463f-a3be-95894290b739] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:10.495143 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-dffc2f6d-1276-4801-a1c0-003eb4330983 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:10.495618 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-dffc2f6d-1276-4801-a1c0-003eb4330983 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:10.496724 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-dffc2f6d-1276-4801-a1c0-003eb4330983 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:10.498586 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-dffc2f6d-1276-4801-a1c0-003eb4330983 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:10.601998 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-dffc2f6d-1276-4801-a1c0-003eb4330983 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/12bb9b8b-86ee-463f-a3be-95894290b739/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.129086 Nov 23 13:02:10.602726 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 226/487] 10.222.0.60 () {58 vars in 1301 bytes} [Tue Nov 23 13:02:10 2021] GET /compute/v2.1/servers/12bb9b8b-86ee-463f-a3be-95894290b739/os-volume_attachments => generated 197 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 13:02:10.739867 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-424a73d2-a009-4aa3-83c8-3de23e2c55b3 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0fe7fa96d645ecbc1e50fb5595971d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306daa81c2794164a38ae7bc3b322ef2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:02:10.748896 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-424a73d2-a009-4aa3-83c8-3de23e2c55b3 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] 10.222.0.60 "GET /compute/v2.1/servers/f44f7229-5fd0-4fbd-9d2a-a4c5a929670e" status: 200 len: 1313 microversion: 2.1 time: 0.457066 Nov 23 13:02:10.749472 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 262/488] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:02:10 2021] GET /compute/v2.1/servers/f44f7229-5fd0-4fbd-9d2a-a4c5a929670e => generated 1313 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:02:11.485161 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-bad6c29b-4c8d-48d2-82b9-19b0cd957b58 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:02:11.486126 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-bad6c29b-4c8d-48d2-82b9-19b0cd957b58 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:11.496883 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-bad6c29b-4c8d-48d2-82b9-19b0cd957b58 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:11.497333 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-bad6c29b-4c8d-48d2-82b9-19b0cd957b58 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:11.498145 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-bad6c29b-4c8d-48d2-82b9-19b0cd957b58 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:11.498747 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-bad6c29b-4c8d-48d2-82b9-19b0cd957b58 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:11.615033 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-6221437e-8c21-4e75-a5c3-9bca80b4575e tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:02:11.615975 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-6221437e-8c21-4e75-a5c3-9bca80b4575e tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: 12bb9b8b-86ee-463f-a3be-95894290b739] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:11.624070 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6221437e-8c21-4e75-a5c3-9bca80b4575e tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:11.624766 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6221437e-8c21-4e75-a5c3-9bca80b4575e tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:11.626005 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6221437e-8c21-4e75-a5c3-9bca80b4575e tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:11.626439 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6221437e-8c21-4e75-a5c3-9bca80b4575e tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:11.694116 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-6221437e-8c21-4e75-a5c3-9bca80b4575e tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/12bb9b8b-86ee-463f-a3be-95894290b739/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082894 Nov 23 13:02:11.694726 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 263/489] 10.222.0.60 () {58 vars in 1301 bytes} [Tue Nov 23 13:02:11 2021] GET /compute/v2.1/servers/12bb9b8b-86ee-463f-a3be-95894290b739/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 13:02:11.698609 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-bad6c29b-4c8d-48d2-82b9-19b0cd957b58 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action" status: 200 len: 28670 microversion: 2.20 time: 0.219083 Nov 23 13:02:11.699311 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 227/490] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:02:11 2021] POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action => generated 28670 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:02:11.765844 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-5de2edce-588a-4549-b878-90acc2116714 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:02:11.766560 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-5de2edce-588a-4549-b878-90acc2116714 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] [instance: f44f7229-5fd0-4fbd-9d2a-a4c5a929670e] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:11.774410 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5de2edce-588a-4549-b878-90acc2116714 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:11.774858 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5de2edce-588a-4549-b878-90acc2116714 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:11.775651 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5de2edce-588a-4549-b878-90acc2116714 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:11.776085 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5de2edce-588a-4549-b878-90acc2116714 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:11.921602 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-f30a254e-7042-4013-8f4f-24dee7475d94 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:02:11.922685 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-f30a254e-7042-4013-8f4f-24dee7475d94 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: 53633a05-ad06-454a-b540-5fc01821ae45] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:11.937498 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f30a254e-7042-4013-8f4f-24dee7475d94 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:11.937951 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f30a254e-7042-4013-8f4f-24dee7475d94 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:11.938892 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f30a254e-7042-4013-8f4f-24dee7475d94 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:11.939468 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f30a254e-7042-4013-8f4f-24dee7475d94 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:11.984972 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-5de2edce-588a-4549-b878-90acc2116714 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0fe7fa96d645ecbc1e50fb5595971d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306daa81c2794164a38ae7bc3b322ef2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:02:11.994834 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-5de2edce-588a-4549-b878-90acc2116714 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] 10.222.0.60 "GET /compute/v2.1/servers/f44f7229-5fd0-4fbd-9d2a-a4c5a929670e" status: 200 len: 1313 microversion: 2.1 time: 0.232566 Nov 23 13:02:11.996431 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 264/491] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:02:11 2021] GET /compute/v2.1/servers/f44f7229-5fd0-4fbd-9d2a-a4c5a929670e => generated 1313 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:02:12.011422 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.objects.instance [None req-f30a254e-7042-4013-8f4f-24dee7475d94 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lazy-loading 'flavor' on Instance uuid 53633a05-ad06-454a-b540-5fc01821ae45 {{(pid=100974) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 23 13:02:12.259178 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-f30a254e-7042-4013-8f4f-24dee7475d94 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "POST /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45/action" status: 200 len: 32 microversion: 2.1 time: 0.341952 Nov 23 13:02:12.260201 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 228/492] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:02:11 2021] POST /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45/action => generated 32 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 23 13:02:12.269621 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-25ca576d-fd10-49b1-b4be-900cedb5e932 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:02:12.270241 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-25ca576d-fd10-49b1-b4be-900cedb5e932 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: 53633a05-ad06-454a-b540-5fc01821ae45] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:12.279485 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-25ca576d-fd10-49b1-b4be-900cedb5e932 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:12.279953 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-25ca576d-fd10-49b1-b4be-900cedb5e932 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:12.280930 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-25ca576d-fd10-49b1-b4be-900cedb5e932 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:12.281395 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-25ca576d-fd10-49b1-b4be-900cedb5e932 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:12.496886 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-25ca576d-fd10-49b1-b4be-900cedb5e932 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:02:12.510355 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-25ca576d-fd10-49b1-b4be-900cedb5e932 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45" status: 200 len: 1564 microversion: 2.1 time: 0.244467 Nov 23 13:02:12.511537 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 265/493] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:02:12 2021] GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45 => generated 1564 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:02:12.708763 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-152cc3df-8bf2-4a3d-8a61-1afd7fe8751e tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:02:12.709799 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-152cc3df-8bf2-4a3d-8a61-1afd7fe8751e tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: 12bb9b8b-86ee-463f-a3be-95894290b739] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:12.711048 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-c9d9cec9-08d8-46ad-92d5-d77d50757075 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:02:12.712036 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-c9d9cec9-08d8-46ad-92d5-d77d50757075 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:12.718047 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-152cc3df-8bf2-4a3d-8a61-1afd7fe8751e tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:12.718492 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-152cc3df-8bf2-4a3d-8a61-1afd7fe8751e tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:12.719466 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-152cc3df-8bf2-4a3d-8a61-1afd7fe8751e tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:12.719814 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c9d9cec9-08d8-46ad-92d5-d77d50757075 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:12.720067 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-152cc3df-8bf2-4a3d-8a61-1afd7fe8751e tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:12.720296 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c9d9cec9-08d8-46ad-92d5-d77d50757075 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:12.721076 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c9d9cec9-08d8-46ad-92d5-d77d50757075 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:12.721502 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c9d9cec9-08d8-46ad-92d5-d77d50757075 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:12.790845 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-152cc3df-8bf2-4a3d-8a61-1afd7fe8751e tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/12bb9b8b-86ee-463f-a3be-95894290b739/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086869 Nov 23 13:02:12.791439 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 229/494] 10.222.0.60 () {58 vars in 1301 bytes} [Tue Nov 23 13:02:12 2021] GET /compute/v2.1/servers/12bb9b8b-86ee-463f-a3be-95894290b739/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 13:02:12.924572 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-c9d9cec9-08d8-46ad-92d5-d77d50757075 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action" status: 200 len: 28670 microversion: 2.20 time: 0.217368 Nov 23 13:02:12.925307 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 266/495] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:02:12 2021] POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action => generated 28670 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 13:02:13.014051 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-d64fa4ec-174b-4508-934f-58aba25f02b6 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:02:13.014668 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-d64fa4ec-174b-4508-934f-58aba25f02b6 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] [instance: f44f7229-5fd0-4fbd-9d2a-a4c5a929670e] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:13.022694 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d64fa4ec-174b-4508-934f-58aba25f02b6 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:13.023138 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d64fa4ec-174b-4508-934f-58aba25f02b6 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:13.023957 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d64fa4ec-174b-4508-934f-58aba25f02b6 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:13.024442 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d64fa4ec-174b-4508-934f-58aba25f02b6 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:13.319985 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-d64fa4ec-174b-4508-934f-58aba25f02b6 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0fe7fa96d645ecbc1e50fb5595971d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306daa81c2794164a38ae7bc3b322ef2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:02:13.329342 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-d64fa4ec-174b-4508-934f-58aba25f02b6 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] 10.222.0.60 "GET /compute/v2.1/servers/f44f7229-5fd0-4fbd-9d2a-a4c5a929670e" status: 200 len: 1313 microversion: 2.1 time: 0.319864 Nov 23 13:02:13.329927 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 230/496] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:02:13 2021] GET /compute/v2.1/servers/f44f7229-5fd0-4fbd-9d2a-a4c5a929670e => generated 1313 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:02:13.529626 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-f678a5fd-9e6d-4949-9e28-bf7832b87a73 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:02:13.530282 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-f678a5fd-9e6d-4949-9e28-bf7832b87a73 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: 53633a05-ad06-454a-b540-5fc01821ae45] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:13.539258 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f678a5fd-9e6d-4949-9e28-bf7832b87a73 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:13.539712 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f678a5fd-9e6d-4949-9e28-bf7832b87a73 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:13.540569 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f678a5fd-9e6d-4949-9e28-bf7832b87a73 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:13.541324 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f678a5fd-9e6d-4949-9e28-bf7832b87a73 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:13.746945 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-f678a5fd-9e6d-4949-9e28-bf7832b87a73 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:02:13.761649 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-f678a5fd-9e6d-4949-9e28-bf7832b87a73 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45" status: 200 len: 1564 microversion: 2.1 time: 0.235938 Nov 23 13:02:13.762623 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 267/497] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:02:13 2021] GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45 => generated 1564 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:02:13.802307 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-11b926d8-cb77-40b5-92be-68a85fce2721 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:02:13.803204 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-11b926d8-cb77-40b5-92be-68a85fce2721 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: 12bb9b8b-86ee-463f-a3be-95894290b739] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:13.811110 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-11b926d8-cb77-40b5-92be-68a85fce2721 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:13.811561 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-11b926d8-cb77-40b5-92be-68a85fce2721 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:13.812372 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-11b926d8-cb77-40b5-92be-68a85fce2721 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:13.812806 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-11b926d8-cb77-40b5-92be-68a85fce2721 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:13.888863 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-11b926d8-cb77-40b5-92be-68a85fce2721 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/12bb9b8b-86ee-463f-a3be-95894290b739/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.090236 Nov 23 13:02:13.889442 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 231/498] 10.222.0.60 () {58 vars in 1301 bytes} [Tue Nov 23 13:02:13 2021] GET /compute/v2.1/servers/12bb9b8b-86ee-463f-a3be-95894290b739/os-volume_attachments => generated 25 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 13:02:13.936994 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-b7c3a515-4aac-4d2a-b4d9-2f55bba9ba79 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:02:13.938139 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-b7c3a515-4aac-4d2a-b4d9-2f55bba9ba79 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:13.946491 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b7c3a515-4aac-4d2a-b4d9-2f55bba9ba79 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:13.946961 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b7c3a515-4aac-4d2a-b4d9-2f55bba9ba79 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:13.947787 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b7c3a515-4aac-4d2a-b4d9-2f55bba9ba79 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:13.948216 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b7c3a515-4aac-4d2a-b4d9-2f55bba9ba79 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:14.076151 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-b7c3a515-4aac-4d2a-b4d9-2f55bba9ba79 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action" status: 200 len: 28670 microversion: 2.20 time: 0.142885 Nov 23 13:02:14.076951 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 268/499] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:02:13 2021] POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action => generated 28670 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:02:14.123380 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-cb492e52-9acb-445a-badf-3bfa7e792833 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1056957323", "imageRef": "d01e1b62-4f14-4f64-9d63-d155732e33e8", "flavorRef": "452", "networks": [{"uuid": "bf33958f-9165-410d-8036-71326a5124b6"}]}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:02:14.193316 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.network.neutron [None req-cb492e52-9acb-445a-badf-3bfa7e792833 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] validate_networks() for [('bf33958f-9165-410d-8036-71326a5124b6', None, None, None)] {{(pid=100974) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Nov 23 13:02:14.346568 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-e3805223-daf8-4f43-aef3-692fd71dd64a tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:02:14.347352 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-e3805223-daf8-4f43-aef3-692fd71dd64a tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] [instance: f44f7229-5fd0-4fbd-9d2a-a4c5a929670e] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:14.355932 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e3805223-daf8-4f43-aef3-692fd71dd64a tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:14.356539 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e3805223-daf8-4f43-aef3-692fd71dd64a tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:14.357313 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e3805223-daf8-4f43-aef3-692fd71dd64a tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:14.357740 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e3805223-daf8-4f43-aef3-692fd71dd64a tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:14.573469 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-e3805223-daf8-4f43-aef3-692fd71dd64a tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0fe7fa96d645ecbc1e50fb5595971d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306daa81c2794164a38ae7bc3b322ef2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:02:14.583721 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-e3805223-daf8-4f43-aef3-692fd71dd64a tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] 10.222.0.60 "GET /compute/v2.1/servers/f44f7229-5fd0-4fbd-9d2a-a4c5a929670e" status: 200 len: 1313 microversion: 2.1 time: 0.240225 Nov 23 13:02:14.584337 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 269/500] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:02:14 2021] GET /compute/v2.1/servers/f44f7229-5fd0-4fbd-9d2a-a4c5a929670e => generated 1313 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:02:14.765069 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.virt.hardware [None req-cb492e52-9acb-445a-badf-3bfa7e792833 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Flavor limits 0:0:0 {{(pid=100974) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 23 13:02:14.765642 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.virt.hardware [None req-cb492e52-9acb-445a-badf-3bfa7e792833 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Image limits 0:0:0 {{(pid=100974) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 23 13:02:14.766224 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.virt.hardware [None req-cb492e52-9acb-445a-badf-3bfa7e792833 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Flavor pref 0:0:0 {{(pid=100974) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 23 13:02:14.766636 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.virt.hardware [None req-cb492e52-9acb-445a-badf-3bfa7e792833 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Image pref 0:0:0 {{(pid=100974) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 23 13:02:14.767301 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.virt.hardware [None req-cb492e52-9acb-445a-badf-3bfa7e792833 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100974) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 23 13:02:14.779022 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-cb492e52-9acb-445a-badf-3bfa7e792833 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:14.779324 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-23db654d-58ff-44b7-93bc-80f9c1d3726e tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:02:14.779896 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-cb492e52-9acb-445a-badf-3bfa7e792833 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:14.780124 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-23db654d-58ff-44b7-93bc-80f9c1d3726e tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: 53633a05-ad06-454a-b540-5fc01821ae45] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:14.780543 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-cb492e52-9acb-445a-badf-3bfa7e792833 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:14.781080 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-cb492e52-9acb-445a-badf-3bfa7e792833 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:14.788482 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-23db654d-58ff-44b7-93bc-80f9c1d3726e tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:14.788920 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-23db654d-58ff-44b7-93bc-80f9c1d3726e tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:14.789731 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-23db654d-58ff-44b7-93bc-80f9c1d3726e tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:14.790149 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-23db654d-58ff-44b7-93bc-80f9c1d3726e tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:14.800506 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.quota [None req-cb492e52-9acb-445a-badf-3bfa7e792833 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Getting quotas for project 9a31364455dc442f8df299a8ad758a4e. Resources: {'ram', 'cores', 'instances'} {{(pid=100974) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 13:02:14.804708 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.quota [None req-cb492e52-9acb-445a-badf-3bfa7e792833 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Getting quotas for user c023f89fd3da4bc8b38963bed4e5cc63 and project 9a31364455dc442f8df299a8ad758a4e. Resources: {'ram', 'cores', 'instances'} {{(pid=100974) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 13:02:14.829625 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-cb492e52-9acb-445a-badf-3bfa7e792833 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Going to run 1 instances... {{(pid=100974) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Nov 23 13:02:14.831986 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-cb492e52-9acb-445a-badf-3bfa7e792833 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: e5f13132-d54e-43f7-8c86-91a4d23d4c35] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d01e1b62-4f14-4f64-9d63-d155732e33e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100974) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Nov 23 13:02:14.906720 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-cb492e52-9acb-445a-badf-3bfa7e792833 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.787166 Nov 23 13:02:14.907534 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 232/501] 10.222.0.60 () {60 vars in 1146 bytes} [Tue Nov 23 13:02:14 2021] POST /compute/v2.1/servers => generated 380 bytes in 789 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 23 13:02:14.917806 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-8a8879fa-9d6c-4de0-9c37-553ddf607609 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:02:14.918413 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-8a8879fa-9d6c-4de0-9c37-553ddf607609 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: e5f13132-d54e-43f7-8c86-91a4d23d4c35] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:15.017474 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-8a8879fa-9d6c-4de0-9c37-553ddf607609 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c023f89fd3da4bc8b38963bed4e5cc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a31364455dc442f8df299a8ad758a4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:02:15.029684 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-8a8879fa-9d6c-4de0-9c37-553ddf607609 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/e5f13132-d54e-43f7-8c86-91a4d23d4c35" status: 200 len: 1218 microversion: 2.1 time: 0.115219 Nov 23 13:02:15.030569 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 233/502] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:02:14 2021] GET /compute/v2.1/servers/e5f13132-d54e-43f7-8c86-91a4d23d4c35 => generated 1218 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:02:15.035835 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-23db654d-58ff-44b7-93bc-80f9c1d3726e tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:02:15.049577 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-23db654d-58ff-44b7-93bc-80f9c1d3726e tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45" status: 200 len: 1564 microversion: 2.1 time: 0.274385 Nov 23 13:02:15.059724 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 270/503] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:02:14 2021] GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45 => generated 1564 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 13:02:15.088755 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-7a99909a-e2a9-4759-8d76-f5802332b0e3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:02:15.091033 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-7a99909a-e2a9-4759-8d76-f5802332b0e3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:15.099799 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7a99909a-e2a9-4759-8d76-f5802332b0e3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:15.100471 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7a99909a-e2a9-4759-8d76-f5802332b0e3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:15.101246 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7a99909a-e2a9-4759-8d76-f5802332b0e3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:15.101675 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7a99909a-e2a9-4759-8d76-f5802332b0e3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:15.187599 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [req-536170ad-28a9-4021-a7d8-67d251496470 req-7d402807-a76e-49f4-a4a5-ac60bd63a42b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f44f7229-5fd0-4fbd-9d2a-a4c5a929670e", "name": "network-vif-plugged", "status": "completed", "tag": "72d7fc77-8138-47bc-aa6c-3a989004e0ed"}]} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:02:15.189622 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 13:02:15.189622 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: warnings.warn(msg) Nov 23 13:02:15.199631 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [req-536170ad-28a9-4021-a7d8-67d251496470 req-7d402807-a76e-49f4-a4a5-ac60bd63a42b service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:15.200070 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [req-536170ad-28a9-4021-a7d8-67d251496470 req-7d402807-a76e-49f4-a4a5-ac60bd63a42b service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:15.217617 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.compute.server_external_events [req-536170ad-28a9-4021-a7d8-67d251496470 req-7d402807-a76e-49f4-a4a5-ac60bd63a42b service nova] Creating event network-vif-plugged:72d7fc77-8138-47bc-aa6c-3a989004e0ed for instance f44f7229-5fd0-4fbd-9d2a-a4c5a929670e on hv-cinder-81888 Nov 23 13:02:15.227436 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [req-536170ad-28a9-4021-a7d8-67d251496470 req-7d402807-a76e-49f4-a4a5-ac60bd63a42b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044172 Nov 23 13:02:15.230007 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 271/504] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Nov 23 13:02:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 13:02:15.253604 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-7a99909a-e2a9-4759-8d76-f5802332b0e3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action" status: 200 len: 28670 microversion: 2.20 time: 0.168911 Nov 23 13:02:15.254264 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 234/505] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:02:15 2021] POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action => generated 28670 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:02:15.600278 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-b203c4ed-5343-4386-a44d-ca3f840d4768 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:02:15.601156 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-b203c4ed-5343-4386-a44d-ca3f840d4768 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] [instance: f44f7229-5fd0-4fbd-9d2a-a4c5a929670e] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:15.609180 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b203c4ed-5343-4386-a44d-ca3f840d4768 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:15.609661 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b203c4ed-5343-4386-a44d-ca3f840d4768 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:15.610440 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b203c4ed-5343-4386-a44d-ca3f840d4768 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:15.610864 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b203c4ed-5343-4386-a44d-ca3f840d4768 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:15.827346 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-b203c4ed-5343-4386-a44d-ca3f840d4768 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0fe7fa96d645ecbc1e50fb5595971d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306daa81c2794164a38ae7bc3b322ef2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:02:15.835625 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-b203c4ed-5343-4386-a44d-ca3f840d4768 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] 10.222.0.60 "GET /compute/v2.1/servers/f44f7229-5fd0-4fbd-9d2a-a4c5a929670e" status: 200 len: 1313 microversion: 2.1 time: 0.240178 Nov 23 13:02:15.836191 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 272/506] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:02:15 2021] GET /compute/v2.1/servers/f44f7229-5fd0-4fbd-9d2a-a4c5a929670e => generated 1313 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:02:16.049719 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-610fa23c-2581-4c1e-9910-d19f17b1abb2 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:02:16.050431 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-610fa23c-2581-4c1e-9910-d19f17b1abb2 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: e5f13132-d54e-43f7-8c86-91a4d23d4c35] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:16.059238 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-610fa23c-2581-4c1e-9910-d19f17b1abb2 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:16.059686 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-610fa23c-2581-4c1e-9910-d19f17b1abb2 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:16.068530 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-610fa23c-2581-4c1e-9910-d19f17b1abb2 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:16.068530 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-610fa23c-2581-4c1e-9910-d19f17b1abb2 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:16.075207 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-761426f0-d942-4ba7-b8bd-b894213111aa tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:02:16.075808 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-761426f0-d942-4ba7-b8bd-b894213111aa tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: 53633a05-ad06-454a-b540-5fc01821ae45] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:16.085939 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-761426f0-d942-4ba7-b8bd-b894213111aa tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:16.086379 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-761426f0-d942-4ba7-b8bd-b894213111aa tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:16.087139 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-761426f0-d942-4ba7-b8bd-b894213111aa tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:16.087583 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-761426f0-d942-4ba7-b8bd-b894213111aa tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:16.182468 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-610fa23c-2581-4c1e-9910-d19f17b1abb2 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c023f89fd3da4bc8b38963bed4e5cc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a31364455dc442f8df299a8ad758a4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:02:16.192004 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-610fa23c-2581-4c1e-9910-d19f17b1abb2 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/e5f13132-d54e-43f7-8c86-91a4d23d4c35" status: 200 len: 1270 microversion: 2.1 time: 0.147308 Nov 23 13:02:16.192886 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 235/507] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:02:16 2021] GET /compute/v2.1/servers/e5f13132-d54e-43f7-8c86-91a4d23d4c35 => generated 1270 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:02:16.265784 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-cbaeecbd-c4ad-4ae8-95ab-2efa6ea54a93 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:02:16.266716 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-cbaeecbd-c4ad-4ae8-95ab-2efa6ea54a93 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:16.274114 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-cbaeecbd-c4ad-4ae8-95ab-2efa6ea54a93 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:16.274558 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-cbaeecbd-c4ad-4ae8-95ab-2efa6ea54a93 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:16.275321 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-cbaeecbd-c4ad-4ae8-95ab-2efa6ea54a93 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:16.275755 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-cbaeecbd-c4ad-4ae8-95ab-2efa6ea54a93 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:16.302621 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-761426f0-d942-4ba7-b8bd-b894213111aa tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:02:16.313215 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-761426f0-d942-4ba7-b8bd-b894213111aa tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45" status: 200 len: 1564 microversion: 2.1 time: 0.241760 Nov 23 13:02:16.313797 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 273/508] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:02:16 2021] GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45 => generated 1564 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:02:16.408955 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-cbaeecbd-c4ad-4ae8-95ab-2efa6ea54a93 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action" status: 200 len: 28670 microversion: 2.20 time: 0.147265 Nov 23 13:02:16.409512 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 236/509] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:02:16 2021] POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action => generated 28670 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 13:02:16.853035 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-e8e2d7dd-d269-4250-ba45-6d9a0a31d10e tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:02:16.853638 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-e8e2d7dd-d269-4250-ba45-6d9a0a31d10e tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] [instance: f44f7229-5fd0-4fbd-9d2a-a4c5a929670e] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:16.864606 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e8e2d7dd-d269-4250-ba45-6d9a0a31d10e tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:16.870839 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e8e2d7dd-d269-4250-ba45-6d9a0a31d10e tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:16.872140 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e8e2d7dd-d269-4250-ba45-6d9a0a31d10e tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:16.873661 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e8e2d7dd-d269-4250-ba45-6d9a0a31d10e tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:17.117086 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-e8e2d7dd-d269-4250-ba45-6d9a0a31d10e tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0fe7fa96d645ecbc1e50fb5595971d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306daa81c2794164a38ae7bc3b322ef2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:02:17.131775 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-e8e2d7dd-d269-4250-ba45-6d9a0a31d10e tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] 10.222.0.60 "GET /compute/v2.1/servers/f44f7229-5fd0-4fbd-9d2a-a4c5a929670e" status: 200 len: 1313 microversion: 2.1 time: 0.282401 Nov 23 13:02:17.132604 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 274/510] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:02:16 2021] GET /compute/v2.1/servers/f44f7229-5fd0-4fbd-9d2a-a4c5a929670e => generated 1313 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:02:17.211796 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-c89005a9-01e7-41a3-892b-586fd280d319 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:02:17.212514 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-c89005a9-01e7-41a3-892b-586fd280d319 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: e5f13132-d54e-43f7-8c86-91a4d23d4c35] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:17.220741 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c89005a9-01e7-41a3-892b-586fd280d319 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:17.221194 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c89005a9-01e7-41a3-892b-586fd280d319 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:17.221968 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c89005a9-01e7-41a3-892b-586fd280d319 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:17.222394 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c89005a9-01e7-41a3-892b-586fd280d319 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:17.331209 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-f4c00b2e-198b-4f89-ab6a-2e9f9d7a0a0e tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:02:17.331931 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-f4c00b2e-198b-4f89-ab6a-2e9f9d7a0a0e tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: 53633a05-ad06-454a-b540-5fc01821ae45] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:17.340101 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f4c00b2e-198b-4f89-ab6a-2e9f9d7a0a0e tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:17.340614 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f4c00b2e-198b-4f89-ab6a-2e9f9d7a0a0e tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:17.341468 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f4c00b2e-198b-4f89-ab6a-2e9f9d7a0a0e tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:17.341969 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f4c00b2e-198b-4f89-ab6a-2e9f9d7a0a0e tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:17.346562 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-c89005a9-01e7-41a3-892b-586fd280d319 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c023f89fd3da4bc8b38963bed4e5cc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a31364455dc442f8df299a8ad758a4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:02:17.359590 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-c89005a9-01e7-41a3-892b-586fd280d319 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/e5f13132-d54e-43f7-8c86-91a4d23d4c35" status: 200 len: 1276 microversion: 2.1 time: 0.151919 Nov 23 13:02:17.360137 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 237/511] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:02:17 2021] GET /compute/v2.1/servers/e5f13132-d54e-43f7-8c86-91a4d23d4c35 => generated 1276 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:02:17.421286 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-e31e6e27-bee1-4182-8d85-ad51da490869 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:02:17.422208 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-e31e6e27-bee1-4182-8d85-ad51da490869 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:17.430107 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e31e6e27-bee1-4182-8d85-ad51da490869 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:17.430630 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e31e6e27-bee1-4182-8d85-ad51da490869 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:17.431580 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e31e6e27-bee1-4182-8d85-ad51da490869 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:17.432120 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e31e6e27-bee1-4182-8d85-ad51da490869 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:17.577732 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-f4c00b2e-198b-4f89-ab6a-2e9f9d7a0a0e tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:02:17.587933 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-f4c00b2e-198b-4f89-ab6a-2e9f9d7a0a0e tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45" status: 200 len: 1564 microversion: 2.1 time: 0.260755 Nov 23 13:02:17.588742 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 275/512] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:02:17 2021] GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45 => generated 1564 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:02:17.670703 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-e31e6e27-bee1-4182-8d85-ad51da490869 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action" status: 200 len: 28670 microversion: 2.20 time: 0.253152 Nov 23 13:02:17.671268 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 238/513] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:02:17 2021] POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action => generated 28670 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 13:02:18.149345 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-ea5981a0-e16f-4805-b888-e22259f43fe4 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:02:18.150653 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-ea5981a0-e16f-4805-b888-e22259f43fe4 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] [instance: f44f7229-5fd0-4fbd-9d2a-a4c5a929670e] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:18.159272 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ea5981a0-e16f-4805-b888-e22259f43fe4 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:18.159953 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ea5981a0-e16f-4805-b888-e22259f43fe4 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:18.161024 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ea5981a0-e16f-4805-b888-e22259f43fe4 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:18.162534 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ea5981a0-e16f-4805-b888-e22259f43fe4 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:18.377715 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-89b1c0dc-ccb1-4f13-9dc1-28481755182f tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:02:18.378613 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-89b1c0dc-ccb1-4f13-9dc1-28481755182f tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: e5f13132-d54e-43f7-8c86-91a4d23d4c35] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:18.390618 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-89b1c0dc-ccb1-4f13-9dc1-28481755182f tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:18.391346 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-89b1c0dc-ccb1-4f13-9dc1-28481755182f tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:18.392138 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-89b1c0dc-ccb1-4f13-9dc1-28481755182f tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:18.392606 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-89b1c0dc-ccb1-4f13-9dc1-28481755182f tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:18.396381 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-ea5981a0-e16f-4805-b888-e22259f43fe4 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0fe7fa96d645ecbc1e50fb5595971d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306daa81c2794164a38ae7bc3b322ef2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:02:18.405229 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-ea5981a0-e16f-4805-b888-e22259f43fe4 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] 10.222.0.60 "GET /compute/v2.1/servers/f44f7229-5fd0-4fbd-9d2a-a4c5a929670e" status: 200 len: 1497 microversion: 2.1 time: 0.259696 Nov 23 13:02:18.406091 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 276/514] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:02:18 2021] GET /compute/v2.1/servers/f44f7229-5fd0-4fbd-9d2a-a4c5a929670e => generated 1497 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:02:18.605881 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-b94bbaeb-258e-4c81-835e-407ada1e81bf tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:02:18.606408 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-b94bbaeb-258e-4c81-835e-407ada1e81bf tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: 53633a05-ad06-454a-b540-5fc01821ae45] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:18.613973 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b94bbaeb-258e-4c81-835e-407ada1e81bf tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:18.614414 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b94bbaeb-258e-4c81-835e-407ada1e81bf tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:18.615181 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b94bbaeb-258e-4c81-835e-407ada1e81bf tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:18.615609 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b94bbaeb-258e-4c81-835e-407ada1e81bf tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:18.883938 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-b94bbaeb-258e-4c81-835e-407ada1e81bf tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:02:18.893766 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-b94bbaeb-258e-4c81-835e-407ada1e81bf tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45" status: 200 len: 1564 microversion: 2.1 time: 0.291785 Nov 23 13:02:18.894563 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 277/515] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:02:18 2021] GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45 => generated 1564 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 13:02:18.897046 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-89b1c0dc-ccb1-4f13-9dc1-28481755182f tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c023f89fd3da4bc8b38963bed4e5cc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a31364455dc442f8df299a8ad758a4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:02:18.907545 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-89b1c0dc-ccb1-4f13-9dc1-28481755182f tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/e5f13132-d54e-43f7-8c86-91a4d23d4c35" status: 200 len: 1318 microversion: 2.1 time: 0.534942 Nov 23 13:02:18.908140 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 239/516] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:02:18 2021] GET /compute/v2.1/servers/e5f13132-d54e-43f7-8c86-91a4d23d4c35 => generated 1318 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:02:18.916385 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-5609914d-b464-404c-a376-ca5e20b96a5e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:02:18.920721 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-5609914d-b464-404c-a376-ca5e20b96a5e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:18.929770 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5609914d-b464-404c-a376-ca5e20b96a5e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:18.930219 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5609914d-b464-404c-a376-ca5e20b96a5e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:18.931005 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5609914d-b464-404c-a376-ca5e20b96a5e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:18.931432 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5609914d-b464-404c-a376-ca5e20b96a5e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:19.198020 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [req-69a41c77-95a0-4e94-af63-c5a22ed8fa81 req-1820a75e-3221-4b68-baf8-b61bedfb1229 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5f13132-d54e-43f7-8c86-91a4d23d4c35", "tag": "ebaa3fb8-fb70-4118-8e64-8d0d70bec47c"}]} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:02:19.199890 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 13:02:19.199890 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: warnings.warn(msg) Nov 23 13:02:19.209794 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [req-69a41c77-95a0-4e94-af63-c5a22ed8fa81 req-1820a75e-3221-4b68-baf8-b61bedfb1229 service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:19.210242 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [req-69a41c77-95a0-4e94-af63-c5a22ed8fa81 req-1820a75e-3221-4b68-baf8-b61bedfb1229 service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:19.226606 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.compute.server_external_events [req-69a41c77-95a0-4e94-af63-c5a22ed8fa81 req-1820a75e-3221-4b68-baf8-b61bedfb1229 service nova] Creating event network-changed:ebaa3fb8-fb70-4118-8e64-8d0d70bec47c for instance e5f13132-d54e-43f7-8c86-91a4d23d4c35 on hv-cinder-81888 Nov 23 13:02:19.231144 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [req-69a41c77-95a0-4e94-af63-c5a22ed8fa81 req-1820a75e-3221-4b68-baf8-b61bedfb1229 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036732 Nov 23 13:02:19.231882 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 240/517] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Nov 23 13:02:19 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 13:02:19.285108 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-5609914d-b464-404c-a376-ca5e20b96a5e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action" status: 200 len: 28670 microversion: 2.20 time: 0.379445 Nov 23 13:02:19.285921 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 278/518] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:02:18 2021] POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action => generated 28670 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:02:19.412971 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-3a0cf645-8fe1-460f-b3ce-b34128266910 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:02:19.413563 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-3a0cf645-8fe1-460f-b3ce-b34128266910 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] [instance: f44f7229-5fd0-4fbd-9d2a-a4c5a929670e] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:19.421486 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3a0cf645-8fe1-460f-b3ce-b34128266910 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:19.421929 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3a0cf645-8fe1-460f-b3ce-b34128266910 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:19.422835 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3a0cf645-8fe1-460f-b3ce-b34128266910 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:19.423255 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3a0cf645-8fe1-460f-b3ce-b34128266910 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:19.494532 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-3a0cf645-8fe1-460f-b3ce-b34128266910 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] [instance: f44f7229-5fd0-4fbd-9d2a-a4c5a929670e] Going to try to terminate instance {{(pid=100974) delete /opt/stack/nova/nova/compute/api.py:2562}} Nov 23 13:02:19.770887 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-3a0cf645-8fe1-460f-b3ce-b34128266910 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] 10.222.0.60 "DELETE /compute/v2.1/servers/f44f7229-5fd0-4fbd-9d2a-a4c5a929670e" status: 204 len: 0 microversion: 2.1 time: 0.362312 Nov 23 13:02:19.771828 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 241/519] 10.222.0.60 () {58 vars in 1238 bytes} [Tue Nov 23 13:02:19 2021] DELETE /compute/v2.1/servers/f44f7229-5fd0-4fbd-9d2a-a4c5a929670e => generated 0 bytes in 364 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 23 13:02:19.780669 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-e2d36d8e-ea90-4504-b854-2c28438731a8 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:02:19.781369 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-e2d36d8e-ea90-4504-b854-2c28438731a8 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] [instance: f44f7229-5fd0-4fbd-9d2a-a4c5a929670e] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:19.790383 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e2d36d8e-ea90-4504-b854-2c28438731a8 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:19.790904 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e2d36d8e-ea90-4504-b854-2c28438731a8 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:19.791669 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e2d36d8e-ea90-4504-b854-2c28438731a8 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:19.792090 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e2d36d8e-ea90-4504-b854-2c28438731a8 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:19.911600 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-d5898c86-c62a-49e9-8764-ce210c97fbcd tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:02:19.912305 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-d5898c86-c62a-49e9-8764-ce210c97fbcd tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: 53633a05-ad06-454a-b540-5fc01821ae45] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:19.922325 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d5898c86-c62a-49e9-8764-ce210c97fbcd tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:19.922765 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d5898c86-c62a-49e9-8764-ce210c97fbcd tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:19.923617 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d5898c86-c62a-49e9-8764-ce210c97fbcd tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:19.924064 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d5898c86-c62a-49e9-8764-ce210c97fbcd tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:20.034127 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-e2d36d8e-ea90-4504-b854-2c28438731a8 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0fe7fa96d645ecbc1e50fb5595971d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306daa81c2794164a38ae7bc3b322ef2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:02:20.042965 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-e2d36d8e-ea90-4504-b854-2c28438731a8 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] 10.222.0.60 "GET /compute/v2.1/servers/f44f7229-5fd0-4fbd-9d2a-a4c5a929670e" status: 200 len: 1503 microversion: 2.1 time: 0.266231 Nov 23 13:02:20.043753 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 279/520] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:02:19 2021] GET /compute/v2.1/servers/f44f7229-5fd0-4fbd-9d2a-a4c5a929670e => generated 1503 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:02:20.047994 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-f619870a-8a39-4eed-85e0-ea0b09441006 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:02:20.048626 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-f619870a-8a39-4eed-85e0-ea0b09441006 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: e5f13132-d54e-43f7-8c86-91a4d23d4c35] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:20.056678 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f619870a-8a39-4eed-85e0-ea0b09441006 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:20.057126 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f619870a-8a39-4eed-85e0-ea0b09441006 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:20.057896 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f619870a-8a39-4eed-85e0-ea0b09441006 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:20.058325 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f619870a-8a39-4eed-85e0-ea0b09441006 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:20.280793 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-d5898c86-c62a-49e9-8764-ce210c97fbcd tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:02:20.285939 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-f619870a-8a39-4eed-85e0-ea0b09441006 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c023f89fd3da4bc8b38963bed4e5cc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a31364455dc442f8df299a8ad758a4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:02:20.291801 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-d5898c86-c62a-49e9-8764-ce210c97fbcd tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45" status: 200 len: 1564 microversion: 2.1 time: 0.382869 Nov 23 13:02:20.292659 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 242/521] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:02:19 2021] GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45 => generated 1564 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 13:02:20.301861 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-f619870a-8a39-4eed-85e0-ea0b09441006 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/e5f13132-d54e-43f7-8c86-91a4d23d4c35" status: 200 len: 1318 microversion: 2.1 time: 0.250881 Nov 23 13:02:20.301861 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 280/522] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:02:20 2021] GET /compute/v2.1/servers/e5f13132-d54e-43f7-8c86-91a4d23d4c35 => generated 1318 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:02:20.301861 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-3093dfe7-8375-4b60-a358-7e96941030d4 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:02:20.303281 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-3093dfe7-8375-4b60-a358-7e96941030d4 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:20.311162 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-3093dfe7-8375-4b60-a358-7e96941030d4 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:20.312147 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-3093dfe7-8375-4b60-a358-7e96941030d4 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:20.312983 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-3093dfe7-8375-4b60-a358-7e96941030d4 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:20.313650 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-3093dfe7-8375-4b60-a358-7e96941030d4 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:20.760575 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-3093dfe7-8375-4b60-a358-7e96941030d4 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action" status: 200 len: 28670 microversion: 2.20 time: 0.462620 Nov 23 13:02:20.761611 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 281/523] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:02:20 2021] POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action => generated 28670 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:02:21.061257 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-ccc39a08-8e3e-4f1b-8315-744f1f97abcb tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:02:21.061994 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-ccc39a08-8e3e-4f1b-8315-744f1f97abcb tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] [instance: f44f7229-5fd0-4fbd-9d2a-a4c5a929670e] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:21.072471 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ccc39a08-8e3e-4f1b-8315-744f1f97abcb tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:21.072922 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ccc39a08-8e3e-4f1b-8315-744f1f97abcb tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:21.073705 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ccc39a08-8e3e-4f1b-8315-744f1f97abcb tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:21.074635 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ccc39a08-8e3e-4f1b-8315-744f1f97abcb tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:21.310460 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-9f305913-f40c-4282-8c7b-2efb7f160966 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:02:21.311141 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-9f305913-f40c-4282-8c7b-2efb7f160966 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: 53633a05-ad06-454a-b540-5fc01821ae45] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:21.319495 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-9f305913-f40c-4282-8c7b-2efb7f160966 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:21.320192 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-9f305913-f40c-4282-8c7b-2efb7f160966 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:21.321157 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-9f305913-f40c-4282-8c7b-2efb7f160966 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:21.321743 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-9f305913-f40c-4282-8c7b-2efb7f160966 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:21.536259 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-ccc39a08-8e3e-4f1b-8315-744f1f97abcb tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0fe7fa96d645ecbc1e50fb5595971d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306daa81c2794164a38ae7bc3b322ef2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:02:21.548331 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-9f305913-f40c-4282-8c7b-2efb7f160966 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:02:21.554849 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-ccc39a08-8e3e-4f1b-8315-744f1f97abcb tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] 10.222.0.60 "GET /compute/v2.1/servers/f44f7229-5fd0-4fbd-9d2a-a4c5a929670e" status: 200 len: 1503 microversion: 2.1 time: 0.497690 Nov 23 13:02:21.558668 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-9f305913-f40c-4282-8c7b-2efb7f160966 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45" status: 200 len: 1564 microversion: 2.1 time: 0.252794 Nov 23 13:02:21.566503 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 243/524] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:02:21 2021] GET /compute/v2.1/servers/f44f7229-5fd0-4fbd-9d2a-a4c5a929670e => generated 1503 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:02:21.569082 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 282/525] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:02:21 2021] GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45 => generated 1564 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 13:02:21.571650 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-99097e00-36a1-476b-9606-2249115e241e tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:02:21.572356 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-99097e00-36a1-476b-9606-2249115e241e tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: e5f13132-d54e-43f7-8c86-91a4d23d4c35] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:21.581213 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-99097e00-36a1-476b-9606-2249115e241e tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:21.581656 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-99097e00-36a1-476b-9606-2249115e241e tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:21.582446 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-99097e00-36a1-476b-9606-2249115e241e tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:21.582884 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-99097e00-36a1-476b-9606-2249115e241e tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:21.778152 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-e8c28421-e3b5-4820-86d5-db4039c68883 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:02:21.779079 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-e8c28421-e3b5-4820-86d5-db4039c68883 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:21.788657 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e8c28421-e3b5-4820-86d5-db4039c68883 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:21.789098 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e8c28421-e3b5-4820-86d5-db4039c68883 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:21.790041 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e8c28421-e3b5-4820-86d5-db4039c68883 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:21.790528 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e8c28421-e3b5-4820-86d5-db4039c68883 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:21.888758 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-99097e00-36a1-476b-9606-2249115e241e tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c023f89fd3da4bc8b38963bed4e5cc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a31364455dc442f8df299a8ad758a4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:02:21.897565 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-99097e00-36a1-476b-9606-2249115e241e tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/e5f13132-d54e-43f7-8c86-91a4d23d4c35" status: 200 len: 1318 microversion: 2.1 time: 0.329892 Nov 23 13:02:21.898134 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 244/526] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:02:21 2021] GET /compute/v2.1/servers/e5f13132-d54e-43f7-8c86-91a4d23d4c35 => generated 1318 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:02:22.038949 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-e8c28421-e3b5-4820-86d5-db4039c68883 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action" status: 200 len: 28670 microversion: 2.20 time: 0.264413 Nov 23 13:02:22.043331 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 283/527] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:02:21 2021] POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action => generated 28670 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:02:22.574877 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-3f33be8e-0222-4307-80ef-9cde90a2e7d1 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:02:22.575910 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-3f33be8e-0222-4307-80ef-9cde90a2e7d1 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] [instance: f44f7229-5fd0-4fbd-9d2a-a4c5a929670e] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:22.576913 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-f27203a8-46c4-4c42-92c8-16525a56c5c7 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:02:22.577618 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-f27203a8-46c4-4c42-92c8-16525a56c5c7 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: 53633a05-ad06-454a-b540-5fc01821ae45] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:22.583929 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3f33be8e-0222-4307-80ef-9cde90a2e7d1 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:22.584473 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3f33be8e-0222-4307-80ef-9cde90a2e7d1 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:22.585255 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3f33be8e-0222-4307-80ef-9cde90a2e7d1 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:22.585680 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3f33be8e-0222-4307-80ef-9cde90a2e7d1 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:22.586043 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f27203a8-46c4-4c42-92c8-16525a56c5c7 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:22.586461 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f27203a8-46c4-4c42-92c8-16525a56c5c7 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:22.587219 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f27203a8-46c4-4c42-92c8-16525a56c5c7 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:22.587644 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f27203a8-46c4-4c42-92c8-16525a56c5c7 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:22.791014 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-f27203a8-46c4-4c42-92c8-16525a56c5c7 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:02:22.795549 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-3f33be8e-0222-4307-80ef-9cde90a2e7d1 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0fe7fa96d645ecbc1e50fb5595971d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306daa81c2794164a38ae7bc3b322ef2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:02:22.801844 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-f27203a8-46c4-4c42-92c8-16525a56c5c7 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45" status: 200 len: 1564 microversion: 2.1 time: 0.229079 Nov 23 13:02:22.802854 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 284/528] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:02:22 2021] GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45 => generated 1564 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:02:22.806524 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-3f33be8e-0222-4307-80ef-9cde90a2e7d1 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] 10.222.0.60 "GET /compute/v2.1/servers/f44f7229-5fd0-4fbd-9d2a-a4c5a929670e" status: 200 len: 1503 microversion: 2.1 time: 0.235923 Nov 23 13:02:22.807461 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 245/529] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:02:22 2021] GET /compute/v2.1/servers/f44f7229-5fd0-4fbd-9d2a-a4c5a929670e => generated 1503 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:02:22.915728 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-b3f1ff76-474f-43ba-b24d-6a0b8dc2df56 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:02:22.916398 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-b3f1ff76-474f-43ba-b24d-6a0b8dc2df56 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: e5f13132-d54e-43f7-8c86-91a4d23d4c35] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:22.924736 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b3f1ff76-474f-43ba-b24d-6a0b8dc2df56 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:22.925290 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b3f1ff76-474f-43ba-b24d-6a0b8dc2df56 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:22.926077 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b3f1ff76-474f-43ba-b24d-6a0b8dc2df56 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:22.926502 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b3f1ff76-474f-43ba-b24d-6a0b8dc2df56 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:23.051184 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-688927fc-0281-4b95-ad8a-175c686c5184 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:02:23.052163 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-688927fc-0281-4b95-ad8a-175c686c5184 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:23.062483 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-688927fc-0281-4b95-ad8a-175c686c5184 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:23.062964 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-688927fc-0281-4b95-ad8a-175c686c5184 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:23.066297 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-688927fc-0281-4b95-ad8a-175c686c5184 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:23.066297 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-688927fc-0281-4b95-ad8a-175c686c5184 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:23.163467 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-b3f1ff76-474f-43ba-b24d-6a0b8dc2df56 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c023f89fd3da4bc8b38963bed4e5cc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a31364455dc442f8df299a8ad758a4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:02:23.173626 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-b3f1ff76-474f-43ba-b24d-6a0b8dc2df56 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/e5f13132-d54e-43f7-8c86-91a4d23d4c35" status: 200 len: 1318 microversion: 2.1 time: 0.262183 Nov 23 13:02:23.174120 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 285/530] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:02:22 2021] GET /compute/v2.1/servers/e5f13132-d54e-43f7-8c86-91a4d23d4c35 => generated 1318 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:02:23.348837 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-688927fc-0281-4b95-ad8a-175c686c5184 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action" status: 200 len: 28670 microversion: 2.20 time: 0.301157 Nov 23 13:02:23.350275 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 246/531] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:02:23 2021] POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action => generated 28670 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:02:23.779855 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [req-ba000a41-59f7-4ee3-a551-7d631a7c381a req-aaaaee7d-a7dc-443b-a309-02db94cd9cf9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f44f7229-5fd0-4fbd-9d2a-a4c5a929670e", "name": "network-vif-deleted", "tag": "72d7fc77-8138-47bc-aa6c-3a989004e0ed"}]} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:02:23.782428 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 13:02:23.782428 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: warnings.warn(msg) Nov 23 13:02:23.797175 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [req-ba000a41-59f7-4ee3-a551-7d631a7c381a req-aaaaee7d-a7dc-443b-a309-02db94cd9cf9 service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:23.797842 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [req-ba000a41-59f7-4ee3-a551-7d631a7c381a req-aaaaee7d-a7dc-443b-a309-02db94cd9cf9 service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:23.821996 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-1733491b-6f0f-47dc-ae46-d771ca3829d4 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:02:23.822703 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-1733491b-6f0f-47dc-ae46-d771ca3829d4 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: 53633a05-ad06-454a-b540-5fc01821ae45] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:23.825648 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.compute.server_external_events [req-ba000a41-59f7-4ee3-a551-7d631a7c381a req-aaaaee7d-a7dc-443b-a309-02db94cd9cf9 service nova] Creating event network-vif-deleted:72d7fc77-8138-47bc-aa6c-3a989004e0ed for instance f44f7229-5fd0-4fbd-9d2a-a4c5a929670e on hv-cinder-81888 Nov 23 13:02:23.842160 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1733491b-6f0f-47dc-ae46-d771ca3829d4 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:23.842717 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1733491b-6f0f-47dc-ae46-d771ca3829d4 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:23.844394 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [req-ba000a41-59f7-4ee3-a551-7d631a7c381a req-aaaaee7d-a7dc-443b-a309-02db94cd9cf9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070397 Nov 23 13:02:23.845480 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1733491b-6f0f-47dc-ae46-d771ca3829d4 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:23.845689 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 286/532] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Nov 23 13:02:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 13:02:23.846490 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1733491b-6f0f-47dc-ae46-d771ca3829d4 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:23.853850 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-571924c8-7524-4680-a9f9-ec53a3717ce2 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:02:23.855050 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-571924c8-7524-4680-a9f9-ec53a3717ce2 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] [instance: f44f7229-5fd0-4fbd-9d2a-a4c5a929670e] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:23.863464 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-571924c8-7524-4680-a9f9-ec53a3717ce2 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:23.864214 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-571924c8-7524-4680-a9f9-ec53a3717ce2 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:23.865367 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-571924c8-7524-4680-a9f9-ec53a3717ce2 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:23.865986 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-571924c8-7524-4680-a9f9-ec53a3717ce2 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:23.997107 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-571924c8-7524-4680-a9f9-ec53a3717ce2 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0fe7fa96d645ecbc1e50fb5595971d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306daa81c2794164a38ae7bc3b322ef2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:02:24.008170 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-571924c8-7524-4680-a9f9-ec53a3717ce2 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] 10.222.0.60 "GET /compute/v2.1/servers/f44f7229-5fd0-4fbd-9d2a-a4c5a929670e" status: 200 len: 1298 microversion: 2.1 time: 0.160998 Nov 23 13:02:24.008837 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 287/533] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:02:23 2021] GET /compute/v2.1/servers/f44f7229-5fd0-4fbd-9d2a-a4c5a929670e => generated 1298 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:02:24.097608 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-1733491b-6f0f-47dc-ae46-d771ca3829d4 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:02:24.107532 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-1733491b-6f0f-47dc-ae46-d771ca3829d4 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45" status: 200 len: 1564 microversion: 2.1 time: 0.289846 Nov 23 13:02:24.108128 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 247/534] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:02:23 2021] GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45 => generated 1564 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:02:24.194213 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-72ea1c9e-dca8-415c-9548-9e1a43ecaa37 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:02:24.195300 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-72ea1c9e-dca8-415c-9548-9e1a43ecaa37 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: e5f13132-d54e-43f7-8c86-91a4d23d4c35] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:24.203443 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-72ea1c9e-dca8-415c-9548-9e1a43ecaa37 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:24.203894 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-72ea1c9e-dca8-415c-9548-9e1a43ecaa37 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:24.204681 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-72ea1c9e-dca8-415c-9548-9e1a43ecaa37 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:24.205251 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-72ea1c9e-dca8-415c-9548-9e1a43ecaa37 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:24.360694 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-0a91d881-8965-40a6-8db6-c45a9f8105dc tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:02:24.361702 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-0a91d881-8965-40a6-8db6-c45a9f8105dc tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:24.369307 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0a91d881-8965-40a6-8db6-c45a9f8105dc tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:24.369818 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0a91d881-8965-40a6-8db6-c45a9f8105dc tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:24.370592 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0a91d881-8965-40a6-8db6-c45a9f8105dc tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:24.371050 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0a91d881-8965-40a6-8db6-c45a9f8105dc tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:24.506380 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-72ea1c9e-dca8-415c-9548-9e1a43ecaa37 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c023f89fd3da4bc8b38963bed4e5cc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a31364455dc442f8df299a8ad758a4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:02:24.518635 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-72ea1c9e-dca8-415c-9548-9e1a43ecaa37 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/e5f13132-d54e-43f7-8c86-91a4d23d4c35" status: 200 len: 1318 microversion: 2.1 time: 0.328539 Nov 23 13:02:24.519524 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 288/535] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:02:24 2021] GET /compute/v2.1/servers/e5f13132-d54e-43f7-8c86-91a4d23d4c35 => generated 1318 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:02:24.987101 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-0a91d881-8965-40a6-8db6-c45a9f8105dc tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action" status: 200 len: 28670 microversion: 2.20 time: 0.630096 Nov 23 13:02:24.991176 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 248/536] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:02:24 2021] POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action => generated 28670 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 13:02:25.026424 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-3f7438de-1a23-4fdf-ab7c-64575c700266 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:02:25.027686 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-3f7438de-1a23-4fdf-ab7c-64575c700266 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] [instance: f44f7229-5fd0-4fbd-9d2a-a4c5a929670e] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:25.035899 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-3f7438de-1a23-4fdf-ab7c-64575c700266 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:25.036420 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-3f7438de-1a23-4fdf-ab7c-64575c700266 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:25.037200 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-3f7438de-1a23-4fdf-ab7c-64575c700266 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:25.037627 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-3f7438de-1a23-4fdf-ab7c-64575c700266 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:25.110895 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-3f7438de-1a23-4fdf-ab7c-64575c700266 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:25.111345 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-3f7438de-1a23-4fdf-ab7c-64575c700266 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:25.111797 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.objects.instance [None req-3f7438de-1a23-4fdf-ab7c-64575c700266 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lazy-loading 'fault' on Instance uuid f44f7229-5fd0-4fbd-9d2a-a4c5a929670e {{(pid=100973) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 23 13:02:25.131921 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-77d6e8be-1f5f-40dd-9c2e-03d940ad1845 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:02:25.137019 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-77d6e8be-1f5f-40dd-9c2e-03d940ad1845 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: 53633a05-ad06-454a-b540-5fc01821ae45] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:25.145684 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-77d6e8be-1f5f-40dd-9c2e-03d940ad1845 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:25.146362 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-77d6e8be-1f5f-40dd-9c2e-03d940ad1845 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:25.147322 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-77d6e8be-1f5f-40dd-9c2e-03d940ad1845 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:25.147935 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-77d6e8be-1f5f-40dd-9c2e-03d940ad1845 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:25.186644 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-3f7438de-1a23-4fdf-ab7c-64575c700266 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0fe7fa96d645ecbc1e50fb5595971d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306daa81c2794164a38ae7bc3b322ef2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:02:25.196020 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-3f7438de-1a23-4fdf-ab7c-64575c700266 tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] 10.222.0.60 "GET /compute/v2.1/servers/f44f7229-5fd0-4fbd-9d2a-a4c5a929670e" status: 200 len: 1303 microversion: 2.1 time: 0.173721 Nov 23 13:02:25.206128 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 289/537] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:02:25 2021] GET /compute/v2.1/servers/f44f7229-5fd0-4fbd-9d2a-a4c5a929670e => generated 1303 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:02:25.379499 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-77d6e8be-1f5f-40dd-9c2e-03d940ad1845 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:02:25.388338 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-77d6e8be-1f5f-40dd-9c2e-03d940ad1845 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45" status: 200 len: 1564 microversion: 2.1 time: 0.266482 Nov 23 13:02:25.389013 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 249/538] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:02:25 2021] GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45 => generated 1564 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 13:02:25.540653 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-9a19a457-f74c-4474-ad0d-4ad16ea888fe tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:02:25.541347 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-9a19a457-f74c-4474-ad0d-4ad16ea888fe tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: e5f13132-d54e-43f7-8c86-91a4d23d4c35] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:25.549359 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-9a19a457-f74c-4474-ad0d-4ad16ea888fe tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:25.549729 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-9a19a457-f74c-4474-ad0d-4ad16ea888fe tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:25.550489 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-9a19a457-f74c-4474-ad0d-4ad16ea888fe tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:25.550912 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-9a19a457-f74c-4474-ad0d-4ad16ea888fe tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:25.771805 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-9a19a457-f74c-4474-ad0d-4ad16ea888fe tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c023f89fd3da4bc8b38963bed4e5cc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a31364455dc442f8df299a8ad758a4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:02:25.784771 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-9a19a457-f74c-4474-ad0d-4ad16ea888fe tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/e5f13132-d54e-43f7-8c86-91a4d23d4c35" status: 200 len: 1318 microversion: 2.1 time: 0.248966 Nov 23 13:02:25.785365 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 290/539] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:02:25 2021] GET /compute/v2.1/servers/e5f13132-d54e-43f7-8c86-91a4d23d4c35 => generated 1318 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:02:26.000720 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-06a48166-c8f9-42f8-8638-8a1c690d19db tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:02:26.002817 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-06a48166-c8f9-42f8-8638-8a1c690d19db tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:26.011362 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-06a48166-c8f9-42f8-8638-8a1c690d19db tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:26.012109 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-06a48166-c8f9-42f8-8638-8a1c690d19db tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:26.013556 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-06a48166-c8f9-42f8-8638-8a1c690d19db tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:26.014168 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-06a48166-c8f9-42f8-8638-8a1c690d19db tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:26.214380 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-aa9ebd80-14f3-43a5-b2b1-5efafb121e8e tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:02:26.215013 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-aa9ebd80-14f3-43a5-b2b1-5efafb121e8e tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] [instance: f44f7229-5fd0-4fbd-9d2a-a4c5a929670e] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:26.222831 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-aa9ebd80-14f3-43a5-b2b1-5efafb121e8e tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:26.223283 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-aa9ebd80-14f3-43a5-b2b1-5efafb121e8e tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:26.224048 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-aa9ebd80-14f3-43a5-b2b1-5efafb121e8e tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:26.224510 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-aa9ebd80-14f3-43a5-b2b1-5efafb121e8e tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:26.273743 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.wsgi [None req-aa9ebd80-14f3-43a5-b2b1-5efafb121e8e tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] HTTP exception thrown: Instance f44f7229-5fd0-4fbd-9d2a-a4c5a929670e could not be found. Nov 23 13:02:26.274383 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-aa9ebd80-14f3-43a5-b2b1-5efafb121e8e tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] Returning 404 to user: Instance f44f7229-5fd0-4fbd-9d2a-a4c5a929670e could not be found. {{(pid=100973) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Nov 23 13:02:26.275206 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-aa9ebd80-14f3-43a5-b2b1-5efafb121e8e tempest-VolumesActionsTest-1289484084 tempest-VolumesActionsTest-1289484084-project] 10.222.0.60 "GET /compute/v2.1/servers/f44f7229-5fd0-4fbd-9d2a-a4c5a929670e" status: 404 len: 111 microversion: 2.1 time: 0.065012 Nov 23 13:02:26.275950 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 291/540] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:02:26 2021] GET /compute/v2.1/servers/f44f7229-5fd0-4fbd-9d2a-a4c5a929670e => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 23 13:02:26.311515 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-06a48166-c8f9-42f8-8638-8a1c690d19db tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action" status: 200 len: 28670 microversion: 2.20 time: 0.314975 Nov 23 13:02:26.312365 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 250/541] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:02:25 2021] POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action => generated 28670 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:02:26.408503 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-4007798e-37ff-4221-abbb-7338792e8316 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:02:26.409719 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-4007798e-37ff-4221-abbb-7338792e8316 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: 53633a05-ad06-454a-b540-5fc01821ae45] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:26.421053 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4007798e-37ff-4221-abbb-7338792e8316 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:26.421493 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4007798e-37ff-4221-abbb-7338792e8316 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:26.422259 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4007798e-37ff-4221-abbb-7338792e8316 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:26.422783 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4007798e-37ff-4221-abbb-7338792e8316 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:26.656924 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-4007798e-37ff-4221-abbb-7338792e8316 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:02:26.666011 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-4007798e-37ff-4221-abbb-7338792e8316 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45" status: 200 len: 1564 microversion: 2.1 time: 0.264198 Nov 23 13:02:26.666576 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 292/542] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:02:26 2021] GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45 => generated 1564 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:02:26.802884 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-b3b89b7a-d908-4561-90c7-55cb96d7bfc3 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:02:26.803789 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-b3b89b7a-d908-4561-90c7-55cb96d7bfc3 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: e5f13132-d54e-43f7-8c86-91a4d23d4c35] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:26.812450 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b3b89b7a-d908-4561-90c7-55cb96d7bfc3 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:26.812898 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b3b89b7a-d908-4561-90c7-55cb96d7bfc3 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:26.815398 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b3b89b7a-d908-4561-90c7-55cb96d7bfc3 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:26.816024 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b3b89b7a-d908-4561-90c7-55cb96d7bfc3 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:27.047974 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-b3b89b7a-d908-4561-90c7-55cb96d7bfc3 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c023f89fd3da4bc8b38963bed4e5cc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a31364455dc442f8df299a8ad758a4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:02:27.060367 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-b3b89b7a-d908-4561-90c7-55cb96d7bfc3 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/e5f13132-d54e-43f7-8c86-91a4d23d4c35" status: 200 len: 1318 microversion: 2.1 time: 0.261075 Nov 23 13:02:27.064296 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 251/543] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:02:26 2021] GET /compute/v2.1/servers/e5f13132-d54e-43f7-8c86-91a4d23d4c35 => generated 1318 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:02:27.325694 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-597a0aab-b559-4f87-b23e-863e1ee4b7c2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:02:27.326779 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-597a0aab-b559-4f87-b23e-863e1ee4b7c2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:27.334124 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-597a0aab-b559-4f87-b23e-863e1ee4b7c2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:27.334567 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-597a0aab-b559-4f87-b23e-863e1ee4b7c2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:27.335335 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-597a0aab-b559-4f87-b23e-863e1ee4b7c2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:27.335942 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-597a0aab-b559-4f87-b23e-863e1ee4b7c2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:27.467775 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-597a0aab-b559-4f87-b23e-863e1ee4b7c2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action" status: 200 len: 28670 microversion: 2.20 time: 0.147379 Nov 23 13:02:27.468944 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 293/544] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:02:27 2021] POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action => generated 28670 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:02:27.684800 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-91c2cae8-e4f2-4672-9b90-18e5aa66b89a tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:02:27.687726 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-91c2cae8-e4f2-4672-9b90-18e5aa66b89a tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: 53633a05-ad06-454a-b540-5fc01821ae45] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:27.697637 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-91c2cae8-e4f2-4672-9b90-18e5aa66b89a tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:27.697985 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-91c2cae8-e4f2-4672-9b90-18e5aa66b89a tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:27.699076 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-91c2cae8-e4f2-4672-9b90-18e5aa66b89a tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:27.699427 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-91c2cae8-e4f2-4672-9b90-18e5aa66b89a tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:27.907247 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-91c2cae8-e4f2-4672-9b90-18e5aa66b89a tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:02:27.916616 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-91c2cae8-e4f2-4672-9b90-18e5aa66b89a tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45" status: 200 len: 1544 microversion: 2.1 time: 0.237095 Nov 23 13:02:27.917179 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 252/545] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:02:27 2021] GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45 => generated 1544 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:02:27.938637 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-6064d796-6e4d-4ec7-b376-f8d9507e5185 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:02:27.939117 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-6064d796-6e4d-4ec7-b376-f8d9507e5185 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: 53633a05-ad06-454a-b540-5fc01821ae45] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:27.947542 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6064d796-6e4d-4ec7-b376-f8d9507e5185 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:27.947973 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6064d796-6e4d-4ec7-b376-f8d9507e5185 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:27.948753 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6064d796-6e4d-4ec7-b376-f8d9507e5185 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:27.949173 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6064d796-6e4d-4ec7-b376-f8d9507e5185 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:28.078168 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-2a46045c-454b-431b-bf10-f1f88b655d37 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:02:28.078833 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-2a46045c-454b-431b-bf10-f1f88b655d37 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: e5f13132-d54e-43f7-8c86-91a4d23d4c35] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:28.086721 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2a46045c-454b-431b-bf10-f1f88b655d37 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:28.087167 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2a46045c-454b-431b-bf10-f1f88b655d37 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:28.087945 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2a46045c-454b-431b-bf10-f1f88b655d37 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:28.088408 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2a46045c-454b-431b-bf10-f1f88b655d37 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:28.119421 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.wsgi [None req-6064d796-6e4d-4ec7-b376-f8d9507e5185 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] HTTP exception thrown: Cannot 'detach_volume' instance 53633a05-ad06-454a-b540-5fc01821ae45 while it is in vm_state rescued Nov 23 13:02:28.120127 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-6064d796-6e4d-4ec7-b376-f8d9507e5185 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Returning 409 to user: Cannot 'detach_volume' instance 53633a05-ad06-454a-b540-5fc01821ae45 while it is in vm_state rescued {{(pid=100973) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Nov 23 13:02:28.121085 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-6064d796-6e4d-4ec7-b376-f8d9507e5185 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "DELETE /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45/os-volume_attachments/9fcbca04-cca7-4f8c-870b-68ef0dca1710" status: 409 len: 152 microversion: 2.1 time: 0.187381 Nov 23 13:02:28.121746 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 294/546] 10.222.0.60 () {58 vars in 1415 bytes} [Tue Nov 23 13:02:27 2021] DELETE /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45/os-volume_attachments/9fcbca04-cca7-4f8c-870b-68ef0dca1710 => generated 152 bytes in 189 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 23 13:02:28.130898 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-78ca9f05-f6f4-46fb-8a69-76c00083169f tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:02:28.131496 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-78ca9f05-f6f4-46fb-8a69-76c00083169f tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: 53633a05-ad06-454a-b540-5fc01821ae45] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:28.140045 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-78ca9f05-f6f4-46fb-8a69-76c00083169f tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:28.140627 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-78ca9f05-f6f4-46fb-8a69-76c00083169f tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:28.141638 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-78ca9f05-f6f4-46fb-8a69-76c00083169f tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:28.141962 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-78ca9f05-f6f4-46fb-8a69-76c00083169f tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:28.293888 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-78ca9f05-f6f4-46fb-8a69-76c00083169f tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "POST /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45/action" status: 202 len: 0 microversion: 2.1 time: 0.166508 Nov 23 13:02:28.298205 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 295/547] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:02:28 2021] POST /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45/action => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:02:28.305968 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-37942380-a70a-4c84-a5e2-bb58d3bf2c2d tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:02:28.306676 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-37942380-a70a-4c84-a5e2-bb58d3bf2c2d tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: 53633a05-ad06-454a-b540-5fc01821ae45] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:28.313391 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-2a46045c-454b-431b-bf10-f1f88b655d37 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c023f89fd3da4bc8b38963bed4e5cc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a31364455dc442f8df299a8ad758a4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:02:28.315423 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-37942380-a70a-4c84-a5e2-bb58d3bf2c2d tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:28.315883 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-37942380-a70a-4c84-a5e2-bb58d3bf2c2d tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:28.316784 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-37942380-a70a-4c84-a5e2-bb58d3bf2c2d tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:28.317209 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-37942380-a70a-4c84-a5e2-bb58d3bf2c2d tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:28.323649 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-2a46045c-454b-431b-bf10-f1f88b655d37 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/e5f13132-d54e-43f7-8c86-91a4d23d4c35" status: 200 len: 1318 microversion: 2.1 time: 0.249141 Nov 23 13:02:28.324369 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 253/548] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:02:28 2021] GET /compute/v2.1/servers/e5f13132-d54e-43f7-8c86-91a4d23d4c35 => generated 1318 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:02:28.479843 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-95466cf0-061d-458b-b8ae-d86f4c10756f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:02:28.480880 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-95466cf0-061d-458b-b8ae-d86f4c10756f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:28.490168 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-95466cf0-061d-458b-b8ae-d86f4c10756f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:28.490901 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-95466cf0-061d-458b-b8ae-d86f4c10756f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:28.491852 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-95466cf0-061d-458b-b8ae-d86f4c10756f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:28.492796 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-95466cf0-061d-458b-b8ae-d86f4c10756f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:28.577777 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-37942380-a70a-4c84-a5e2-bb58d3bf2c2d tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:02:28.588535 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-37942380-a70a-4c84-a5e2-bb58d3bf2c2d tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45" status: 200 len: 1552 microversion: 2.1 time: 0.286782 Nov 23 13:02:28.589430 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 296/549] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:02:28 2021] GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45 => generated 1552 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:02:28.641566 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-95466cf0-061d-458b-b8ae-d86f4c10756f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action" status: 200 len: 28670 microversion: 2.20 time: 0.165514 Nov 23 13:02:28.643478 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 254/550] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:02:28 2021] POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action => generated 28670 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:02:29.261276 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [req-96ba6411-5809-4078-a3f3-5a89a26bf016 req-c89d65c1-af7b-4b28-ba94-2021bec2cb0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5f13132-d54e-43f7-8c86-91a4d23d4c35", "name": "network-vif-plugged", "status": "completed", "tag": "ebaa3fb8-fb70-4118-8e64-8d0d70bec47c"}]} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:02:29.264522 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 13:02:29.264522 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: warnings.warn(msg) Nov 23 13:02:29.276614 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [req-96ba6411-5809-4078-a3f3-5a89a26bf016 req-c89d65c1-af7b-4b28-ba94-2021bec2cb0a service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:29.277661 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [req-96ba6411-5809-4078-a3f3-5a89a26bf016 req-c89d65c1-af7b-4b28-ba94-2021bec2cb0a service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:29.295850 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.compute.server_external_events [req-96ba6411-5809-4078-a3f3-5a89a26bf016 req-c89d65c1-af7b-4b28-ba94-2021bec2cb0a service nova] Creating event network-vif-plugged:ebaa3fb8-fb70-4118-8e64-8d0d70bec47c for instance e5f13132-d54e-43f7-8c86-91a4d23d4c35 on hv-cinder-81888 Nov 23 13:02:29.302982 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [req-96ba6411-5809-4078-a3f3-5a89a26bf016 req-c89d65c1-af7b-4b28-ba94-2021bec2cb0a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046449 Nov 23 13:02:29.304248 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 297/551] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Nov 23 13:02:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 13:02:29.351068 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-ab0079e9-01c6-4126-b683-921dd85fc51b tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:02:29.351791 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-ab0079e9-01c6-4126-b683-921dd85fc51b tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: e5f13132-d54e-43f7-8c86-91a4d23d4c35] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:29.360046 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ab0079e9-01c6-4126-b683-921dd85fc51b tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:29.360540 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ab0079e9-01c6-4126-b683-921dd85fc51b tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:29.361352 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ab0079e9-01c6-4126-b683-921dd85fc51b tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:29.361789 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ab0079e9-01c6-4126-b683-921dd85fc51b tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:29.610926 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-f0d5c9f5-f8e1-4157-8392-47686c3583cc tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:02:29.611637 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-f0d5c9f5-f8e1-4157-8392-47686c3583cc tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: 53633a05-ad06-454a-b540-5fc01821ae45] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:29.619654 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f0d5c9f5-f8e1-4157-8392-47686c3583cc tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:29.620107 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f0d5c9f5-f8e1-4157-8392-47686c3583cc tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:29.620922 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f0d5c9f5-f8e1-4157-8392-47686c3583cc tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:29.621351 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f0d5c9f5-f8e1-4157-8392-47686c3583cc tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:29.632966 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-ab0079e9-01c6-4126-b683-921dd85fc51b tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c023f89fd3da4bc8b38963bed4e5cc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a31364455dc442f8df299a8ad758a4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:02:29.641564 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-ab0079e9-01c6-4126-b683-921dd85fc51b tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/e5f13132-d54e-43f7-8c86-91a4d23d4c35" status: 200 len: 1318 microversion: 2.1 time: 0.294651 Nov 23 13:02:29.642277 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 255/552] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:02:29 2021] GET /compute/v2.1/servers/e5f13132-d54e-43f7-8c86-91a4d23d4c35 => generated 1318 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:02:29.654408 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-b76ae22b-8b25-4743-b72d-7939f269ab57 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:02:29.655333 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-b76ae22b-8b25-4743-b72d-7939f269ab57 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:29.662631 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b76ae22b-8b25-4743-b72d-7939f269ab57 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:29.663058 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b76ae22b-8b25-4743-b72d-7939f269ab57 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:29.663848 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b76ae22b-8b25-4743-b72d-7939f269ab57 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:29.664453 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b76ae22b-8b25-4743-b72d-7939f269ab57 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:29.827587 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-f0d5c9f5-f8e1-4157-8392-47686c3583cc tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:02:29.836555 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-f0d5c9f5-f8e1-4157-8392-47686c3583cc tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45" status: 200 len: 1552 microversion: 2.1 time: 0.230175 Nov 23 13:02:29.837040 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 298/553] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:02:29 2021] GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45 => generated 1552 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:02:30.659412 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-740c1f4a-0f81-400d-bd72-2a3d3840ec49 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:02:30.660104 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-740c1f4a-0f81-400d-bd72-2a3d3840ec49 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: e5f13132-d54e-43f7-8c86-91a4d23d4c35] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:30.667612 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-740c1f4a-0f81-400d-bd72-2a3d3840ec49 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:30.668049 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-740c1f4a-0f81-400d-bd72-2a3d3840ec49 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:30.668863 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-740c1f4a-0f81-400d-bd72-2a3d3840ec49 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:30.669397 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-740c1f4a-0f81-400d-bd72-2a3d3840ec49 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:30.880842 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-740c1f4a-0f81-400d-bd72-2a3d3840ec49 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c023f89fd3da4bc8b38963bed4e5cc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a31364455dc442f8df299a8ad758a4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:02:30.891607 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-740c1f4a-0f81-400d-bd72-2a3d3840ec49 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/e5f13132-d54e-43f7-8c86-91a4d23d4c35" status: 200 len: 1318 microversion: 2.1 time: 0.236060 Nov 23 13:02:30.892176 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 299/554] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:02:30 2021] GET /compute/v2.1/servers/e5f13132-d54e-43f7-8c86-91a4d23d4c35 => generated 1318 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:02:30.896525 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-b446e531-ed5d-4de4-8e27-3c83ecc24617 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:02:30.897120 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-b446e531-ed5d-4de4-8e27-3c83ecc24617 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: 53633a05-ad06-454a-b540-5fc01821ae45] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:30.904631 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b446e531-ed5d-4de4-8e27-3c83ecc24617 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:30.905090 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b446e531-ed5d-4de4-8e27-3c83ecc24617 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:30.905859 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b446e531-ed5d-4de4-8e27-3c83ecc24617 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:30.906287 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b446e531-ed5d-4de4-8e27-3c83ecc24617 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:31.133782 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-b446e531-ed5d-4de4-8e27-3c83ecc24617 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:02:31.147106 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-b446e531-ed5d-4de4-8e27-3c83ecc24617 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45" status: 200 len: 1552 microversion: 2.1 time: 0.253633 Nov 23 13:02:31.147894 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 300/555] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:02:30 2021] GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45 => generated 1552 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:02:31.908686 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-50090025-db5c-4ce0-9047-333f7977738f tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:02:31.909396 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-50090025-db5c-4ce0-9047-333f7977738f tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: e5f13132-d54e-43f7-8c86-91a4d23d4c35] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:31.917228 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-50090025-db5c-4ce0-9047-333f7977738f tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:31.917668 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-50090025-db5c-4ce0-9047-333f7977738f tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:31.918434 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-50090025-db5c-4ce0-9047-333f7977738f tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:31.918859 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-50090025-db5c-4ce0-9047-333f7977738f tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:32.128492 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-50090025-db5c-4ce0-9047-333f7977738f tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c023f89fd3da4bc8b38963bed4e5cc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a31364455dc442f8df299a8ad758a4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:02:32.141136 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-50090025-db5c-4ce0-9047-333f7977738f tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/e5f13132-d54e-43f7-8c86-91a4d23d4c35" status: 200 len: 1318 microversion: 2.1 time: 0.236012 Nov 23 13:02:32.141849 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 301/556] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:02:31 2021] GET /compute/v2.1/servers/e5f13132-d54e-43f7-8c86-91a4d23d4c35 => generated 1318 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 13:02:32.166296 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-4482aedc-47e7-4126-9720-0f2f814e7350 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:02:32.166907 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-4482aedc-47e7-4126-9720-0f2f814e7350 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: 53633a05-ad06-454a-b540-5fc01821ae45] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:32.174378 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4482aedc-47e7-4126-9720-0f2f814e7350 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:32.174809 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4482aedc-47e7-4126-9720-0f2f814e7350 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:32.175553 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4482aedc-47e7-4126-9720-0f2f814e7350 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:32.175952 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4482aedc-47e7-4126-9720-0f2f814e7350 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:32.397690 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-4482aedc-47e7-4126-9720-0f2f814e7350 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:02:32.411385 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-4482aedc-47e7-4126-9720-0f2f814e7350 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45" status: 200 len: 1552 microversion: 2.1 time: 0.248172 Nov 23 13:02:32.412191 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 302/557] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:02:32 2021] GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45 => generated 1552 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 13:02:33.158976 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-36c2441e-ec7f-46f1-b33a-e19629ded30e tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:02:33.159689 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-36c2441e-ec7f-46f1-b33a-e19629ded30e tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: e5f13132-d54e-43f7-8c86-91a4d23d4c35] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:33.167282 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-36c2441e-ec7f-46f1-b33a-e19629ded30e tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:33.167727 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-36c2441e-ec7f-46f1-b33a-e19629ded30e tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:33.168537 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-36c2441e-ec7f-46f1-b33a-e19629ded30e tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:33.168969 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-36c2441e-ec7f-46f1-b33a-e19629ded30e tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:33.376132 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-36c2441e-ec7f-46f1-b33a-e19629ded30e tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c023f89fd3da4bc8b38963bed4e5cc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a31364455dc442f8df299a8ad758a4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:02:33.384881 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-36c2441e-ec7f-46f1-b33a-e19629ded30e tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/e5f13132-d54e-43f7-8c86-91a4d23d4c35" status: 200 len: 1318 microversion: 2.1 time: 0.229889 Nov 23 13:02:33.385365 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 303/558] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:02:33 2021] GET /compute/v2.1/servers/e5f13132-d54e-43f7-8c86-91a4d23d4c35 => generated 1318 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:02:33.431942 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-5fd624a8-733a-40f1-8442-2d04c407d0a5 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:02:33.432561 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-5fd624a8-733a-40f1-8442-2d04c407d0a5 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: 53633a05-ad06-454a-b540-5fc01821ae45] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:33.440694 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5fd624a8-733a-40f1-8442-2d04c407d0a5 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:33.441140 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5fd624a8-733a-40f1-8442-2d04c407d0a5 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:33.441901 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5fd624a8-733a-40f1-8442-2d04c407d0a5 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:33.442326 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5fd624a8-733a-40f1-8442-2d04c407d0a5 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:33.650400 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-5fd624a8-733a-40f1-8442-2d04c407d0a5 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:02:33.659701 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-5fd624a8-733a-40f1-8442-2d04c407d0a5 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45" status: 200 len: 1552 microversion: 2.1 time: 0.231355 Nov 23 13:02:33.660497 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 304/559] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:02:33 2021] GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45 => generated 1552 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:02:34.402560 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-57bd1875-4ec0-4270-a1df-5e3e97125d53 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:02:34.403271 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-57bd1875-4ec0-4270-a1df-5e3e97125d53 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: e5f13132-d54e-43f7-8c86-91a4d23d4c35] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:34.411135 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-57bd1875-4ec0-4270-a1df-5e3e97125d53 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:34.411577 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-57bd1875-4ec0-4270-a1df-5e3e97125d53 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:34.412368 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-57bd1875-4ec0-4270-a1df-5e3e97125d53 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:34.412795 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-57bd1875-4ec0-4270-a1df-5e3e97125d53 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:34.639350 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-57bd1875-4ec0-4270-a1df-5e3e97125d53 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c023f89fd3da4bc8b38963bed4e5cc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a31364455dc442f8df299a8ad758a4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:02:34.649067 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-57bd1875-4ec0-4270-a1df-5e3e97125d53 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/e5f13132-d54e-43f7-8c86-91a4d23d4c35" status: 200 len: 1318 microversion: 2.1 time: 0.250299 Nov 23 13:02:34.649632 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 305/560] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:02:34 2021] GET /compute/v2.1/servers/e5f13132-d54e-43f7-8c86-91a4d23d4c35 => generated 1318 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:02:34.677640 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-d05e8de6-31a1-4659-a85a-661bc9ff0eaf tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:02:34.678245 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-d05e8de6-31a1-4659-a85a-661bc9ff0eaf tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: 53633a05-ad06-454a-b540-5fc01821ae45] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:34.686106 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d05e8de6-31a1-4659-a85a-661bc9ff0eaf tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:34.686550 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d05e8de6-31a1-4659-a85a-661bc9ff0eaf tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:34.687324 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d05e8de6-31a1-4659-a85a-661bc9ff0eaf tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:34.687823 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d05e8de6-31a1-4659-a85a-661bc9ff0eaf tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:34.896332 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-d05e8de6-31a1-4659-a85a-661bc9ff0eaf tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:02:34.905706 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-d05e8de6-31a1-4659-a85a-661bc9ff0eaf tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45" status: 200 len: 1552 microversion: 2.1 time: 0.231627 Nov 23 13:02:34.906279 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 306/561] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:02:34 2021] GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45 => generated 1552 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:02:35.671386 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-cfdba6d8-e07a-4869-9940-10c4aeb2fa21 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:02:35.672076 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-cfdba6d8-e07a-4869-9940-10c4aeb2fa21 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: e5f13132-d54e-43f7-8c86-91a4d23d4c35] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:35.680205 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-cfdba6d8-e07a-4869-9940-10c4aeb2fa21 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:35.680700 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-cfdba6d8-e07a-4869-9940-10c4aeb2fa21 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:35.681470 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-cfdba6d8-e07a-4869-9940-10c4aeb2fa21 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:35.681902 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-cfdba6d8-e07a-4869-9940-10c4aeb2fa21 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:35.894992 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-cfdba6d8-e07a-4869-9940-10c4aeb2fa21 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c023f89fd3da4bc8b38963bed4e5cc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a31364455dc442f8df299a8ad758a4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:02:35.903512 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-cfdba6d8-e07a-4869-9940-10c4aeb2fa21 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/e5f13132-d54e-43f7-8c86-91a4d23d4c35" status: 200 len: 1318 microversion: 2.1 time: 0.236074 Nov 23 13:02:35.904086 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 307/562] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:02:35 2021] GET /compute/v2.1/servers/e5f13132-d54e-43f7-8c86-91a4d23d4c35 => generated 1318 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:02:35.922751 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-db7f9a10-a74f-42c1-b433-f5f5177b0800 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:02:35.923182 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-db7f9a10-a74f-42c1-b433-f5f5177b0800 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: 53633a05-ad06-454a-b540-5fc01821ae45] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:35.931463 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-db7f9a10-a74f-42c1-b433-f5f5177b0800 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:35.931994 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-db7f9a10-a74f-42c1-b433-f5f5177b0800 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:35.932756 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-db7f9a10-a74f-42c1-b433-f5f5177b0800 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:35.933184 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-db7f9a10-a74f-42c1-b433-f5f5177b0800 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:35.977998 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-b76ae22b-8b25-4743-b72d-7939f269ab57 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action" status: 200 len: 28670 microversion: 2.20 time: 6.327126 Nov 23 13:02:35.982714 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 256/563] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:02:29 2021] POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action => generated 28670 bytes in 6330 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:02:36.149603 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-db7f9a10-a74f-42c1-b433-f5f5177b0800 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:02:36.158846 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-db7f9a10-a74f-42c1-b433-f5f5177b0800 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45" status: 200 len: 1552 microversion: 2.1 time: 0.239838 Nov 23 13:02:36.159381 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 308/564] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:02:35 2021] GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45 => generated 1552 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 13:02:36.924780 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-25831ad9-ec42-420f-bf4f-12c4291f106e tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:02:36.925905 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-25831ad9-ec42-420f-bf4f-12c4291f106e tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: e5f13132-d54e-43f7-8c86-91a4d23d4c35] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:36.935058 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-25831ad9-ec42-420f-bf4f-12c4291f106e tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:36.935482 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-25831ad9-ec42-420f-bf4f-12c4291f106e tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:36.936295 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-25831ad9-ec42-420f-bf4f-12c4291f106e tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:36.936762 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-25831ad9-ec42-420f-bf4f-12c4291f106e tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:36.990213 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-b7e92fc6-9cc8-4fad-92da-f1d1fdd769fa tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:02:36.992127 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-b7e92fc6-9cc8-4fad-92da-f1d1fdd769fa tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:37.001599 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b7e92fc6-9cc8-4fad-92da-f1d1fdd769fa tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:37.002082 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b7e92fc6-9cc8-4fad-92da-f1d1fdd769fa tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:37.002829 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b7e92fc6-9cc8-4fad-92da-f1d1fdd769fa tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:37.003287 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b7e92fc6-9cc8-4fad-92da-f1d1fdd769fa tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:37.146839 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-25831ad9-ec42-420f-bf4f-12c4291f106e tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c023f89fd3da4bc8b38963bed4e5cc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a31364455dc442f8df299a8ad758a4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:02:37.156197 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-25831ad9-ec42-420f-bf4f-12c4291f106e tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/e5f13132-d54e-43f7-8c86-91a4d23d4c35" status: 200 len: 1318 microversion: 2.1 time: 0.237956 Nov 23 13:02:37.156797 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 257/565] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:02:36 2021] GET /compute/v2.1/servers/e5f13132-d54e-43f7-8c86-91a4d23d4c35 => generated 1318 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 13:02:37.179906 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-df4139c6-b1bd-42ed-bc73-ba85574e115a tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:02:37.180541 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-df4139c6-b1bd-42ed-bc73-ba85574e115a tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: 53633a05-ad06-454a-b540-5fc01821ae45] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:37.188368 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-df4139c6-b1bd-42ed-bc73-ba85574e115a tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:37.188801 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-df4139c6-b1bd-42ed-bc73-ba85574e115a tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:37.189582 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-df4139c6-b1bd-42ed-bc73-ba85574e115a tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:37.190011 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-df4139c6-b1bd-42ed-bc73-ba85574e115a tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:37.413868 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-df4139c6-b1bd-42ed-bc73-ba85574e115a tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:02:37.424350 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-df4139c6-b1bd-42ed-bc73-ba85574e115a tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45" status: 200 len: 1552 microversion: 2.1 time: 0.249566 Nov 23 13:02:37.424899 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 258/566] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:02:37 2021] GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45 => generated 1552 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 13:02:38.178383 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-aeb1a718-c06d-4028-bb37-664255118d64 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:02:38.179190 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-aeb1a718-c06d-4028-bb37-664255118d64 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: e5f13132-d54e-43f7-8c86-91a4d23d4c35] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:38.189495 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-aeb1a718-c06d-4028-bb37-664255118d64 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:38.190159 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-aeb1a718-c06d-4028-bb37-664255118d64 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:38.191084 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-aeb1a718-c06d-4028-bb37-664255118d64 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:38.191637 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-aeb1a718-c06d-4028-bb37-664255118d64 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:38.412059 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-aeb1a718-c06d-4028-bb37-664255118d64 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c023f89fd3da4bc8b38963bed4e5cc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a31364455dc442f8df299a8ad758a4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:02:38.421097 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-aeb1a718-c06d-4028-bb37-664255118d64 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/e5f13132-d54e-43f7-8c86-91a4d23d4c35" status: 200 len: 1318 microversion: 2.1 time: 0.247472 Nov 23 13:02:38.421631 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 259/567] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:02:38 2021] GET /compute/v2.1/servers/e5f13132-d54e-43f7-8c86-91a4d23d4c35 => generated 1318 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:02:38.445462 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-70393a0e-2913-4a23-8885-1c7dc63b1e4e tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:02:38.446070 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-70393a0e-2913-4a23-8885-1c7dc63b1e4e tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: 53633a05-ad06-454a-b540-5fc01821ae45] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:38.453512 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-70393a0e-2913-4a23-8885-1c7dc63b1e4e tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:38.453964 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-70393a0e-2913-4a23-8885-1c7dc63b1e4e tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:38.454733 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-70393a0e-2913-4a23-8885-1c7dc63b1e4e tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:38.455164 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-70393a0e-2913-4a23-8885-1c7dc63b1e4e tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:38.674871 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-70393a0e-2913-4a23-8885-1c7dc63b1e4e tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:02:38.684378 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-70393a0e-2913-4a23-8885-1c7dc63b1e4e tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45" status: 200 len: 1552 microversion: 2.1 time: 0.242643 Nov 23 13:02:38.684952 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 260/568] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:02:38 2021] GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45 => generated 1552 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:02:39.437859 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-cce51eca-be94-47c2-b5e9-95758af8dd54 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:02:39.438555 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-cce51eca-be94-47c2-b5e9-95758af8dd54 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: e5f13132-d54e-43f7-8c86-91a4d23d4c35] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:39.446654 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-cce51eca-be94-47c2-b5e9-95758af8dd54 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:39.447091 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-cce51eca-be94-47c2-b5e9-95758af8dd54 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:39.447857 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-cce51eca-be94-47c2-b5e9-95758af8dd54 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:39.448279 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-cce51eca-be94-47c2-b5e9-95758af8dd54 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:39.653161 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-cce51eca-be94-47c2-b5e9-95758af8dd54 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c023f89fd3da4bc8b38963bed4e5cc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a31364455dc442f8df299a8ad758a4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:02:39.661820 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-cce51eca-be94-47c2-b5e9-95758af8dd54 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/e5f13132-d54e-43f7-8c86-91a4d23d4c35" status: 200 len: 1318 microversion: 2.1 time: 0.227797 Nov 23 13:02:39.662431 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 261/569] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:02:39 2021] GET /compute/v2.1/servers/e5f13132-d54e-43f7-8c86-91a4d23d4c35 => generated 1318 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:02:39.701951 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-4c60c890-f0b1-4214-ba90-00ad427fa84c tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:02:39.702526 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-4c60c890-f0b1-4214-ba90-00ad427fa84c tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: 53633a05-ad06-454a-b540-5fc01821ae45] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:39.710726 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-4c60c890-f0b1-4214-ba90-00ad427fa84c tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:39.711203 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-4c60c890-f0b1-4214-ba90-00ad427fa84c tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:39.711982 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-4c60c890-f0b1-4214-ba90-00ad427fa84c tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:39.712547 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-4c60c890-f0b1-4214-ba90-00ad427fa84c tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:39.913070 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-4c60c890-f0b1-4214-ba90-00ad427fa84c tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:02:39.922266 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-4c60c890-f0b1-4214-ba90-00ad427fa84c tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45" status: 200 len: 1552 microversion: 2.1 time: 0.224024 Nov 23 13:02:39.922994 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 262/570] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:02:39 2021] GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45 => generated 1552 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:02:40.681106 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-099bca52-cf45-4681-9ef1-86539832dea1 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:02:40.681753 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-099bca52-cf45-4681-9ef1-86539832dea1 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: e5f13132-d54e-43f7-8c86-91a4d23d4c35] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:40.689700 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-099bca52-cf45-4681-9ef1-86539832dea1 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:40.690135 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-099bca52-cf45-4681-9ef1-86539832dea1 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:40.690899 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-099bca52-cf45-4681-9ef1-86539832dea1 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:40.691320 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-099bca52-cf45-4681-9ef1-86539832dea1 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:40.905001 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-099bca52-cf45-4681-9ef1-86539832dea1 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c023f89fd3da4bc8b38963bed4e5cc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a31364455dc442f8df299a8ad758a4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:02:40.913427 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-099bca52-cf45-4681-9ef1-86539832dea1 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/e5f13132-d54e-43f7-8c86-91a4d23d4c35" status: 200 len: 1318 microversion: 2.1 time: 0.237530 Nov 23 13:02:40.913991 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 263/571] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:02:40 2021] GET /compute/v2.1/servers/e5f13132-d54e-43f7-8c86-91a4d23d4c35 => generated 1318 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:02:40.939721 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-01ead8b7-affb-41a5-9f19-f97aeeda806f tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:02:40.940265 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-01ead8b7-affb-41a5-9f19-f97aeeda806f tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: 53633a05-ad06-454a-b540-5fc01821ae45] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:40.947992 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-01ead8b7-affb-41a5-9f19-f97aeeda806f tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:40.948470 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-01ead8b7-affb-41a5-9f19-f97aeeda806f tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:40.949238 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-01ead8b7-affb-41a5-9f19-f97aeeda806f tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:40.949697 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-01ead8b7-affb-41a5-9f19-f97aeeda806f tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:41.156716 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-01ead8b7-affb-41a5-9f19-f97aeeda806f tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:02:41.167362 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-01ead8b7-affb-41a5-9f19-f97aeeda806f tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45" status: 200 len: 1552 microversion: 2.1 time: 0.231317 Nov 23 13:02:41.167958 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 264/572] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:02:40 2021] GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45 => generated 1552 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 13:02:41.932627 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-1bb83a13-f75a-471c-b4a2-70aaef5a2e47 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:02:41.933467 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-1bb83a13-f75a-471c-b4a2-70aaef5a2e47 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: e5f13132-d54e-43f7-8c86-91a4d23d4c35] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:41.943233 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1bb83a13-f75a-471c-b4a2-70aaef5a2e47 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:41.943896 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1bb83a13-f75a-471c-b4a2-70aaef5a2e47 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:41.944783 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1bb83a13-f75a-471c-b4a2-70aaef5a2e47 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:41.945214 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1bb83a13-f75a-471c-b4a2-70aaef5a2e47 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:42.153102 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-1bb83a13-f75a-471c-b4a2-70aaef5a2e47 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c023f89fd3da4bc8b38963bed4e5cc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a31364455dc442f8df299a8ad758a4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:02:42.169901 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-1bb83a13-f75a-471c-b4a2-70aaef5a2e47 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/e5f13132-d54e-43f7-8c86-91a4d23d4c35" status: 200 len: 1318 microversion: 2.1 time: 0.242419 Nov 23 13:02:42.170477 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 265/573] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:02:41 2021] GET /compute/v2.1/servers/e5f13132-d54e-43f7-8c86-91a4d23d4c35 => generated 1318 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 13:02:42.184740 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-f5fcce02-4d69-4713-a989-cfc93ac9b81f tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:02:42.185376 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-f5fcce02-4d69-4713-a989-cfc93ac9b81f tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: 53633a05-ad06-454a-b540-5fc01821ae45] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:42.192939 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f5fcce02-4d69-4713-a989-cfc93ac9b81f tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:42.193381 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f5fcce02-4d69-4713-a989-cfc93ac9b81f tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:42.194446 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f5fcce02-4d69-4713-a989-cfc93ac9b81f tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:42.194833 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f5fcce02-4d69-4713-a989-cfc93ac9b81f tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:42.419923 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-f5fcce02-4d69-4713-a989-cfc93ac9b81f tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:02:42.435931 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-f5fcce02-4d69-4713-a989-cfc93ac9b81f tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45" status: 200 len: 1552 microversion: 2.1 time: 0.254665 Nov 23 13:02:42.436833 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 266/574] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:02:42 2021] GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45 => generated 1552 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:02:43.187462 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-a3dc67c5-d48c-4081-97cb-8f9d162bbf28 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:02:43.188195 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-a3dc67c5-d48c-4081-97cb-8f9d162bbf28 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: e5f13132-d54e-43f7-8c86-91a4d23d4c35] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:43.196595 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a3dc67c5-d48c-4081-97cb-8f9d162bbf28 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:43.197050 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a3dc67c5-d48c-4081-97cb-8f9d162bbf28 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:43.197824 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a3dc67c5-d48c-4081-97cb-8f9d162bbf28 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:43.198255 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a3dc67c5-d48c-4081-97cb-8f9d162bbf28 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:43.393994 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-a3dc67c5-d48c-4081-97cb-8f9d162bbf28 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c023f89fd3da4bc8b38963bed4e5cc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a31364455dc442f8df299a8ad758a4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:02:43.402454 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-a3dc67c5-d48c-4081-97cb-8f9d162bbf28 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/e5f13132-d54e-43f7-8c86-91a4d23d4c35" status: 200 len: 1318 microversion: 2.1 time: 0.218834 Nov 23 13:02:43.403035 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 267/575] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:02:43 2021] GET /compute/v2.1/servers/e5f13132-d54e-43f7-8c86-91a4d23d4c35 => generated 1318 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:02:43.458930 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-0236bf51-a2a6-4ed7-b468-0f6b2f479ff5 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:02:43.459424 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-0236bf51-a2a6-4ed7-b468-0f6b2f479ff5 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: 53633a05-ad06-454a-b540-5fc01821ae45] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:43.467625 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0236bf51-a2a6-4ed7-b468-0f6b2f479ff5 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:43.468053 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0236bf51-a2a6-4ed7-b468-0f6b2f479ff5 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:43.468917 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0236bf51-a2a6-4ed7-b468-0f6b2f479ff5 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:43.469350 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0236bf51-a2a6-4ed7-b468-0f6b2f479ff5 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:43.686254 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-0236bf51-a2a6-4ed7-b468-0f6b2f479ff5 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:02:43.696668 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-0236bf51-a2a6-4ed7-b468-0f6b2f479ff5 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45" status: 200 len: 1552 microversion: 2.1 time: 0.241457 Nov 23 13:02:43.697641 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 268/576] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:02:43 2021] GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45 => generated 1552 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:02:44.419107 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-969ba7e9-2620-48e2-8954-3ed99865cc0b tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:02:44.419810 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-969ba7e9-2620-48e2-8954-3ed99865cc0b tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: e5f13132-d54e-43f7-8c86-91a4d23d4c35] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:44.427538 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-969ba7e9-2620-48e2-8954-3ed99865cc0b tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:44.427980 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-969ba7e9-2620-48e2-8954-3ed99865cc0b tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:44.429139 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-969ba7e9-2620-48e2-8954-3ed99865cc0b tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:44.429535 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-969ba7e9-2620-48e2-8954-3ed99865cc0b tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:44.522715 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-b7e92fc6-9cc8-4fad-92da-f1d1fdd769fa tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action" status: 200 len: 28670 microversion: 2.20 time: 7.535328 Nov 23 13:02:44.523826 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 309/577] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:02:36 2021] POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action => generated 28670 bytes in 7538 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 13:02:44.642118 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-969ba7e9-2620-48e2-8954-3ed99865cc0b tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c023f89fd3da4bc8b38963bed4e5cc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a31364455dc442f8df299a8ad758a4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:02:44.650720 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-969ba7e9-2620-48e2-8954-3ed99865cc0b tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/e5f13132-d54e-43f7-8c86-91a4d23d4c35" status: 200 len: 1318 microversion: 2.1 time: 0.235406 Nov 23 13:02:44.651272 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 269/578] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:02:44 2021] GET /compute/v2.1/servers/e5f13132-d54e-43f7-8c86-91a4d23d4c35 => generated 1318 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:02:44.715232 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-09626b19-9f49-4e0d-b785-866b451a2c81 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:02:44.715947 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-09626b19-9f49-4e0d-b785-866b451a2c81 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: 53633a05-ad06-454a-b540-5fc01821ae45] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:44.724155 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-09626b19-9f49-4e0d-b785-866b451a2c81 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:44.724822 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-09626b19-9f49-4e0d-b785-866b451a2c81 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:44.725816 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-09626b19-9f49-4e0d-b785-866b451a2c81 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:44.726149 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-09626b19-9f49-4e0d-b785-866b451a2c81 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:44.932892 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-09626b19-9f49-4e0d-b785-866b451a2c81 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:02:44.942060 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-09626b19-9f49-4e0d-b785-866b451a2c81 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45" status: 200 len: 1552 microversion: 2.1 time: 0.231034 Nov 23 13:02:44.942625 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 310/579] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:02:44 2021] GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45 => generated 1552 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:02:45.536486 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-c5d99c44-0087-4224-aa4e-b7a401bc9930 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:02:45.538695 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-c5d99c44-0087-4224-aa4e-b7a401bc9930 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:45.546595 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c5d99c44-0087-4224-aa4e-b7a401bc9930 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:45.547055 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c5d99c44-0087-4224-aa4e-b7a401bc9930 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:45.547834 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c5d99c44-0087-4224-aa4e-b7a401bc9930 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:45.548295 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c5d99c44-0087-4224-aa4e-b7a401bc9930 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:45.667989 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-622e7749-6aea-4879-ba76-4f51a8e6aea9 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:02:45.668620 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-622e7749-6aea-4879-ba76-4f51a8e6aea9 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: e5f13132-d54e-43f7-8c86-91a4d23d4c35] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:45.676324 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-622e7749-6aea-4879-ba76-4f51a8e6aea9 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:45.676772 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-622e7749-6aea-4879-ba76-4f51a8e6aea9 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:45.677535 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-622e7749-6aea-4879-ba76-4f51a8e6aea9 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:45.677963 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-622e7749-6aea-4879-ba76-4f51a8e6aea9 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:45.885567 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-622e7749-6aea-4879-ba76-4f51a8e6aea9 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c023f89fd3da4bc8b38963bed4e5cc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a31364455dc442f8df299a8ad758a4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:02:45.893893 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-622e7749-6aea-4879-ba76-4f51a8e6aea9 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/e5f13132-d54e-43f7-8c86-91a4d23d4c35" status: 200 len: 1318 microversion: 2.1 time: 0.229883 Nov 23 13:02:45.894440 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 311/580] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:02:45 2021] GET /compute/v2.1/servers/e5f13132-d54e-43f7-8c86-91a4d23d4c35 => generated 1318 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 13:02:45.959994 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-73f859ac-a560-40e5-8f72-e3b63bbc5a83 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:02:45.961301 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-73f859ac-a560-40e5-8f72-e3b63bbc5a83 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: 53633a05-ad06-454a-b540-5fc01821ae45] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:45.968851 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-73f859ac-a560-40e5-8f72-e3b63bbc5a83 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:45.969294 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-73f859ac-a560-40e5-8f72-e3b63bbc5a83 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:45.970070 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-73f859ac-a560-40e5-8f72-e3b63bbc5a83 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:45.970492 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-73f859ac-a560-40e5-8f72-e3b63bbc5a83 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:46.175965 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-73f859ac-a560-40e5-8f72-e3b63bbc5a83 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:02:46.187068 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-73f859ac-a560-40e5-8f72-e3b63bbc5a83 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45" status: 200 len: 1552 microversion: 2.1 time: 0.231659 Nov 23 13:02:46.187652 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 312/581] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:02:45 2021] GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45 => generated 1552 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:02:46.911361 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-6a924c28-013e-4bd9-9ce3-477bfd98ded1 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:02:46.912066 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-6a924c28-013e-4bd9-9ce3-477bfd98ded1 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: e5f13132-d54e-43f7-8c86-91a4d23d4c35] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:46.920079 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6a924c28-013e-4bd9-9ce3-477bfd98ded1 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:46.920535 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6a924c28-013e-4bd9-9ce3-477bfd98ded1 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:46.921324 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6a924c28-013e-4bd9-9ce3-477bfd98ded1 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:46.921744 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6a924c28-013e-4bd9-9ce3-477bfd98ded1 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:47.203565 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-6a924c28-013e-4bd9-9ce3-477bfd98ded1 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c023f89fd3da4bc8b38963bed4e5cc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a31364455dc442f8df299a8ad758a4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:02:47.212713 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-6a924c28-013e-4bd9-9ce3-477bfd98ded1 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/e5f13132-d54e-43f7-8c86-91a4d23d4c35" status: 200 len: 1318 microversion: 2.1 time: 0.305052 Nov 23 13:02:47.213367 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 313/582] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:02:46 2021] GET /compute/v2.1/servers/e5f13132-d54e-43f7-8c86-91a4d23d4c35 => generated 1318 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:02:47.217829 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-8aa12e1f-81f1-4b1b-a584-2670184a75ed tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:02:47.218438 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-8aa12e1f-81f1-4b1b-a584-2670184a75ed tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: 53633a05-ad06-454a-b540-5fc01821ae45] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:47.225894 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8aa12e1f-81f1-4b1b-a584-2670184a75ed tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:47.226335 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8aa12e1f-81f1-4b1b-a584-2670184a75ed tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:47.227084 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8aa12e1f-81f1-4b1b-a584-2670184a75ed tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:47.227504 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8aa12e1f-81f1-4b1b-a584-2670184a75ed tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:47.427548 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-8aa12e1f-81f1-4b1b-a584-2670184a75ed tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:02:47.436629 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-8aa12e1f-81f1-4b1b-a584-2670184a75ed tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45" status: 200 len: 1552 microversion: 2.1 time: 0.222259 Nov 23 13:02:47.437210 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 314/583] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:02:47 2021] GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45 => generated 1552 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:02:48.229754 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-7665930e-3bf9-449b-b06e-c528c1c69a0c tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:02:48.230471 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-7665930e-3bf9-449b-b06e-c528c1c69a0c tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: e5f13132-d54e-43f7-8c86-91a4d23d4c35] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:48.238586 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-7665930e-3bf9-449b-b06e-c528c1c69a0c tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:48.239042 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-7665930e-3bf9-449b-b06e-c528c1c69a0c tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:48.239821 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-7665930e-3bf9-449b-b06e-c528c1c69a0c tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:48.240279 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-7665930e-3bf9-449b-b06e-c528c1c69a0c tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:48.449659 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-7665930e-3bf9-449b-b06e-c528c1c69a0c tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c023f89fd3da4bc8b38963bed4e5cc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a31364455dc442f8df299a8ad758a4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:02:48.458529 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-7665930e-3bf9-449b-b06e-c528c1c69a0c tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/e5f13132-d54e-43f7-8c86-91a4d23d4c35" status: 200 len: 1318 microversion: 2.1 time: 0.232763 Nov 23 13:02:48.459101 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 315/584] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:02:48 2021] GET /compute/v2.1/servers/e5f13132-d54e-43f7-8c86-91a4d23d4c35 => generated 1318 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:02:48.463800 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-f5d85f4e-e1d0-45d6-9eff-f1a6bad52136 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:02:48.464437 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-f5d85f4e-e1d0-45d6-9eff-f1a6bad52136 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: 53633a05-ad06-454a-b540-5fc01821ae45] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:48.472349 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f5d85f4e-e1d0-45d6-9eff-f1a6bad52136 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:48.472806 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f5d85f4e-e1d0-45d6-9eff-f1a6bad52136 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:48.473583 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f5d85f4e-e1d0-45d6-9eff-f1a6bad52136 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:48.474120 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f5d85f4e-e1d0-45d6-9eff-f1a6bad52136 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:48.681395 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-f5d85f4e-e1d0-45d6-9eff-f1a6bad52136 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:02:48.690632 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-f5d85f4e-e1d0-45d6-9eff-f1a6bad52136 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45" status: 200 len: 1552 microversion: 2.1 time: 0.230511 Nov 23 13:02:48.691209 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 316/585] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:02:48 2021] GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45 => generated 1552 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:02:49.478396 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-5d09ddf7-ad87-47cb-b7a5-a64da7784fcb tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:02:49.479261 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-5d09ddf7-ad87-47cb-b7a5-a64da7784fcb tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: e5f13132-d54e-43f7-8c86-91a4d23d4c35] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:49.486645 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5d09ddf7-ad87-47cb-b7a5-a64da7784fcb tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:49.487089 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5d09ddf7-ad87-47cb-b7a5-a64da7784fcb tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:49.487848 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5d09ddf7-ad87-47cb-b7a5-a64da7784fcb tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:49.488281 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5d09ddf7-ad87-47cb-b7a5-a64da7784fcb tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:49.702952 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-5d09ddf7-ad87-47cb-b7a5-a64da7784fcb tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c023f89fd3da4bc8b38963bed4e5cc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a31364455dc442f8df299a8ad758a4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:02:49.714359 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-5d09ddf7-ad87-47cb-b7a5-a64da7784fcb tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/e5f13132-d54e-43f7-8c86-91a4d23d4c35" status: 200 len: 1318 microversion: 2.1 time: 0.240924 Nov 23 13:02:49.714902 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 317/586] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:02:49 2021] GET /compute/v2.1/servers/e5f13132-d54e-43f7-8c86-91a4d23d4c35 => generated 1318 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:02:49.719205 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-d28478d6-6cac-49a4-8e7d-c3b8afd0678b tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:02:49.719805 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-d28478d6-6cac-49a4-8e7d-c3b8afd0678b tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: 53633a05-ad06-454a-b540-5fc01821ae45] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:49.727199 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d28478d6-6cac-49a4-8e7d-c3b8afd0678b tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:49.727635 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d28478d6-6cac-49a4-8e7d-c3b8afd0678b tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:49.728474 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d28478d6-6cac-49a4-8e7d-c3b8afd0678b tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:49.728839 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d28478d6-6cac-49a4-8e7d-c3b8afd0678b tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:49.938896 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-d28478d6-6cac-49a4-8e7d-c3b8afd0678b tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:02:49.948214 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-d28478d6-6cac-49a4-8e7d-c3b8afd0678b tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45" status: 200 len: 1552 microversion: 2.1 time: 0.232345 Nov 23 13:02:49.948871 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 318/587] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:02:49 2021] GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45 => generated 1552 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:02:49.973617 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-c5d99c44-0087-4224-aa4e-b7a401bc9930 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action" status: 200 len: 28670 microversion: 2.20 time: 4.441799 Nov 23 13:02:49.974501 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 270/588] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:02:45 2021] POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action => generated 28670 bytes in 4444 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:02:50.732691 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-57fcfd06-8808-40a4-8d59-3dccb8c57211 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:02:50.733605 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-57fcfd06-8808-40a4-8d59-3dccb8c57211 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: e5f13132-d54e-43f7-8c86-91a4d23d4c35] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:50.743807 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-57fcfd06-8808-40a4-8d59-3dccb8c57211 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:50.744228 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-57fcfd06-8808-40a4-8d59-3dccb8c57211 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:50.745164 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-57fcfd06-8808-40a4-8d59-3dccb8c57211 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:50.745662 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-57fcfd06-8808-40a4-8d59-3dccb8c57211 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:50.973500 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-ccdfc91a-1cca-4042-b40a-0a19e321d872 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:02:50.974334 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-ccdfc91a-1cca-4042-b40a-0a19e321d872 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: 53633a05-ad06-454a-b540-5fc01821ae45] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:50.984134 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ccdfc91a-1cca-4042-b40a-0a19e321d872 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:50.984960 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ccdfc91a-1cca-4042-b40a-0a19e321d872 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:50.986259 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ccdfc91a-1cca-4042-b40a-0a19e321d872 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:50.986852 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ccdfc91a-1cca-4042-b40a-0a19e321d872 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:51.046166 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-57fcfd06-8808-40a4-8d59-3dccb8c57211 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c023f89fd3da4bc8b38963bed4e5cc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a31364455dc442f8df299a8ad758a4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:02:51.058024 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-57fcfd06-8808-40a4-8d59-3dccb8c57211 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/e5f13132-d54e-43f7-8c86-91a4d23d4c35" status: 200 len: 1318 microversion: 2.1 time: 0.329136 Nov 23 13:02:51.067916 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 319/589] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:02:50 2021] GET /compute/v2.1/servers/e5f13132-d54e-43f7-8c86-91a4d23d4c35 => generated 1318 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 13:02:51.082221 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-b6431cfa-e928-4ef7-b910-7a23c91bee27 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:02:51.083890 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-b6431cfa-e928-4ef7-b910-7a23c91bee27 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:51.101875 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b6431cfa-e928-4ef7-b910-7a23c91bee27 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:51.103341 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b6431cfa-e928-4ef7-b910-7a23c91bee27 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:51.104850 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b6431cfa-e928-4ef7-b910-7a23c91bee27 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:51.105638 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b6431cfa-e928-4ef7-b910-7a23c91bee27 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:51.280640 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-ccdfc91a-1cca-4042-b40a-0a19e321d872 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:02:51.316656 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-ccdfc91a-1cca-4042-b40a-0a19e321d872 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45" status: 200 len: 1552 microversion: 2.1 time: 0.348468 Nov 23 13:02:51.319723 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 271/590] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:02:50 2021] GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45 => generated 1552 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:02:51.327571 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-b6431cfa-e928-4ef7-b910-7a23c91bee27 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action" status: 200 len: 28670 microversion: 2.20 time: 0.258086 Nov 23 13:02:51.328339 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 320/591] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:02:51 2021] POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action => generated 28670 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:02:52.079052 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-74e9bb9d-5e3a-473b-9287-6c0e2fc1e6ee tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:02:52.079701 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-74e9bb9d-5e3a-473b-9287-6c0e2fc1e6ee tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: e5f13132-d54e-43f7-8c86-91a4d23d4c35] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:52.089198 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-74e9bb9d-5e3a-473b-9287-6c0e2fc1e6ee tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:52.090086 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-74e9bb9d-5e3a-473b-9287-6c0e2fc1e6ee tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:52.091100 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-74e9bb9d-5e3a-473b-9287-6c0e2fc1e6ee tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:52.091589 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-74e9bb9d-5e3a-473b-9287-6c0e2fc1e6ee tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:52.319717 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-74e9bb9d-5e3a-473b-9287-6c0e2fc1e6ee tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c023f89fd3da4bc8b38963bed4e5cc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a31364455dc442f8df299a8ad758a4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:02:52.333196 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-74e9bb9d-5e3a-473b-9287-6c0e2fc1e6ee tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/e5f13132-d54e-43f7-8c86-91a4d23d4c35" status: 200 len: 1509 microversion: 2.1 time: 0.258255 Nov 23 13:02:52.334107 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 272/592] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:02:52 2021] GET /compute/v2.1/servers/e5f13132-d54e-43f7-8c86-91a4d23d4c35 => generated 1509 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:02:52.346604 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-2849c631-17e3-4a66-bbaf-199b12ea32e8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:02:52.347622 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-2849c631-17e3-4a66-bbaf-199b12ea32e8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:52.350531 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-7021e2c0-1919-4d57-906f-11b7679b158c tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:02:52.351109 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-7021e2c0-1919-4d57-906f-11b7679b158c tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: 53633a05-ad06-454a-b540-5fc01821ae45] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:52.356923 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-2849c631-17e3-4a66-bbaf-199b12ea32e8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:52.357364 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-2849c631-17e3-4a66-bbaf-199b12ea32e8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:52.358129 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-2849c631-17e3-4a66-bbaf-199b12ea32e8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:52.358549 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-2849c631-17e3-4a66-bbaf-199b12ea32e8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:52.360816 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7021e2c0-1919-4d57-906f-11b7679b158c tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:52.361262 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7021e2c0-1919-4d57-906f-11b7679b158c tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:52.362041 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7021e2c0-1919-4d57-906f-11b7679b158c tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:52.362468 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7021e2c0-1919-4d57-906f-11b7679b158c tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:52.488420 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-2849c631-17e3-4a66-bbaf-199b12ea32e8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action" status: 200 len: 28670 microversion: 2.20 time: 0.145629 Nov 23 13:02:52.493673 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 321/593] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:02:52 2021] POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action => generated 28670 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:02:52.622740 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-e902285e-917e-489b-ac4d-8f7953fa23eb tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1199267940", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-984203030", "security_groups": [{"name": "tempest-secgroup-smoke-108357609"}], "networks": [{"uuid": "02ba363d-e5eb-44ed-b3cb-f5f6be41db0f"}], "block_device_mapping_v2": [{"uuid": "9872f75a-b0c6-431d-a84b-a4e9e65682d8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:02:52.753075 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-7021e2c0-1919-4d57-906f-11b7679b158c tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:02:52.778737 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-7021e2c0-1919-4d57-906f-11b7679b158c tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45" status: 200 len: 1552 microversion: 2.1 time: 0.431163 Nov 23 13:02:52.804025 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 273/594] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:02:52 2021] GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45 => generated 1552 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:02:53.031693 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.network.neutron [None req-e902285e-917e-489b-ac4d-8f7953fa23eb tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] validate_networks() for [('02ba363d-e5eb-44ed-b3cb-f5f6be41db0f', None, None, None)] {{(pid=100973) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Nov 23 13:02:53.506091 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-5b15f3f2-3824-4b5a-a047-16ed4c7377f5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:02:53.507984 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-5b15f3f2-3824-4b5a-a047-16ed4c7377f5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:53.519028 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5b15f3f2-3824-4b5a-a047-16ed4c7377f5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:53.519517 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5b15f3f2-3824-4b5a-a047-16ed4c7377f5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:53.520316 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5b15f3f2-3824-4b5a-a047-16ed4c7377f5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:53.520919 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5b15f3f2-3824-4b5a-a047-16ed4c7377f5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:53.671442 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.virt.hardware [None req-e902285e-917e-489b-ac4d-8f7953fa23eb tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Flavor limits 0:0:0 {{(pid=100973) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 23 13:02:53.672682 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.virt.hardware [None req-e902285e-917e-489b-ac4d-8f7953fa23eb tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Image limits 0:0:0 {{(pid=100973) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 23 13:02:53.673640 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.virt.hardware [None req-e902285e-917e-489b-ac4d-8f7953fa23eb tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Flavor pref 0:0:0 {{(pid=100973) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 23 13:02:53.674288 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.virt.hardware [None req-e902285e-917e-489b-ac4d-8f7953fa23eb tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Image pref 0:0:0 {{(pid=100973) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 23 13:02:53.674891 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.virt.hardware [None req-e902285e-917e-489b-ac4d-8f7953fa23eb tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100973) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 23 13:02:53.691757 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e902285e-917e-489b-ac4d-8f7953fa23eb tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:53.698067 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e902285e-917e-489b-ac4d-8f7953fa23eb tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:53.699331 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e902285e-917e-489b-ac4d-8f7953fa23eb tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:53.699947 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e902285e-917e-489b-ac4d-8f7953fa23eb tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:53.723977 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-5b15f3f2-3824-4b5a-a047-16ed4c7377f5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action" status: 200 len: 28670 microversion: 2.20 time: 0.226473 Nov 23 13:02:53.733134 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 274/595] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:02:53 2021] POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action => generated 28670 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 13:02:53.743701 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.quota [None req-e902285e-917e-489b-ac4d-8f7953fa23eb tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Getting quotas for project a76cd93551c243ffac2329a86c7fce12. Resources: {'ram', 'cores', 'instances'} {{(pid=100973) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 13:02:53.749547 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.quota [None req-e902285e-917e-489b-ac4d-8f7953fa23eb tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Getting quotas for user e1f010313d3e4875994e8537e8c9c558 and project a76cd93551c243ffac2329a86c7fce12. Resources: {'ram', 'cores', 'instances'} {{(pid=100973) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 13:02:53.815654 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-1ddef22d-b5c1-4995-9572-ecb275af7e72 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:02:53.817165 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-1ddef22d-b5c1-4995-9572-ecb275af7e72 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: 53633a05-ad06-454a-b540-5fc01821ae45] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:53.853485 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1ddef22d-b5c1-4995-9572-ecb275af7e72 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:53.856785 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1ddef22d-b5c1-4995-9572-ecb275af7e72 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:53.857786 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1ddef22d-b5c1-4995-9572-ecb275af7e72 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:53.860838 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1ddef22d-b5c1-4995-9572-ecb275af7e72 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:53.889012 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-e902285e-917e-489b-ac4d-8f7953fa23eb tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Going to run 1 instances... {{(pid=100973) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Nov 23 13:02:53.893335 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-e902285e-917e-489b-ac4d-8f7953fa23eb tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9872f75a-b0c6-431d-a84b-a4e9e65682d8',volume_size=None,volume_type=None)] {{(pid=100973) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Nov 23 13:02:54.204568 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-e902285e-917e-489b-ac4d-8f7953fa23eb tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.583866 Nov 23 13:02:54.207617 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 322/596] 10.222.0.60 () {60 vars in 1146 bytes} [Tue Nov 23 13:02:52 2021] POST /compute/v2.1/servers => generated 405 bytes in 1591 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 23 13:02:54.219875 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-0cf7556d-1223-4498-b38d-ec54cb55e38e tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e21588b1-c572-4d7d-9ddb-1e2f598d08c4"}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:02:54.221171 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-0cf7556d-1223-4498-b38d-ec54cb55e38e tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: e5f13132-d54e-43f7-8c86-91a4d23d4c35] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:54.225234 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-1ddef22d-b5c1-4995-9572-ecb275af7e72 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:02:54.237229 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-1ddef22d-b5c1-4995-9572-ecb275af7e72 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45" status: 200 len: 1558 microversion: 2.1 time: 0.430363 Nov 23 13:02:54.252837 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 275/597] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:02:53 2021] GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45 => generated 1558 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 13:02:54.280309 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0cf7556d-1223-4498-b38d-ec54cb55e38e tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:54.282094 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0cf7556d-1223-4498-b38d-ec54cb55e38e tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:54.283324 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0cf7556d-1223-4498-b38d-ec54cb55e38e tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:54.284431 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0cf7556d-1223-4498-b38d-ec54cb55e38e tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:54.289359 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-76a53e56-5d6c-471f-b3e5-f4b8787dcef1 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:02:54.290421 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-76a53e56-5d6c-471f-b3e5-f4b8787dcef1 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:54.428855 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-76a53e56-5d6c-471f-b3e5-f4b8787dcef1 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:02:54.440931 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-76a53e56-5d6c-471f-b3e5-f4b8787dcef1 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1088 microversion: 2.1 time: 0.186357 Nov 23 13:02:54.441707 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 276/598] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:02:54 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1088 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:02:54.510479 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-3487a4a6-7bf6-4ba8-862f-48ea8265c056 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:02:54.511185 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-3487a4a6-7bf6-4ba8-862f-48ea8265c056 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: 53633a05-ad06-454a-b540-5fc01821ae45] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:54.525225 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3487a4a6-7bf6-4ba8-862f-48ea8265c056 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:54.526063 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3487a4a6-7bf6-4ba8-862f-48ea8265c056 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:54.527207 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3487a4a6-7bf6-4ba8-862f-48ea8265c056 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:54.527959 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3487a4a6-7bf6-4ba8-862f-48ea8265c056 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:54.854451 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.objects.instance [None req-3487a4a6-7bf6-4ba8-862f-48ea8265c056 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lazy-loading 'services' on Instance uuid 53633a05-ad06-454a-b540-5fc01821ae45 {{(pid=100974) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 23 13:02:55.035981 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-0cf7556d-1223-4498-b38d-ec54cb55e38e tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "POST /compute/v2.1/servers/e5f13132-d54e-43f7-8c86-91a4d23d4c35/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.822173 Nov 23 13:02:55.035981 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 323/599] 10.222.0.60 () {60 vars in 1322 bytes} [Tue Nov 23 13:02:54 2021] POST /compute/v2.1/servers/e5f13132-d54e-43f7-8c86-91a4d23d4c35/os-volume_attachments => generated 194 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 13:02:55.053906 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-32ce4824-d4e1-474e-af08-cc0432dd6655 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:02:55.055201 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-32ce4824-d4e1-474e-af08-cc0432dd6655 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:55.066670 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-32ce4824-d4e1-474e-af08-cc0432dd6655 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:55.073362 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-32ce4824-d4e1-474e-af08-cc0432dd6655 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:55.074906 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-32ce4824-d4e1-474e-af08-cc0432dd6655 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:55.076389 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-32ce4824-d4e1-474e-af08-cc0432dd6655 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:55.162047 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-3487a4a6-7bf6-4ba8-862f-48ea8265c056 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "DELETE /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45/os-volume_attachments/9fcbca04-cca7-4f8c-870b-68ef0dca1710" status: 202 len: 0 microversion: 2.1 time: 0.655995 Nov 23 13:02:55.162632 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 277/600] 10.222.0.60 () {58 vars in 1415 bytes} [Tue Nov 23 13:02:54 2021] DELETE /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45/os-volume_attachments/9fcbca04-cca7-4f8c-870b-68ef0dca1710 => generated 0 bytes in 658 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 23 13:02:55.173759 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-2af4dbb4-cfaa-4eea-9a10-e99bbcbc668d tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:02:55.175126 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-2af4dbb4-cfaa-4eea-9a10-e99bbcbc668d tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: 53633a05-ad06-454a-b540-5fc01821ae45] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:55.186183 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2af4dbb4-cfaa-4eea-9a10-e99bbcbc668d tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:55.186656 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2af4dbb4-cfaa-4eea-9a10-e99bbcbc668d tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:55.187471 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2af4dbb4-cfaa-4eea-9a10-e99bbcbc668d tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:55.188114 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2af4dbb4-cfaa-4eea-9a10-e99bbcbc668d tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:55.276994 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-32ce4824-d4e1-474e-af08-cc0432dd6655 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action" status: 200 len: 28670 microversion: 2.20 time: 0.239497 Nov 23 13:02:55.278285 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 324/601] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:02:55 2021] POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action => generated 28670 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:02:55.285945 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-2af4dbb4-cfaa-4eea-9a10-e99bbcbc668d tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.116641 Nov 23 13:02:55.286697 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 278/602] 10.222.0.60 () {58 vars in 1301 bytes} [Tue Nov 23 13:02:55 2021] GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45/os-volume_attachments => generated 197 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 13:02:55.460738 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-8e1f40a0-e39e-46c1-b9ba-e2c007c40b33 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:02:55.462395 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-8e1f40a0-e39e-46c1-b9ba-e2c007c40b33 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:55.485387 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8e1f40a0-e39e-46c1-b9ba-e2c007c40b33 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:55.486772 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8e1f40a0-e39e-46c1-b9ba-e2c007c40b33 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:55.488910 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8e1f40a0-e39e-46c1-b9ba-e2c007c40b33 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:55.491065 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8e1f40a0-e39e-46c1-b9ba-e2c007c40b33 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:55.659601 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-8e1f40a0-e39e-46c1-b9ba-e2c007c40b33 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:02:55.669793 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-8e1f40a0-e39e-46c1-b9ba-e2c007c40b33 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1186 microversion: 2.1 time: 0.214242 Nov 23 13:02:55.670692 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 325/603] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:02:55 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1186 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 13:02:56.289235 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-c0d14101-bd87-43af-b058-60a7b8328d14 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:02:56.291203 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-c0d14101-bd87-43af-b058-60a7b8328d14 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:56.299489 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c0d14101-bd87-43af-b058-60a7b8328d14 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:56.300000 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c0d14101-bd87-43af-b058-60a7b8328d14 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:56.300392 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-7e220463-ccc6-41af-9488-2d7a69faa154 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:02:56.301285 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c0d14101-bd87-43af-b058-60a7b8328d14 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:56.301665 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-7e220463-ccc6-41af-9488-2d7a69faa154 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: 53633a05-ad06-454a-b540-5fc01821ae45] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:56.301917 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c0d14101-bd87-43af-b058-60a7b8328d14 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:56.310820 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-7e220463-ccc6-41af-9488-2d7a69faa154 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:56.311581 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-7e220463-ccc6-41af-9488-2d7a69faa154 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:56.312592 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-7e220463-ccc6-41af-9488-2d7a69faa154 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:56.313204 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-7e220463-ccc6-41af-9488-2d7a69faa154 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:56.417623 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-7e220463-ccc6-41af-9488-2d7a69faa154 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.122763 Nov 23 13:02:56.422242 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 326/604] 10.222.0.60 () {58 vars in 1301 bytes} [Tue Nov 23 13:02:56 2021] GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45/os-volume_attachments => generated 197 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 13:02:56.475732 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-c0d14101-bd87-43af-b058-60a7b8328d14 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action" status: 200 len: 28670 microversion: 2.20 time: 0.190398 Nov 23 13:02:56.476638 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 279/605] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:02:56 2021] POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action => generated 28670 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:02:56.688066 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-6e1b36da-c82d-46e8-9b61-adecd99b5464 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:02:56.688841 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-6e1b36da-c82d-46e8-9b61-adecd99b5464 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:56.696501 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6e1b36da-c82d-46e8-9b61-adecd99b5464 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:56.696939 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6e1b36da-c82d-46e8-9b61-adecd99b5464 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:56.698357 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6e1b36da-c82d-46e8-9b61-adecd99b5464 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:56.698772 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6e1b36da-c82d-46e8-9b61-adecd99b5464 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:56.879716 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-6e1b36da-c82d-46e8-9b61-adecd99b5464 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:02:56.900600 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-6e1b36da-c82d-46e8-9b61-adecd99b5464 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1204 microversion: 2.1 time: 0.215060 Nov 23 13:02:56.902325 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 327/606] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:02:56 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1204 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:02:57.431110 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-a5ce5469-fb2b-4e04-93bc-6faa339d2fc6 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:02:57.433212 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-a5ce5469-fb2b-4e04-93bc-6faa339d2fc6 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: 53633a05-ad06-454a-b540-5fc01821ae45] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:57.448273 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a5ce5469-fb2b-4e04-93bc-6faa339d2fc6 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:57.448802 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a5ce5469-fb2b-4e04-93bc-6faa339d2fc6 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:57.450042 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a5ce5469-fb2b-4e04-93bc-6faa339d2fc6 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:57.450528 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a5ce5469-fb2b-4e04-93bc-6faa339d2fc6 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:57.492032 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-d254b238-6548-4774-a81f-39beb97ea457 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:02:57.495461 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-d254b238-6548-4774-a81f-39beb97ea457 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:57.508994 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d254b238-6548-4774-a81f-39beb97ea457 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:57.509631 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d254b238-6548-4774-a81f-39beb97ea457 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:57.510611 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d254b238-6548-4774-a81f-39beb97ea457 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:57.511188 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d254b238-6548-4774-a81f-39beb97ea457 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:57.560430 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-a5ce5469-fb2b-4e04-93bc-6faa339d2fc6 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.134674 Nov 23 13:02:57.565487 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 280/607] 10.222.0.60 () {58 vars in 1301 bytes} [Tue Nov 23 13:02:57 2021] GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45/os-volume_attachments => generated 197 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 13:02:57.919165 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-6f96379f-941e-46d7-9585-6cbe2bc13bd2 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:02:57.920247 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-6f96379f-941e-46d7-9585-6cbe2bc13bd2 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:57.929856 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-6f96379f-941e-46d7-9585-6cbe2bc13bd2 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:57.930669 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-6f96379f-941e-46d7-9585-6cbe2bc13bd2 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:57.931744 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-6f96379f-941e-46d7-9585-6cbe2bc13bd2 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:57.932433 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-6f96379f-941e-46d7-9585-6cbe2bc13bd2 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:58.232169 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-6f96379f-941e-46d7-9585-6cbe2bc13bd2 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:02:58.243551 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-6f96379f-941e-46d7-9585-6cbe2bc13bd2 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1271 microversion: 2.1 time: 0.328448 Nov 23 13:02:58.244617 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 281/608] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:02:57 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1271 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 13:02:58.572850 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-d2619ce2-5cb0-42f6-8452-08a329748364 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:02:58.574685 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-d2619ce2-5cb0-42f6-8452-08a329748364 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: 53633a05-ad06-454a-b540-5fc01821ae45] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:58.583439 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d2619ce2-5cb0-42f6-8452-08a329748364 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:58.584372 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d2619ce2-5cb0-42f6-8452-08a329748364 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:58.585159 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d2619ce2-5cb0-42f6-8452-08a329748364 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:58.585931 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d2619ce2-5cb0-42f6-8452-08a329748364 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:58.661453 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-d2619ce2-5cb0-42f6-8452-08a329748364 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092954 Nov 23 13:02:58.662647 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 282/609] 10.222.0.60 () {58 vars in 1301 bytes} [Tue Nov 23 13:02:58 2021] GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 13:02:59.263502 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-103e15cd-18b4-4bcd-ba1d-18456940f0dc tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:02:59.264532 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-103e15cd-18b4-4bcd-ba1d-18456940f0dc tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:59.272653 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-103e15cd-18b4-4bcd-ba1d-18456940f0dc tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:59.274029 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-103e15cd-18b4-4bcd-ba1d-18456940f0dc tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:59.275051 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-103e15cd-18b4-4bcd-ba1d-18456940f0dc tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:59.275723 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-103e15cd-18b4-4bcd-ba1d-18456940f0dc tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:59.547745 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-103e15cd-18b4-4bcd-ba1d-18456940f0dc tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:02:59.557962 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-103e15cd-18b4-4bcd-ba1d-18456940f0dc tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1271 microversion: 2.1 time: 0.298391 Nov 23 13:02:59.559031 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 283/610] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:02:59 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1271 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 13:02:59.674940 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-c0f02308-fce1-4bbb-a69a-228588c5a9eb tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:02:59.677023 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-c0f02308-fce1-4bbb-a69a-228588c5a9eb tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: 53633a05-ad06-454a-b540-5fc01821ae45] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:02:59.686131 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c0f02308-fce1-4bbb-a69a-228588c5a9eb tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:59.686808 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c0f02308-fce1-4bbb-a69a-228588c5a9eb tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:59.687877 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c0f02308-fce1-4bbb-a69a-228588c5a9eb tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:02:59.688447 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c0f02308-fce1-4bbb-a69a-228588c5a9eb tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:02:59.769890 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-c0f02308-fce1-4bbb-a69a-228588c5a9eb tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.099388 Nov 23 13:02:59.772376 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 284/611] 10.222.0.60 () {58 vars in 1301 bytes} [Tue Nov 23 13:02:59 2021] GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45/os-volume_attachments => generated 197 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 13:03:00.575213 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-ea8f103a-67f5-4ca8-9cd6-90a874b3d0b1 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:03:00.575836 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-ea8f103a-67f5-4ca8-9cd6-90a874b3d0b1 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:03:00.584416 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ea8f103a-67f5-4ca8-9cd6-90a874b3d0b1 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:00.584977 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ea8f103a-67f5-4ca8-9cd6-90a874b3d0b1 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:00.585929 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ea8f103a-67f5-4ca8-9cd6-90a874b3d0b1 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:00.586617 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ea8f103a-67f5-4ca8-9cd6-90a874b3d0b1 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:01.098253 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-ea8f103a-67f5-4ca8-9cd6-90a874b3d0b1 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:03:01.107541 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-ea8f103a-67f5-4ca8-9cd6-90a874b3d0b1 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1271 microversion: 2.1 time: 0.536063 Nov 23 13:03:01.108863 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 285/612] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:03:00 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1271 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 13:03:01.114128 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-7327ce8c-ea62-4581-8a3b-0126c42cc683 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:03:01.115295 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-7327ce8c-ea62-4581-8a3b-0126c42cc683 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: 53633a05-ad06-454a-b540-5fc01821ae45] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:03:01.123720 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7327ce8c-ea62-4581-8a3b-0126c42cc683 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:01.124845 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7327ce8c-ea62-4581-8a3b-0126c42cc683 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:01.125850 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7327ce8c-ea62-4581-8a3b-0126c42cc683 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:01.126476 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7327ce8c-ea62-4581-8a3b-0126c42cc683 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:01.212598 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-7327ce8c-ea62-4581-8a3b-0126c42cc683 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.102278 Nov 23 13:03:01.213733 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 286/613] 10.222.0.60 () {58 vars in 1301 bytes} [Tue Nov 23 13:03:01 2021] GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 13:03:02.125612 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-c8d8a9ed-1f65-4f24-b9ff-888ab429aaac tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:03:02.126282 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-c8d8a9ed-1f65-4f24-b9ff-888ab429aaac tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:03:02.147555 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c8d8a9ed-1f65-4f24-b9ff-888ab429aaac tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:02.147915 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c8d8a9ed-1f65-4f24-b9ff-888ab429aaac tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:02.148823 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c8d8a9ed-1f65-4f24-b9ff-888ab429aaac tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:02.149512 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c8d8a9ed-1f65-4f24-b9ff-888ab429aaac tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:02.270221 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-d254b238-6548-4774-a81f-39beb97ea457 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action" status: 200 len: 28670 microversion: 2.20 time: 4.784256 Nov 23 13:03:02.271918 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 328/614] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:02:57 2021] POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action => generated 28670 bytes in 4787 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 13:03:02.282722 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [req-e76cef4a-8a54-433e-b2eb-6508bb21b62a req-c5938611-756a-4094-a0de-e28be0c4a713 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a3c40e3-d194-4953-be2a-355e3cd882d7", "tag": "9334a9ef-7661-4c37-bee0-88d739f97311"}]} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:03:02.284637 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 13:03:02.284637 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: warnings.warn(msg) Nov 23 13:03:02.299009 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [req-e76cef4a-8a54-433e-b2eb-6508bb21b62a req-c5938611-756a-4094-a0de-e28be0c4a713 service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:02.299714 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [req-e76cef4a-8a54-433e-b2eb-6508bb21b62a req-c5938611-756a-4094-a0de-e28be0c4a713 service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:02.318144 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.compute.server_external_events [req-e76cef4a-8a54-433e-b2eb-6508bb21b62a req-c5938611-756a-4094-a0de-e28be0c4a713 service nova] Creating event network-changed:9334a9ef-7661-4c37-bee0-88d739f97311 for instance 5a3c40e3-d194-4953-be2a-355e3cd882d7 on hv-cinder-81888 Nov 23 13:03:02.327486 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [req-e76cef4a-8a54-433e-b2eb-6508bb21b62a req-c5938611-756a-4094-a0de-e28be0c4a713 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052675 Nov 23 13:03:02.329042 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 329/615] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Nov 23 13:03:02 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 13:03:02.337388 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-8376fe17-5e4a-4a57-9eef-105b637c35a3 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:03:02.339022 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-8376fe17-5e4a-4a57-9eef-105b637c35a3 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: 53633a05-ad06-454a-b540-5fc01821ae45] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:03:02.349155 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8376fe17-5e4a-4a57-9eef-105b637c35a3 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:02.351532 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8376fe17-5e4a-4a57-9eef-105b637c35a3 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:02.353311 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8376fe17-5e4a-4a57-9eef-105b637c35a3 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:02.353929 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8376fe17-5e4a-4a57-9eef-105b637c35a3 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:02.456175 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-8376fe17-5e4a-4a57-9eef-105b637c35a3 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.125485 Nov 23 13:03:02.457193 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 330/616] 10.222.0.60 () {58 vars in 1301 bytes} [Tue Nov 23 13:03:02 2021] GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45/os-volume_attachments => generated 197 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 13:03:02.488888 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-c8d8a9ed-1f65-4f24-b9ff-888ab429aaac tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:03:02.499713 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-c8d8a9ed-1f65-4f24-b9ff-888ab429aaac tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1271 microversion: 2.1 time: 0.378388 Nov 23 13:03:02.510460 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 287/617] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:03:02 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1271 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 13:03:03.284072 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-955d2fea-b67f-4ed4-9c03-6c85e651f4e1 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:03:03.285722 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-955d2fea-b67f-4ed4-9c03-6c85e651f4e1 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:03:03.307784 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-955d2fea-b67f-4ed4-9c03-6c85e651f4e1 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:03.308245 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-955d2fea-b67f-4ed4-9c03-6c85e651f4e1 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:03.314400 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-955d2fea-b67f-4ed4-9c03-6c85e651f4e1 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:03.315057 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-955d2fea-b67f-4ed4-9c03-6c85e651f4e1 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:03.469047 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-c70cf56c-ef55-4754-84c5-6b0d57e72b3b tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:03:03.470822 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-c70cf56c-ef55-4754-84c5-6b0d57e72b3b tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: 53633a05-ad06-454a-b540-5fc01821ae45] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:03:03.486585 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c70cf56c-ef55-4754-84c5-6b0d57e72b3b tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:03.488173 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c70cf56c-ef55-4754-84c5-6b0d57e72b3b tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:03.489091 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c70cf56c-ef55-4754-84c5-6b0d57e72b3b tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:03.489592 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c70cf56c-ef55-4754-84c5-6b0d57e72b3b tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:03.516745 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-955d2fea-b67f-4ed4-9c03-6c85e651f4e1 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action" status: 200 len: 28670 microversion: 2.20 time: 0.237052 Nov 23 13:03:03.517382 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 331/618] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:03:03 2021] POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action => generated 28670 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:03:03.533781 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-a797b44b-d9f7-4c0a-bb5e-bf798a27acf5 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:03:03.535089 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-a797b44b-d9f7-4c0a-bb5e-bf798a27acf5 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:03:03.547412 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a797b44b-d9f7-4c0a-bb5e-bf798a27acf5 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:03.549924 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a797b44b-d9f7-4c0a-bb5e-bf798a27acf5 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:03.549924 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a797b44b-d9f7-4c0a-bb5e-bf798a27acf5 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:03.549924 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a797b44b-d9f7-4c0a-bb5e-bf798a27acf5 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:03.626363 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-c70cf56c-ef55-4754-84c5-6b0d57e72b3b tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.161955 Nov 23 13:03:03.628761 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 288/619] 10.222.0.60 () {58 vars in 1301 bytes} [Tue Nov 23 13:03:03 2021] GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45/os-volume_attachments => generated 197 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 13:03:03.832096 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-a797b44b-d9f7-4c0a-bb5e-bf798a27acf5 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:03:03.843378 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-a797b44b-d9f7-4c0a-bb5e-bf798a27acf5 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1271 microversion: 2.1 time: 0.323999 Nov 23 13:03:03.844177 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 332/620] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:03:03 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1271 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:03:04.529742 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-81ce7f35-4e64-4083-862b-fc76806c9c37 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:03:04.531752 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-81ce7f35-4e64-4083-862b-fc76806c9c37 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:03:04.541634 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-81ce7f35-4e64-4083-862b-fc76806c9c37 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:04.542510 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-81ce7f35-4e64-4083-862b-fc76806c9c37 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:04.543621 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-81ce7f35-4e64-4083-862b-fc76806c9c37 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:04.544333 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-81ce7f35-4e64-4083-862b-fc76806c9c37 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:04.641360 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-d281f6c0-0c9e-4661-9ed4-2d1e0fb7aa1d tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:03:04.642281 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-d281f6c0-0c9e-4661-9ed4-2d1e0fb7aa1d tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: 53633a05-ad06-454a-b540-5fc01821ae45] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:03:04.656372 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d281f6c0-0c9e-4661-9ed4-2d1e0fb7aa1d tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:04.657642 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d281f6c0-0c9e-4661-9ed4-2d1e0fb7aa1d tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:04.661011 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d281f6c0-0c9e-4661-9ed4-2d1e0fb7aa1d tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:04.661879 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d281f6c0-0c9e-4661-9ed4-2d1e0fb7aa1d tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:04.690505 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-81ce7f35-4e64-4083-862b-fc76806c9c37 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action" status: 200 len: 28670 microversion: 2.20 time: 0.164616 Nov 23 13:03:04.695687 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 289/621] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:03:04 2021] POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action => generated 28670 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 13:03:04.756736 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-d281f6c0-0c9e-4661-9ed4-2d1e0fb7aa1d tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.121876 Nov 23 13:03:04.757927 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 333/622] 10.222.0.60 () {58 vars in 1301 bytes} [Tue Nov 23 13:03:04 2021] GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45/os-volume_attachments => generated 197 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 13:03:04.872159 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-cd9f2a06-113d-45b8-b6f3-0eb53a2ed8e9 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:03:04.873222 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-cd9f2a06-113d-45b8-b6f3-0eb53a2ed8e9 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:03:04.893543 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-cd9f2a06-113d-45b8-b6f3-0eb53a2ed8e9 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:04.895909 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-cd9f2a06-113d-45b8-b6f3-0eb53a2ed8e9 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:04.897698 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-cd9f2a06-113d-45b8-b6f3-0eb53a2ed8e9 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:04.899207 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-cd9f2a06-113d-45b8-b6f3-0eb53a2ed8e9 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:05.008591 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-9f955afd-e2e4-4670-8e18-1a9e31579d8b tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:03:05.009349 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-9f955afd-e2e4-4670-8e18-1a9e31579d8b tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: e5f13132-d54e-43f7-8c86-91a4d23d4c35] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:03:05.026247 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-9f955afd-e2e4-4670-8e18-1a9e31579d8b tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:05.026699 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-9f955afd-e2e4-4670-8e18-1a9e31579d8b tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:05.027498 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-9f955afd-e2e4-4670-8e18-1a9e31579d8b tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:05.027933 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-9f955afd-e2e4-4670-8e18-1a9e31579d8b tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:05.208624 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-cd9f2a06-113d-45b8-b6f3-0eb53a2ed8e9 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:03:05.219257 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-cd9f2a06-113d-45b8-b6f3-0eb53a2ed8e9 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1271 microversion: 2.1 time: 0.361354 Nov 23 13:03:05.230163 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 290/623] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:03:04 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1271 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:03:05.283838 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.objects.instance [None req-9f955afd-e2e4-4670-8e18-1a9e31579d8b tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lazy-loading 'services' on Instance uuid e5f13132-d54e-43f7-8c86-91a4d23d4c35 {{(pid=100973) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 23 13:03:05.598784 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-9f955afd-e2e4-4670-8e18-1a9e31579d8b tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "DELETE /compute/v2.1/servers/e5f13132-d54e-43f7-8c86-91a4d23d4c35/os-volume_attachments/e21588b1-c572-4d7d-9ddb-1e2f598d08c4" status: 202 len: 0 microversion: 2.1 time: 0.600263 Nov 23 13:03:05.599206 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 334/624] 10.222.0.60 () {58 vars in 1415 bytes} [Tue Nov 23 13:03:04 2021] DELETE /compute/v2.1/servers/e5f13132-d54e-43f7-8c86-91a4d23d4c35/os-volume_attachments/e21588b1-c572-4d7d-9ddb-1e2f598d08c4 => generated 0 bytes in 602 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:03:05.612839 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-f1a13faa-bbde-4bc9-aba0-73888ed0408e tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:03:05.618018 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-f1a13faa-bbde-4bc9-aba0-73888ed0408e tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: e5f13132-d54e-43f7-8c86-91a4d23d4c35] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:03:05.636999 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f1a13faa-bbde-4bc9-aba0-73888ed0408e tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:05.637806 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f1a13faa-bbde-4bc9-aba0-73888ed0408e tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:05.638614 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f1a13faa-bbde-4bc9-aba0-73888ed0408e tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:05.639046 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f1a13faa-bbde-4bc9-aba0-73888ed0408e tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:05.708302 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-ce5497d5-f20b-4d6b-994f-923fca991087 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:03:05.710992 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-ce5497d5-f20b-4d6b-994f-923fca991087 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:03:05.728490 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-f1a13faa-bbde-4bc9-aba0-73888ed0408e tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/e5f13132-d54e-43f7-8c86-91a4d23d4c35/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.123960 Nov 23 13:03:05.733506 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 291/625] 10.222.0.60 () {58 vars in 1301 bytes} [Tue Nov 23 13:03:05 2021] GET /compute/v2.1/servers/e5f13132-d54e-43f7-8c86-91a4d23d4c35/os-volume_attachments => generated 197 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 13:03:05.742055 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ce5497d5-f20b-4d6b-994f-923fca991087 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:05.742838 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ce5497d5-f20b-4d6b-994f-923fca991087 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:05.743798 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ce5497d5-f20b-4d6b-994f-923fca991087 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:05.744434 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ce5497d5-f20b-4d6b-994f-923fca991087 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:05.770377 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-ba70ced6-9c98-42a6-9604-9b66b715865b tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:03:05.771779 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-ba70ced6-9c98-42a6-9604-9b66b715865b tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: 53633a05-ad06-454a-b540-5fc01821ae45] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:03:05.793759 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ba70ced6-9c98-42a6-9604-9b66b715865b tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:05.794574 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ba70ced6-9c98-42a6-9604-9b66b715865b tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:05.798430 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ba70ced6-9c98-42a6-9604-9b66b715865b tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:05.799710 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ba70ced6-9c98-42a6-9604-9b66b715865b tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:05.886151 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-ba70ced6-9c98-42a6-9604-9b66b715865b tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.120388 Nov 23 13:03:05.886727 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 292/626] 10.222.0.60 () {58 vars in 1301 bytes} [Tue Nov 23 13:03:05 2021] GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45/os-volume_attachments => generated 197 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 13:03:05.897601 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-ce5497d5-f20b-4d6b-994f-923fca991087 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action" status: 200 len: 28670 microversion: 2.20 time: 0.197086 Nov 23 13:03:05.898331 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 335/627] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:03:05 2021] POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action => generated 28670 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 13:03:06.246756 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-2bfc0faf-8bc3-46ad-bbaf-4be76cbc3172 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:03:06.248271 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-2bfc0faf-8bc3-46ad-bbaf-4be76cbc3172 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:03:06.262995 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2bfc0faf-8bc3-46ad-bbaf-4be76cbc3172 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:06.263448 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2bfc0faf-8bc3-46ad-bbaf-4be76cbc3172 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:06.264270 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2bfc0faf-8bc3-46ad-bbaf-4be76cbc3172 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:06.265078 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2bfc0faf-8bc3-46ad-bbaf-4be76cbc3172 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:06.539835 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-2bfc0faf-8bc3-46ad-bbaf-4be76cbc3172 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:03:06.550812 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-2bfc0faf-8bc3-46ad-bbaf-4be76cbc3172 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1271 microversion: 2.1 time: 0.308673 Nov 23 13:03:06.551607 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 293/628] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:03:06 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1271 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:03:06.741938 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-f9b447af-6427-44c4-b343-196ee3eb7fe0 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:03:06.743110 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-f9b447af-6427-44c4-b343-196ee3eb7fe0 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: e5f13132-d54e-43f7-8c86-91a4d23d4c35] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:03:06.752139 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f9b447af-6427-44c4-b343-196ee3eb7fe0 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:06.752612 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f9b447af-6427-44c4-b343-196ee3eb7fe0 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:06.753398 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f9b447af-6427-44c4-b343-196ee3eb7fe0 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:06.753826 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f9b447af-6427-44c4-b343-196ee3eb7fe0 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:06.823679 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-f9b447af-6427-44c4-b343-196ee3eb7fe0 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/e5f13132-d54e-43f7-8c86-91a4d23d4c35/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086084 Nov 23 13:03:06.824144 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 336/629] 10.222.0.60 () {58 vars in 1301 bytes} [Tue Nov 23 13:03:06 2021] GET /compute/v2.1/servers/e5f13132-d54e-43f7-8c86-91a4d23d4c35/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 13:03:06.898024 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-d8aabb00-577f-47cd-8553-52fafe1446ba tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:03:06.899112 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-d8aabb00-577f-47cd-8553-52fafe1446ba tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: 53633a05-ad06-454a-b540-5fc01821ae45] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:03:06.906783 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d8aabb00-577f-47cd-8553-52fafe1446ba tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:06.907253 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d8aabb00-577f-47cd-8553-52fafe1446ba tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:06.908096 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d8aabb00-577f-47cd-8553-52fafe1446ba tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:06.908502 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d8aabb00-577f-47cd-8553-52fafe1446ba tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:06.910412 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-94b79dfd-05dc-450f-8680-4d02444ecaac tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:03:06.911322 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-94b79dfd-05dc-450f-8680-4d02444ecaac tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:03:06.919560 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-94b79dfd-05dc-450f-8680-4d02444ecaac tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:06.920021 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-94b79dfd-05dc-450f-8680-4d02444ecaac tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:06.920855 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-94b79dfd-05dc-450f-8680-4d02444ecaac tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:06.921284 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-94b79dfd-05dc-450f-8680-4d02444ecaac tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:06.974927 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-d8aabb00-577f-47cd-8553-52fafe1446ba tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.080753 Nov 23 13:03:06.975705 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 294/630] 10.222.0.60 () {58 vars in 1301 bytes} [Tue Nov 23 13:03:06 2021] GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45/os-volume_attachments => generated 25 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 13:03:07.053668 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-94b79dfd-05dc-450f-8680-4d02444ecaac tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action" status: 200 len: 28670 microversion: 2.20 time: 0.147194 Nov 23 13:03:07.054828 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 337/631] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:03:06 2021] POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action => generated 28670 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:03:07.571944 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-5a8cc6f5-aefb-4a38-a934-b7f1b934339f tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:03:07.572621 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-5a8cc6f5-aefb-4a38-a934-b7f1b934339f tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:03:07.580253 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5a8cc6f5-aefb-4a38-a934-b7f1b934339f tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:07.580737 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5a8cc6f5-aefb-4a38-a934-b7f1b934339f tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:07.581507 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5a8cc6f5-aefb-4a38-a934-b7f1b934339f tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:07.581936 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5a8cc6f5-aefb-4a38-a934-b7f1b934339f tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:07.794317 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-5a8cc6f5-aefb-4a38-a934-b7f1b934339f tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:03:07.805023 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-5a8cc6f5-aefb-4a38-a934-b7f1b934339f tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1271 microversion: 2.1 time: 0.237714 Nov 23 13:03:07.806041 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 295/632] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:03:07 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1271 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:03:07.835784 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-4adf4c92-ef56-4ef0-a5ee-4c0e3bc62463 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:03:07.836911 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-4adf4c92-ef56-4ef0-a5ee-4c0e3bc62463 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: e5f13132-d54e-43f7-8c86-91a4d23d4c35] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:03:07.845251 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4adf4c92-ef56-4ef0-a5ee-4c0e3bc62463 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:07.845704 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4adf4c92-ef56-4ef0-a5ee-4c0e3bc62463 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:07.846678 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4adf4c92-ef56-4ef0-a5ee-4c0e3bc62463 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:07.847115 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4adf4c92-ef56-4ef0-a5ee-4c0e3bc62463 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:07.914561 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-4adf4c92-ef56-4ef0-a5ee-4c0e3bc62463 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/e5f13132-d54e-43f7-8c86-91a4d23d4c35/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082890 Nov 23 13:03:07.915308 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 338/633] 10.222.0.60 () {58 vars in 1301 bytes} [Tue Nov 23 13:03:07 2021] GET /compute/v2.1/servers/e5f13132-d54e-43f7-8c86-91a4d23d4c35/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 13:03:08.070726 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-c142b1c7-a9da-4b13-975c-0a2a6412cc2e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:03:08.071888 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-c142b1c7-a9da-4b13-975c-0a2a6412cc2e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:03:08.088377 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c142b1c7-a9da-4b13-975c-0a2a6412cc2e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:08.088820 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c142b1c7-a9da-4b13-975c-0a2a6412cc2e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:08.089631 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c142b1c7-a9da-4b13-975c-0a2a6412cc2e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:08.090059 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c142b1c7-a9da-4b13-975c-0a2a6412cc2e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:08.279851 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-c142b1c7-a9da-4b13-975c-0a2a6412cc2e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action" status: 200 len: 28670 microversion: 2.20 time: 0.212692 Nov 23 13:03:08.282570 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 296/634] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:03:08 2021] POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action => generated 28670 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:03:08.824049 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-986af148-615f-4e15-aebf-b9383de5d55d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:03:08.824835 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-986af148-615f-4e15-aebf-b9383de5d55d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:03:08.832353 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-986af148-615f-4e15-aebf-b9383de5d55d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:08.833262 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-986af148-615f-4e15-aebf-b9383de5d55d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:08.835209 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-986af148-615f-4e15-aebf-b9383de5d55d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:08.835747 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-986af148-615f-4e15-aebf-b9383de5d55d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:08.928540 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-f837646c-0962-4864-8a51-dacbd4515a37 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:03:08.930227 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-f837646c-0962-4864-8a51-dacbd4515a37 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: e5f13132-d54e-43f7-8c86-91a4d23d4c35] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:03:08.939270 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f837646c-0962-4864-8a51-dacbd4515a37 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:08.939700 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f837646c-0962-4864-8a51-dacbd4515a37 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:08.940521 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f837646c-0962-4864-8a51-dacbd4515a37 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:08.940942 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f837646c-0962-4864-8a51-dacbd4515a37 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:09.015193 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-f837646c-0962-4864-8a51-dacbd4515a37 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/e5f13132-d54e-43f7-8c86-91a4d23d4c35/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091840 Nov 23 13:03:09.015974 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 297/635] 10.222.0.60 () {58 vars in 1301 bytes} [Tue Nov 23 13:03:08 2021] GET /compute/v2.1/servers/e5f13132-d54e-43f7-8c86-91a4d23d4c35/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 13:03:09.067261 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-986af148-615f-4e15-aebf-b9383de5d55d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:03:09.076844 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-986af148-615f-4e15-aebf-b9383de5d55d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1259 microversion: 2.1 time: 0.256881 Nov 23 13:03:09.077471 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 339/636] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:03:08 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1259 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:03:09.292747 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-ddecfb98-649a-49bb-8374-9f602cbaf6ca tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:03:09.293790 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-ddecfb98-649a-49bb-8374-9f602cbaf6ca tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:03:09.301551 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ddecfb98-649a-49bb-8374-9f602cbaf6ca tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:09.301990 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ddecfb98-649a-49bb-8374-9f602cbaf6ca tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:09.302761 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ddecfb98-649a-49bb-8374-9f602cbaf6ca tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:09.303183 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ddecfb98-649a-49bb-8374-9f602cbaf6ca tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:09.482051 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-ddecfb98-649a-49bb-8374-9f602cbaf6ca tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action" status: 200 len: 28670 microversion: 2.20 time: 0.193783 Nov 23 13:03:09.483133 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 298/637] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:03:09 2021] POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action => generated 28670 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:03:09.637716 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-a3ffc434-e0e0-474e-98a2-a8dbb5a2e67a tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:03:09.638530 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-a3ffc434-e0e0-474e-98a2-a8dbb5a2e67a tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: bc54276f-764d-49ee-b58e-552822acc211] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:03:09.647458 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a3ffc434-e0e0-474e-98a2-a8dbb5a2e67a tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:09.648474 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a3ffc434-e0e0-474e-98a2-a8dbb5a2e67a tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:09.649331 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a3ffc434-e0e0-474e-98a2-a8dbb5a2e67a tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:09.649842 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a3ffc434-e0e0-474e-98a2-a8dbb5a2e67a tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:09.715452 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-a3ffc434-e0e0-474e-98a2-a8dbb5a2e67a tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: bc54276f-764d-49ee-b58e-552822acc211] Going to try to terminate instance {{(pid=100973) delete /opt/stack/nova/nova/compute/api.py:2562}} Nov 23 13:03:09.988075 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-a3ffc434-e0e0-474e-98a2-a8dbb5a2e67a tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "DELETE /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211" status: 204 len: 0 microversion: 2.1 time: 0.353896 Nov 23 13:03:09.989127 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 340/638] 10.222.0.60 () {58 vars in 1238 bytes} [Tue Nov 23 13:03:09 2021] DELETE /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 23 13:03:10.002173 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-ad774af4-516d-44d2-a700-c599c66b52a5 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:03:10.004495 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-ad774af4-516d-44d2-a700-c599c66b52a5 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: bc54276f-764d-49ee-b58e-552822acc211] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:03:10.033035 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-bf47f015-d717-4f42-aa6f-d86148a273ed tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:03:10.034532 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-bf47f015-d717-4f42-aa6f-d86148a273ed tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: e5f13132-d54e-43f7-8c86-91a4d23d4c35] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:03:10.043938 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ad774af4-516d-44d2-a700-c599c66b52a5 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:10.044616 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ad774af4-516d-44d2-a700-c599c66b52a5 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:10.045672 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ad774af4-516d-44d2-a700-c599c66b52a5 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:10.046107 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ad774af4-516d-44d2-a700-c599c66b52a5 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:10.057344 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-bf47f015-d717-4f42-aa6f-d86148a273ed tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:10.058504 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-bf47f015-d717-4f42-aa6f-d86148a273ed tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:10.068515 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-bf47f015-d717-4f42-aa6f-d86148a273ed tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:10.069698 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-bf47f015-d717-4f42-aa6f-d86148a273ed tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:10.186141 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-bf47f015-d717-4f42-aa6f-d86148a273ed tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/e5f13132-d54e-43f7-8c86-91a4d23d4c35/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.158332 Nov 23 13:03:10.194910 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 341/639] 10.222.0.60 () {58 vars in 1301 bytes} [Tue Nov 23 13:03:10 2021] GET /compute/v2.1/servers/e5f13132-d54e-43f7-8c86-91a4d23d4c35/os-volume_attachments => generated 25 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 13:03:10.198288 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-3b3feafe-8fe7-4e2c-8ea7-3daa6b5b9974 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:03:10.199303 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-3b3feafe-8fe7-4e2c-8ea7-3daa6b5b9974 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:03:10.210582 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-3b3feafe-8fe7-4e2c-8ea7-3daa6b5b9974 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:10.211303 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-3b3feafe-8fe7-4e2c-8ea7-3daa6b5b9974 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:10.212328 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-3b3feafe-8fe7-4e2c-8ea7-3daa6b5b9974 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:10.212802 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-3b3feafe-8fe7-4e2c-8ea7-3daa6b5b9974 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:10.496498 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-ad774af4-516d-44d2-a700-c599c66b52a5 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:03:10.510873 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-ad774af4-516d-44d2-a700-c599c66b52a5 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211" status: 200 len: 1505 microversion: 2.1 time: 0.516539 Nov 23 13:03:10.515125 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 299/640] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:03:09 2021] GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211 => generated 1505 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 13:03:10.526321 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-0ffb0352-4543-493c-83da-744149d7b85e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:03:10.527353 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-0ffb0352-4543-493c-83da-744149d7b85e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:03:10.543754 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0ffb0352-4543-493c-83da-744149d7b85e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:10.544213 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0ffb0352-4543-493c-83da-744149d7b85e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:10.545036 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0ffb0352-4543-493c-83da-744149d7b85e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:10.545468 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0ffb0352-4543-493c-83da-744149d7b85e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:10.571609 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-3b3feafe-8fe7-4e2c-8ea7-3daa6b5b9974 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:03:10.581324 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-3b3feafe-8fe7-4e2c-8ea7-3daa6b5b9974 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1259 microversion: 2.1 time: 0.392421 Nov 23 13:03:10.582116 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 342/641] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:03:10 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1259 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:03:10.740094 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-0ffb0352-4543-493c-83da-744149d7b85e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action" status: 200 len: 28670 microversion: 2.20 time: 0.222715 Nov 23 13:03:10.741059 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 300/642] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:03:10 2021] POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action => generated 28670 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:03:11.533199 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-7b6b42f6-f1d9-4739-ab39-7a5583faf80f tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:03:11.535056 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-7b6b42f6-f1d9-4739-ab39-7a5583faf80f tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: bc54276f-764d-49ee-b58e-552822acc211] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:03:11.546534 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-7b6b42f6-f1d9-4739-ab39-7a5583faf80f tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:11.547252 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-7b6b42f6-f1d9-4739-ab39-7a5583faf80f tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:11.548203 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-7b6b42f6-f1d9-4739-ab39-7a5583faf80f tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:11.548669 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-7b6b42f6-f1d9-4739-ab39-7a5583faf80f tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:11.623384 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-abb515d5-2c90-465d-a199-d1404e0b3e0d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:03:11.637400 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-abb515d5-2c90-465d-a199-d1404e0b3e0d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:03:11.642342 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-abb515d5-2c90-465d-a199-d1404e0b3e0d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:11.643110 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-abb515d5-2c90-465d-a199-d1404e0b3e0d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:11.644225 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-abb515d5-2c90-465d-a199-d1404e0b3e0d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:11.644928 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-abb515d5-2c90-465d-a199-d1404e0b3e0d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:12.002363 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-abb515d5-2c90-465d-a199-d1404e0b3e0d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:03:12.012837 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-abb515d5-2c90-465d-a199-d1404e0b3e0d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1259 microversion: 2.1 time: 0.394871 Nov 23 13:03:12.013417 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 301/643] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:03:11 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1259 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:03:12.020743 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-ecf9dcf4-6417-4573-a50a-721cf36c7139 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:03:12.022007 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-ecf9dcf4-6417-4573-a50a-721cf36c7139 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:03:12.033436 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-7b6b42f6-f1d9-4739-ab39-7a5583faf80f tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:03:12.039760 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ecf9dcf4-6417-4573-a50a-721cf36c7139 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:12.040815 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ecf9dcf4-6417-4573-a50a-721cf36c7139 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:12.042544 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ecf9dcf4-6417-4573-a50a-721cf36c7139 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:12.043457 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ecf9dcf4-6417-4573-a50a-721cf36c7139 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:12.044750 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-7b6b42f6-f1d9-4739-ab39-7a5583faf80f tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211" status: 200 len: 1505 microversion: 2.1 time: 0.519691 Nov 23 13:03:12.045944 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 343/644] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:03:11 2021] GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211 => generated 1505 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:03:12.051046 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-58b2c684-d382-48ba-b287-cf387f3f1bec tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:03:12.051662 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-58b2c684-d382-48ba-b287-cf387f3f1bec tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: e5f13132-d54e-43f7-8c86-91a4d23d4c35] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:03:12.059589 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-58b2c684-d382-48ba-b287-cf387f3f1bec tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:12.060420 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-58b2c684-d382-48ba-b287-cf387f3f1bec tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:12.061184 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-58b2c684-d382-48ba-b287-cf387f3f1bec tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:12.061733 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-58b2c684-d382-48ba-b287-cf387f3f1bec tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:12.139152 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-58b2c684-d382-48ba-b287-cf387f3f1bec tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: e5f13132-d54e-43f7-8c86-91a4d23d4c35] Going to try to terminate instance {{(pid=100973) delete /opt/stack/nova/nova/compute/api.py:2562}} Nov 23 13:03:12.277669 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-ecf9dcf4-6417-4573-a50a-721cf36c7139 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action" status: 200 len: 29775 microversion: 2.20 time: 0.262596 Nov 23 13:03:12.279619 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 302/645] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:03:12 2021] POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action => generated 29775 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:03:12.323387 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-58b2c684-d382-48ba-b287-cf387f3f1bec tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "DELETE /compute/v2.1/servers/e5f13132-d54e-43f7-8c86-91a4d23d4c35" status: 204 len: 0 microversion: 2.1 time: 0.275558 Nov 23 13:03:12.333290 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-ffa17704-89c3-4cc4-a153-00c1d2e238d5 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:03:12.334149 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-ffa17704-89c3-4cc4-a153-00c1d2e238d5 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: e5f13132-d54e-43f7-8c86-91a4d23d4c35] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:03:12.337486 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 344/646] 10.222.0.60 () {58 vars in 1238 bytes} [Tue Nov 23 13:03:12 2021] DELETE /compute/v2.1/servers/e5f13132-d54e-43f7-8c86-91a4d23d4c35 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 23 13:03:12.342873 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ffa17704-89c3-4cc4-a153-00c1d2e238d5 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:12.343437 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ffa17704-89c3-4cc4-a153-00c1d2e238d5 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:12.344382 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ffa17704-89c3-4cc4-a153-00c1d2e238d5 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:12.344890 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ffa17704-89c3-4cc4-a153-00c1d2e238d5 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:12.590593 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-ffa17704-89c3-4cc4-a153-00c1d2e238d5 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c023f89fd3da4bc8b38963bed4e5cc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a31364455dc442f8df299a8ad758a4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:03:12.600506 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-ffa17704-89c3-4cc4-a153-00c1d2e238d5 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/e5f13132-d54e-43f7-8c86-91a4d23d4c35" status: 200 len: 1515 microversion: 2.1 time: 0.271697 Nov 23 13:03:12.601682 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 303/647] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:03:12 2021] GET /compute/v2.1/servers/e5f13132-d54e-43f7-8c86-91a4d23d4c35 => generated 1515 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:03:13.030168 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-30aa8fad-4e54-48ba-8080-ae8883a27460 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:03:13.030914 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-30aa8fad-4e54-48ba-8080-ae8883a27460 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:03:13.038554 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-30aa8fad-4e54-48ba-8080-ae8883a27460 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:13.039045 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-30aa8fad-4e54-48ba-8080-ae8883a27460 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:13.040503 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-30aa8fad-4e54-48ba-8080-ae8883a27460 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:13.040986 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-30aa8fad-4e54-48ba-8080-ae8883a27460 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:13.062781 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-edb8509f-722c-46a4-b235-5d0c7b017bee tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:03:13.065636 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-edb8509f-722c-46a4-b235-5d0c7b017bee tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: bc54276f-764d-49ee-b58e-552822acc211] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:03:13.078348 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-edb8509f-722c-46a4-b235-5d0c7b017bee tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:13.079120 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-edb8509f-722c-46a4-b235-5d0c7b017bee tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:13.080663 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-edb8509f-722c-46a4-b235-5d0c7b017bee tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:13.081427 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-edb8509f-722c-46a4-b235-5d0c7b017bee tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:13.288346 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-edb8509f-722c-46a4-b235-5d0c7b017bee tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:03:13.297625 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-edb8509f-722c-46a4-b235-5d0c7b017bee tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211" status: 200 len: 1505 microversion: 2.1 time: 0.238970 Nov 23 13:03:13.298631 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 304/648] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:03:13 2021] GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211 => generated 1505 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:03:13.303155 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-fa43b2b0-aad7-4b41-91e1-db0e137128d7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:03:13.304117 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-fa43b2b0-aad7-4b41-91e1-db0e137128d7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:03:13.311493 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-fa43b2b0-aad7-4b41-91e1-db0e137128d7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:13.312176 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-fa43b2b0-aad7-4b41-91e1-db0e137128d7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:13.312977 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-fa43b2b0-aad7-4b41-91e1-db0e137128d7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:13.313661 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-fa43b2b0-aad7-4b41-91e1-db0e137128d7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:13.402849 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-30aa8fad-4e54-48ba-8080-ae8883a27460 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:03:13.411360 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-30aa8fad-4e54-48ba-8080-ae8883a27460 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1259 microversion: 2.1 time: 0.385559 Nov 23 13:03:13.412021 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 345/649] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:03:13 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1259 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:03:13.620738 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-ca07d2d1-280b-4409-ac77-f0092bd4b736 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:03:13.621525 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-ca07d2d1-280b-4409-ac77-f0092bd4b736 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: e5f13132-d54e-43f7-8c86-91a4d23d4c35] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:03:13.633819 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ca07d2d1-280b-4409-ac77-f0092bd4b736 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:13.634270 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ca07d2d1-280b-4409-ac77-f0092bd4b736 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:13.635087 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ca07d2d1-280b-4409-ac77-f0092bd4b736 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:13.635538 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ca07d2d1-280b-4409-ac77-f0092bd4b736 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:13.864365 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-fa43b2b0-aad7-4b41-91e1-db0e137128d7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action" status: 200 len: 31034 microversion: 2.20 time: 0.564195 Nov 23 13:03:13.865705 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 305/650] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:03:13 2021] POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action => generated 31034 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:03:14.186889 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-ca07d2d1-280b-4409-ac77-f0092bd4b736 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c023f89fd3da4bc8b38963bed4e5cc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a31364455dc442f8df299a8ad758a4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:03:14.200634 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-ca07d2d1-280b-4409-ac77-f0092bd4b736 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/e5f13132-d54e-43f7-8c86-91a4d23d4c35" status: 200 len: 1515 microversion: 2.1 time: 0.584936 Nov 23 13:03:14.201769 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 346/651] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:03:13 2021] GET /compute/v2.1/servers/e5f13132-d54e-43f7-8c86-91a4d23d4c35 => generated 1515 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:03:14.315576 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-d44dba99-4016-4f0d-aee3-0018ca8f57e7 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:03:14.316390 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-d44dba99-4016-4f0d-aee3-0018ca8f57e7 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: bc54276f-764d-49ee-b58e-552822acc211] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:03:14.334145 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d44dba99-4016-4f0d-aee3-0018ca8f57e7 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:14.334873 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d44dba99-4016-4f0d-aee3-0018ca8f57e7 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:14.336124 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d44dba99-4016-4f0d-aee3-0018ca8f57e7 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:14.336913 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d44dba99-4016-4f0d-aee3-0018ca8f57e7 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:14.429964 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-1668027e-54b3-4775-bcfa-cd0b0371daab tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:03:14.431376 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-1668027e-54b3-4775-bcfa-cd0b0371daab tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:03:14.440395 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-1668027e-54b3-4775-bcfa-cd0b0371daab tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:14.441144 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-1668027e-54b3-4775-bcfa-cd0b0371daab tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:14.442119 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-1668027e-54b3-4775-bcfa-cd0b0371daab tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:14.442745 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-1668027e-54b3-4775-bcfa-cd0b0371daab tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:14.891120 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-1668027e-54b3-4775-bcfa-cd0b0371daab tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:03:14.901172 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-1668027e-54b3-4775-bcfa-cd0b0371daab tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1259 microversion: 2.1 time: 0.475393 Nov 23 13:03:14.906601 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 347/652] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:03:14 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1259 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:03:14.922719 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-d8640847-4596-4e3e-be53-bbbe923284af tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:03:14.925935 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-d8640847-4596-4e3e-be53-bbbe923284af tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:03:14.941845 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d8640847-4596-4e3e-be53-bbbe923284af tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:14.943398 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d8640847-4596-4e3e-be53-bbbe923284af tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:14.944411 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d8640847-4596-4e3e-be53-bbbe923284af tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:14.945017 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d8640847-4596-4e3e-be53-bbbe923284af tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:14.990689 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-d44dba99-4016-4f0d-aee3-0018ca8f57e7 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:03:15.001674 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-d44dba99-4016-4f0d-aee3-0018ca8f57e7 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211" status: 200 len: 1505 microversion: 2.1 time: 0.690270 Nov 23 13:03:15.011939 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 306/653] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:03:14 2021] GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211 => generated 1505 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:03:15.163589 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-d8640847-4596-4e3e-be53-bbbe923284af tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action" status: 200 len: 32700 microversion: 2.20 time: 0.255065 Nov 23 13:03:15.164308 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 348/654] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:03:14 2021] POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action => generated 32700 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:03:15.218237 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-f04caa27-d77f-4084-a89d-2c5192cadbcd tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:03:15.218859 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-f04caa27-d77f-4084-a89d-2c5192cadbcd tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: e5f13132-d54e-43f7-8c86-91a4d23d4c35] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:03:15.235927 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f04caa27-d77f-4084-a89d-2c5192cadbcd tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:15.236815 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f04caa27-d77f-4084-a89d-2c5192cadbcd tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:15.238143 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f04caa27-d77f-4084-a89d-2c5192cadbcd tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:15.238768 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f04caa27-d77f-4084-a89d-2c5192cadbcd tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:15.442191 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [req-e7270990-58f7-428c-bedc-651232c34f5c req-10f0d049-63c0-4f7d-9275-9d1a7ae358d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc54276f-764d-49ee-b58e-552822acc211", "name": "network-vif-deleted", "tag": "4f32dbce-9338-45e3-a6af-9412f33ad987"}]} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:03:15.444009 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 13:03:15.444009 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: warnings.warn(msg) Nov 23 13:03:15.461783 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [req-e7270990-58f7-428c-bedc-651232c34f5c req-10f0d049-63c0-4f7d-9275-9d1a7ae358d6 service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:15.462473 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [req-e7270990-58f7-428c-bedc-651232c34f5c req-10f0d049-63c0-4f7d-9275-9d1a7ae358d6 service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:15.488159 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.compute.server_external_events [req-e7270990-58f7-428c-bedc-651232c34f5c req-10f0d049-63c0-4f7d-9275-9d1a7ae358d6 service nova] Creating event network-vif-deleted:4f32dbce-9338-45e3-a6af-9412f33ad987 for instance bc54276f-764d-49ee-b58e-552822acc211 on hv-cinder-81888 Nov 23 13:03:15.494968 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [req-e7270990-58f7-428c-bedc-651232c34f5c req-10f0d049-63c0-4f7d-9275-9d1a7ae358d6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056823 Nov 23 13:03:15.496617 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 349/655] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Nov 23 13:03:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 13:03:15.667588 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-f04caa27-d77f-4084-a89d-2c5192cadbcd tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c023f89fd3da4bc8b38963bed4e5cc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a31364455dc442f8df299a8ad758a4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:03:15.680163 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-f04caa27-d77f-4084-a89d-2c5192cadbcd tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/e5f13132-d54e-43f7-8c86-91a4d23d4c35" status: 200 len: 1515 microversion: 2.1 time: 0.465164 Nov 23 13:03:15.696708 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 307/656] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:03:15 2021] GET /compute/v2.1/servers/e5f13132-d54e-43f7-8c86-91a4d23d4c35 => generated 1515 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:03:15.925366 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-b15b8e2a-44de-4ced-9a29-ff034dd92039 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:03:15.926659 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-b15b8e2a-44de-4ced-9a29-ff034dd92039 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:03:15.937655 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b15b8e2a-44de-4ced-9a29-ff034dd92039 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:15.938109 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b15b8e2a-44de-4ced-9a29-ff034dd92039 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:15.939000 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b15b8e2a-44de-4ced-9a29-ff034dd92039 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:15.939436 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b15b8e2a-44de-4ced-9a29-ff034dd92039 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:16.019172 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-b3089942-93e6-45d2-a823-ed848cecb377 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:03:16.020206 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-b3089942-93e6-45d2-a823-ed848cecb377 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: bc54276f-764d-49ee-b58e-552822acc211] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:03:16.033011 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b3089942-93e6-45d2-a823-ed848cecb377 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:16.033807 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b3089942-93e6-45d2-a823-ed848cecb377 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:16.035926 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b3089942-93e6-45d2-a823-ed848cecb377 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:16.038957 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b3089942-93e6-45d2-a823-ed848cecb377 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:16.210967 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b3089942-93e6-45d2-a823-ed848cecb377 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:16.211427 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b3089942-93e6-45d2-a823-ed848cecb377 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:16.212407 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.objects.instance [None req-b3089942-93e6-45d2-a823-ed848cecb377 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lazy-loading 'fault' on Instance uuid bc54276f-764d-49ee-b58e-552822acc211 {{(pid=100974) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 23 13:03:16.412612 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-b3089942-93e6-45d2-a823-ed848cecb377 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:03:16.426152 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-b3089942-93e6-45d2-a823-ed848cecb377 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211" status: 200 len: 1311 microversion: 2.1 time: 0.410536 Nov 23 13:03:16.438916 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 308/657] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:03:16 2021] GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211 => generated 1311 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 13:03:16.450223 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-94fd8604-abe7-4f3d-8feb-d82c27bbe4d4 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:03:16.453412 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-94fd8604-abe7-4f3d-8feb-d82c27bbe4d4 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:03:16.465754 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-94fd8604-abe7-4f3d-8feb-d82c27bbe4d4 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:16.466560 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-94fd8604-abe7-4f3d-8feb-d82c27bbe4d4 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:16.467581 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-94fd8604-abe7-4f3d-8feb-d82c27bbe4d4 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:16.468273 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-94fd8604-abe7-4f3d-8feb-d82c27bbe4d4 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:16.481358 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-b15b8e2a-44de-4ced-9a29-ff034dd92039 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:03:16.493889 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-b15b8e2a-44de-4ced-9a29-ff034dd92039 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1259 microversion: 2.1 time: 0.571082 Nov 23 13:03:16.495052 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 350/658] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:03:15 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1259 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:03:16.701030 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-94fd8604-abe7-4f3d-8feb-d82c27bbe4d4 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action" status: 200 len: 33609 microversion: 2.20 time: 0.259392 Nov 23 13:03:16.707177 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 309/659] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:03:16 2021] POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action => generated 33609 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:03:16.712682 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-bb57c0fd-8f1f-46d5-81ad-9e8d6219475c tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:03:16.714983 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-bb57c0fd-8f1f-46d5-81ad-9e8d6219475c tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: e5f13132-d54e-43f7-8c86-91a4d23d4c35] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:03:16.730726 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-bb57c0fd-8f1f-46d5-81ad-9e8d6219475c tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:16.731352 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-bb57c0fd-8f1f-46d5-81ad-9e8d6219475c tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:16.732620 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-bb57c0fd-8f1f-46d5-81ad-9e8d6219475c tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:16.733274 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-bb57c0fd-8f1f-46d5-81ad-9e8d6219475c tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:16.959144 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-bb57c0fd-8f1f-46d5-81ad-9e8d6219475c tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c023f89fd3da4bc8b38963bed4e5cc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a31364455dc442f8df299a8ad758a4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:03:16.973312 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-bb57c0fd-8f1f-46d5-81ad-9e8d6219475c tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/e5f13132-d54e-43f7-8c86-91a4d23d4c35" status: 200 len: 1303 microversion: 2.1 time: 0.277928 Nov 23 13:03:16.975451 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 351/660] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:03:16 2021] GET /compute/v2.1/servers/e5f13132-d54e-43f7-8c86-91a4d23d4c35 => generated 1303 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:03:17.447939 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-d18a32f6-d754-48b7-bcf5-8a4535129d55 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:03:17.449098 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-d18a32f6-d754-48b7-bcf5-8a4535129d55 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: bc54276f-764d-49ee-b58e-552822acc211] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:03:17.459637 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d18a32f6-d754-48b7-bcf5-8a4535129d55 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:17.460402 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d18a32f6-d754-48b7-bcf5-8a4535129d55 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:17.461364 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d18a32f6-d754-48b7-bcf5-8a4535129d55 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:17.462411 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d18a32f6-d754-48b7-bcf5-8a4535129d55 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:17.511177 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-7c6f8ff7-9ba7-410e-98ec-8c7b531e5088 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:03:17.511786 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-7c6f8ff7-9ba7-410e-98ec-8c7b531e5088 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:03:17.527651 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-7c6f8ff7-9ba7-410e-98ec-8c7b531e5088 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:17.528152 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-7c6f8ff7-9ba7-410e-98ec-8c7b531e5088 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:17.529007 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-7c6f8ff7-9ba7-410e-98ec-8c7b531e5088 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:17.529450 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-7c6f8ff7-9ba7-410e-98ec-8c7b531e5088 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:17.551883 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.wsgi [None req-d18a32f6-d754-48b7-bcf5-8a4535129d55 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] HTTP exception thrown: Instance bc54276f-764d-49ee-b58e-552822acc211 could not be found. Nov 23 13:03:17.552532 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-d18a32f6-d754-48b7-bcf5-8a4535129d55 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Returning 404 to user: Instance bc54276f-764d-49ee-b58e-552822acc211 could not be found. {{(pid=100974) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Nov 23 13:03:17.553384 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-d18a32f6-d754-48b7-bcf5-8a4535129d55 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211" status: 404 len: 111 microversion: 2.1 time: 0.110841 Nov 23 13:03:17.559994 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 310/661] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:03:17 2021] GET /compute/v2.1/servers/bc54276f-764d-49ee-b58e-552822acc211 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 23 13:03:17.570996 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [req-e8e87c64-372a-4939-bd2b-8d778b9b9ebb req-42f7d001-626f-477e-a87e-13d2de981e68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5f13132-d54e-43f7-8c86-91a4d23d4c35", "name": "network-vif-deleted", "tag": "ebaa3fb8-fb70-4118-8e64-8d0d70bec47c"}]} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:03:17.578005 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 13:03:17.578005 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: warnings.warn(msg) Nov 23 13:03:17.590758 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [req-e8e87c64-372a-4939-bd2b-8d778b9b9ebb req-42f7d001-626f-477e-a87e-13d2de981e68 service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:17.591532 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [req-e8e87c64-372a-4939-bd2b-8d778b9b9ebb req-42f7d001-626f-477e-a87e-13d2de981e68 service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:17.616599 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.compute.server_external_events [req-e8e87c64-372a-4939-bd2b-8d778b9b9ebb req-42f7d001-626f-477e-a87e-13d2de981e68 service nova] Creating event network-vif-deleted:ebaa3fb8-fb70-4118-8e64-8d0d70bec47c for instance e5f13132-d54e-43f7-8c86-91a4d23d4c35 on hv-cinder-81888 Nov 23 13:03:17.622996 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [req-e8e87c64-372a-4939-bd2b-8d778b9b9ebb req-42f7d001-626f-477e-a87e-13d2de981e68 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060285 Nov 23 13:03:17.624616 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 311/662] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Nov 23 13:03:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 13:03:17.632202 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-9f8c9aec-8f30-41cf-81ca-f84431c48fa5 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:03:17.633148 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-9f8c9aec-8f30-41cf-81ca-f84431c48fa5 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: 53633a05-ad06-454a-b540-5fc01821ae45] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:03:17.641635 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-9f8c9aec-8f30-41cf-81ca-f84431c48fa5 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:17.642353 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-9f8c9aec-8f30-41cf-81ca-f84431c48fa5 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:17.643361 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-9f8c9aec-8f30-41cf-81ca-f84431c48fa5 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:17.643956 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-9f8c9aec-8f30-41cf-81ca-f84431c48fa5 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:17.725714 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-9f8c9aec-8f30-41cf-81ca-f84431c48fa5 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: 53633a05-ad06-454a-b540-5fc01821ae45] Going to try to terminate instance {{(pid=100974) delete /opt/stack/nova/nova/compute/api.py:2562}} Nov 23 13:03:17.901702 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-9f8c9aec-8f30-41cf-81ca-f84431c48fa5 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "DELETE /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45" status: 204 len: 0 microversion: 2.1 time: 0.275319 Nov 23 13:03:17.902634 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 312/663] 10.222.0.60 () {58 vars in 1238 bytes} [Tue Nov 23 13:03:17 2021] DELETE /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 23 13:03:17.911007 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-edff2b56-bf55-42a4-bb41-ad0958d54a10 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:03:17.912009 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-edff2b56-bf55-42a4-bb41-ad0958d54a10 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:03:17.920492 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-edff2b56-bf55-42a4-bb41-ad0958d54a10 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:17.921168 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-edff2b56-bf55-42a4-bb41-ad0958d54a10 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:17.922089 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-edff2b56-bf55-42a4-bb41-ad0958d54a10 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:17.922684 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-edff2b56-bf55-42a4-bb41-ad0958d54a10 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:18.077483 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-7c6f8ff7-9ba7-410e-98ec-8c7b531e5088 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:03:18.082298 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-edff2b56-bf55-42a4-bb41-ad0958d54a10 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action" status: 200 len: 34852 microversion: 2.20 time: 0.175042 Nov 23 13:03:18.083164 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 313/664] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:03:17 2021] POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action => generated 34852 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:03:18.086816 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-7c6f8ff7-9ba7-410e-98ec-8c7b531e5088 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1259 microversion: 2.1 time: 0.579338 Nov 23 13:03:18.089016 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-31dcde28-afb4-4fcb-adfe-6666d58386a0 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:03:18.094709 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-31dcde28-afb4-4fcb-adfe-6666d58386a0 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: 53633a05-ad06-454a-b540-5fc01821ae45] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:03:18.100010 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 352/665] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:03:17 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1259 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:03:18.104935 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-a8756eb4-355e-4b9b-9cbe-b4e243ebac9b tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:03:18.105553 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-a8756eb4-355e-4b9b-9cbe-b4e243ebac9b tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: e5f13132-d54e-43f7-8c86-91a4d23d4c35] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:03:18.115175 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-31dcde28-afb4-4fcb-adfe-6666d58386a0 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:18.118771 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-31dcde28-afb4-4fcb-adfe-6666d58386a0 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:18.119194 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a8756eb4-355e-4b9b-9cbe-b4e243ebac9b tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:18.119663 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a8756eb4-355e-4b9b-9cbe-b4e243ebac9b tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:18.120031 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-31dcde28-afb4-4fcb-adfe-6666d58386a0 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:18.120496 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a8756eb4-355e-4b9b-9cbe-b4e243ebac9b tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:18.120933 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a8756eb4-355e-4b9b-9cbe-b4e243ebac9b tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:18.122673 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-31dcde28-afb4-4fcb-adfe-6666d58386a0 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:18.249530 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.wsgi [None req-a8756eb4-355e-4b9b-9cbe-b4e243ebac9b tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] HTTP exception thrown: Instance e5f13132-d54e-43f7-8c86-91a4d23d4c35 could not be found. Nov 23 13:03:18.264629 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-a8756eb4-355e-4b9b-9cbe-b4e243ebac9b tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Returning 404 to user: Instance e5f13132-d54e-43f7-8c86-91a4d23d4c35 could not be found. {{(pid=100973) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Nov 23 13:03:18.265744 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-a8756eb4-355e-4b9b-9cbe-b4e243ebac9b tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/e5f13132-d54e-43f7-8c86-91a4d23d4c35" status: 404 len: 111 microversion: 2.1 time: 0.164724 Nov 23 13:03:18.269094 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 353/666] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:03:18 2021] GET /compute/v2.1/servers/e5f13132-d54e-43f7-8c86-91a4d23d4c35 => generated 111 bytes in 169 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 13:03:18.553457 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-31dcde28-afb4-4fcb-adfe-6666d58386a0 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:03:18.569533 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-31dcde28-afb4-4fcb-adfe-6666d58386a0 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45" status: 200 len: 1518 microversion: 2.1 time: 0.485050 Nov 23 13:03:18.580732 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 314/667] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:03:18 2021] GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45 => generated 1518 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:03:19.096987 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-cf333e16-fd56-46d0-aa14-c4d6e0b02574 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:03:19.098765 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-cf333e16-fd56-46d0-aa14-c4d6e0b02574 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:03:19.107835 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-cf333e16-fd56-46d0-aa14-c4d6e0b02574 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:19.108512 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-cf333e16-fd56-46d0-aa14-c4d6e0b02574 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:19.109471 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-cf333e16-fd56-46d0-aa14-c4d6e0b02574 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:19.110069 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-cf333e16-fd56-46d0-aa14-c4d6e0b02574 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:19.128762 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-8976e5d8-33ef-4adf-9cb5-d875a1d0b020 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:03:19.129575 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-8976e5d8-33ef-4adf-9cb5-d875a1d0b020 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:03:19.142381 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8976e5d8-33ef-4adf-9cb5-d875a1d0b020 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:19.145124 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8976e5d8-33ef-4adf-9cb5-d875a1d0b020 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:19.149457 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8976e5d8-33ef-4adf-9cb5-d875a1d0b020 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:19.152985 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8976e5d8-33ef-4adf-9cb5-d875a1d0b020 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:19.406992 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-cf333e16-fd56-46d0-aa14-c4d6e0b02574 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action" status: 200 len: 35542 microversion: 2.20 time: 0.314123 Nov 23 13:03:19.407783 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 354/668] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:03:19 2021] POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action => generated 35542 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:03:19.472934 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-8976e5d8-33ef-4adf-9cb5-d875a1d0b020 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:03:19.484569 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-8976e5d8-33ef-4adf-9cb5-d875a1d0b020 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1259 microversion: 2.1 time: 0.362075 Nov 23 13:03:19.485613 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 315/669] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:03:19 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1259 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 13:03:19.590136 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-8ffa694c-3dbb-44cb-84cd-1d3e13bb444c tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:03:19.592674 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-8ffa694c-3dbb-44cb-84cd-1d3e13bb444c tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: 53633a05-ad06-454a-b540-5fc01821ae45] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:03:19.602487 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8ffa694c-3dbb-44cb-84cd-1d3e13bb444c tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:19.603094 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8ffa694c-3dbb-44cb-84cd-1d3e13bb444c tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:19.604033 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8ffa694c-3dbb-44cb-84cd-1d3e13bb444c tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:19.604664 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8ffa694c-3dbb-44cb-84cd-1d3e13bb444c tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:19.756586 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-5dd247b5-fa34-48dc-bf4c-c222b7ad2757 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:03:19.757085 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-5dd247b5-fa34-48dc-bf4c-c222b7ad2757 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: 12bb9b8b-86ee-463f-a3be-95894290b739] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:03:19.765029 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5dd247b5-fa34-48dc-bf4c-c222b7ad2757 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:19.765739 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5dd247b5-fa34-48dc-bf4c-c222b7ad2757 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:19.766668 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5dd247b5-fa34-48dc-bf4c-c222b7ad2757 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:19.767246 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5dd247b5-fa34-48dc-bf4c-c222b7ad2757 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:19.874157 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-5dd247b5-fa34-48dc-bf4c-c222b7ad2757 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: 12bb9b8b-86ee-463f-a3be-95894290b739] Going to try to terminate instance {{(pid=100974) delete /opt/stack/nova/nova/compute/api.py:2562}} Nov 23 13:03:20.121633 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-5dd247b5-fa34-48dc-bf4c-c222b7ad2757 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "DELETE /compute/v2.1/servers/12bb9b8b-86ee-463f-a3be-95894290b739" status: 204 len: 0 microversion: 2.1 time: 0.367050 Nov 23 13:03:20.124499 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 316/670] 10.222.0.60 () {58 vars in 1238 bytes} [Tue Nov 23 13:03:19 2021] DELETE /compute/v2.1/servers/12bb9b8b-86ee-463f-a3be-95894290b739 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 23 13:03:20.142119 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-85047a54-092e-48d6-84c0-880d4042f396 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:03:20.142915 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-85047a54-092e-48d6-84c0-880d4042f396 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: 12bb9b8b-86ee-463f-a3be-95894290b739] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:03:20.150821 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-85047a54-092e-48d6-84c0-880d4042f396 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:20.151264 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-85047a54-092e-48d6-84c0-880d4042f396 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:20.152038 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-85047a54-092e-48d6-84c0-880d4042f396 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:20.152507 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-85047a54-092e-48d6-84c0-880d4042f396 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:20.193230 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-8ffa694c-3dbb-44cb-84cd-1d3e13bb444c tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:03:20.208576 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-8ffa694c-3dbb-44cb-84cd-1d3e13bb444c tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45" status: 200 len: 1518 microversion: 2.1 time: 0.620780 Nov 23 13:03:20.209577 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 355/671] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:03:19 2021] GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45 => generated 1518 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:03:20.426339 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-5e44e2f2-8507-4478-8192-70a31b06b596 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:03:20.427603 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-5e44e2f2-8507-4478-8192-70a31b06b596 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:03:20.446019 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5e44e2f2-8507-4478-8192-70a31b06b596 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:20.446671 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5e44e2f2-8507-4478-8192-70a31b06b596 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:20.449756 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5e44e2f2-8507-4478-8192-70a31b06b596 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:20.451342 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5e44e2f2-8507-4478-8192-70a31b06b596 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:20.531221 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-85047a54-092e-48d6-84c0-880d4042f396 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c023f89fd3da4bc8b38963bed4e5cc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a31364455dc442f8df299a8ad758a4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:03:20.541416 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-85047a54-092e-48d6-84c0-880d4042f396 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/12bb9b8b-86ee-463f-a3be-95894290b739" status: 200 len: 1514 microversion: 2.1 time: 0.408672 Nov 23 13:03:20.543626 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 317/672] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:03:20 2021] GET /compute/v2.1/servers/12bb9b8b-86ee-463f-a3be-95894290b739 => generated 1514 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:03:20.548578 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-1393ccd8-8bdb-411e-ba67-3540a2e5c204 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:03:20.552395 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-1393ccd8-8bdb-411e-ba67-3540a2e5c204 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:03:20.562962 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1393ccd8-8bdb-411e-ba67-3540a2e5c204 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:20.564740 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1393ccd8-8bdb-411e-ba67-3540a2e5c204 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:20.569255 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1393ccd8-8bdb-411e-ba67-3540a2e5c204 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:20.569707 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1393ccd8-8bdb-411e-ba67-3540a2e5c204 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:20.695449 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-5e44e2f2-8507-4478-8192-70a31b06b596 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action" status: 200 len: 36662 microversion: 2.20 time: 0.276740 Nov 23 13:03:20.696129 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 356/673] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:03:20 2021] POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action => generated 36662 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:03:20.903051 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-1393ccd8-8bdb-411e-ba67-3540a2e5c204 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:03:20.921630 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-1393ccd8-8bdb-411e-ba67-3540a2e5c204 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1259 microversion: 2.1 time: 0.376480 Nov 23 13:03:20.922480 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 318/674] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:03:20 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1259 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:03:21.227590 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-330f3cc9-c7ac-4e0b-9a73-7895364c82f0 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:03:21.228690 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-330f3cc9-c7ac-4e0b-9a73-7895364c82f0 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: 53633a05-ad06-454a-b540-5fc01821ae45] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:03:21.237618 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-330f3cc9-c7ac-4e0b-9a73-7895364c82f0 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:21.238082 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-330f3cc9-c7ac-4e0b-9a73-7895364c82f0 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:21.239049 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-330f3cc9-c7ac-4e0b-9a73-7895364c82f0 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:21.239666 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-330f3cc9-c7ac-4e0b-9a73-7895364c82f0 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:21.547101 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-330f3cc9-c7ac-4e0b-9a73-7895364c82f0 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:03:21.560466 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-bb6da315-ff15-40e3-88a7-11359cd63b04 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:03:21.561074 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-bb6da315-ff15-40e3-88a7-11359cd63b04 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: 12bb9b8b-86ee-463f-a3be-95894290b739] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:03:21.569115 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-330f3cc9-c7ac-4e0b-9a73-7895364c82f0 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45" status: 200 len: 1518 microversion: 2.1 time: 0.345650 Nov 23 13:03:21.570148 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 357/675] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:03:21 2021] GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45 => generated 1518 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:03:21.572115 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-bb6da315-ff15-40e3-88a7-11359cd63b04 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:21.572920 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-bb6da315-ff15-40e3-88a7-11359cd63b04 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:21.575421 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-bb6da315-ff15-40e3-88a7-11359cd63b04 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:21.576432 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-bb6da315-ff15-40e3-88a7-11359cd63b04 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:21.707341 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-4649c9f6-f6ff-4d15-9631-5d72153696bc tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:03:21.708262 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-4649c9f6-f6ff-4d15-9631-5d72153696bc tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:03:21.718685 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4649c9f6-f6ff-4d15-9631-5d72153696bc tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:21.719136 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4649c9f6-f6ff-4d15-9631-5d72153696bc tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:21.720107 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4649c9f6-f6ff-4d15-9631-5d72153696bc tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:21.720713 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4649c9f6-f6ff-4d15-9631-5d72153696bc tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:21.807825 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-bb6da315-ff15-40e3-88a7-11359cd63b04 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c023f89fd3da4bc8b38963bed4e5cc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a31364455dc442f8df299a8ad758a4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:03:21.819038 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-bb6da315-ff15-40e3-88a7-11359cd63b04 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/12bb9b8b-86ee-463f-a3be-95894290b739" status: 200 len: 1514 microversion: 2.1 time: 0.262205 Nov 23 13:03:21.820253 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 319/676] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:03:21 2021] GET /compute/v2.1/servers/12bb9b8b-86ee-463f-a3be-95894290b739 => generated 1514 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:03:21.875406 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-4649c9f6-f6ff-4d15-9631-5d72153696bc tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action" status: 200 len: 37422 microversion: 2.20 time: 0.171801 Nov 23 13:03:21.876388 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 358/677] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:03:21 2021] POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action => generated 37422 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 13:03:21.939536 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-44c3d551-6693-4341-b163-6e090a873d59 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:03:21.940137 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-44c3d551-6693-4341-b163-6e090a873d59 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:03:21.947854 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-44c3d551-6693-4341-b163-6e090a873d59 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:21.948703 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-44c3d551-6693-4341-b163-6e090a873d59 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:21.949708 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-44c3d551-6693-4341-b163-6e090a873d59 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:21.950321 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-44c3d551-6693-4341-b163-6e090a873d59 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:22.219414 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-44c3d551-6693-4341-b163-6e090a873d59 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:03:22.229032 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-44c3d551-6693-4341-b163-6e090a873d59 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1259 microversion: 2.1 time: 0.293339 Nov 23 13:03:22.230001 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 320/678] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:03:21 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1259 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 13:03:22.588594 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-abcbfa5a-9688-4d85-939a-0041a488c380 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:03:22.590569 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-abcbfa5a-9688-4d85-939a-0041a488c380 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: 53633a05-ad06-454a-b540-5fc01821ae45] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:03:22.599735 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-abcbfa5a-9688-4d85-939a-0041a488c380 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:22.600364 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-abcbfa5a-9688-4d85-939a-0041a488c380 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:22.601249 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-abcbfa5a-9688-4d85-939a-0041a488c380 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:22.601777 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-abcbfa5a-9688-4d85-939a-0041a488c380 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:22.837408 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-28f81ff4-3ecb-4886-9d46-0082c4b12b81 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:03:22.838769 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-28f81ff4-3ecb-4886-9d46-0082c4b12b81 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: 12bb9b8b-86ee-463f-a3be-95894290b739] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:03:22.854431 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-28f81ff4-3ecb-4886-9d46-0082c4b12b81 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:22.855385 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-28f81ff4-3ecb-4886-9d46-0082c4b12b81 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:22.856938 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-28f81ff4-3ecb-4886-9d46-0082c4b12b81 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:22.857751 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-28f81ff4-3ecb-4886-9d46-0082c4b12b81 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:22.955260 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-abcbfa5a-9688-4d85-939a-0041a488c380 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:03:22.970887 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-abcbfa5a-9688-4d85-939a-0041a488c380 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45" status: 200 len: 1518 microversion: 2.1 time: 0.386745 Nov 23 13:03:22.976364 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 359/679] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:03:22 2021] GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45 => generated 1518 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:03:22.985701 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-8f5d44b3-046b-4583-baf7-51ab2ae9a5bb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:03:22.986858 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-8f5d44b3-046b-4583-baf7-51ab2ae9a5bb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:03:22.996985 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8f5d44b3-046b-4583-baf7-51ab2ae9a5bb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:22.998033 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8f5d44b3-046b-4583-baf7-51ab2ae9a5bb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:23.000703 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8f5d44b3-046b-4583-baf7-51ab2ae9a5bb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:23.001455 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8f5d44b3-046b-4583-baf7-51ab2ae9a5bb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:23.143626 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-8f5d44b3-046b-4583-baf7-51ab2ae9a5bb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action" status: 200 len: 38209 microversion: 2.20 time: 0.165544 Nov 23 13:03:23.147809 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 360/680] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:03:22 2021] POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action => generated 38209 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:03:23.247353 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-682101d0-e1f2-4523-95ad-8edec5d99e1a tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:03:23.248086 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-682101d0-e1f2-4523-95ad-8edec5d99e1a tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:03:23.280007 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-682101d0-e1f2-4523-95ad-8edec5d99e1a tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:23.280007 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-682101d0-e1f2-4523-95ad-8edec5d99e1a tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:23.280007 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-682101d0-e1f2-4523-95ad-8edec5d99e1a tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:23.280007 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-682101d0-e1f2-4523-95ad-8edec5d99e1a tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:23.520734 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-682101d0-e1f2-4523-95ad-8edec5d99e1a tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:03:23.532818 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-682101d0-e1f2-4523-95ad-8edec5d99e1a tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1259 microversion: 2.1 time: 0.290107 Nov 23 13:03:23.537604 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 361/681] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:03:23 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1259 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:03:23.552380 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [req-0b94490b-ac3a-48dd-9fdf-a4a123edf368 req-3ae97b7e-efd2-4267-9102-91aa70cbfa84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a3c40e3-d194-4953-be2a-355e3cd882d7", "name": "network-vif-plugged", "status": "completed", "tag": "9334a9ef-7661-4c37-bee0-88d739f97311"}]} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:03:23.555076 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 13:03:23.555076 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: warnings.warn(msg) Nov 23 13:03:23.562323 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-28f81ff4-3ecb-4886-9d46-0082c4b12b81 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c023f89fd3da4bc8b38963bed4e5cc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a31364455dc442f8df299a8ad758a4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:03:23.571023 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [req-0b94490b-ac3a-48dd-9fdf-a4a123edf368 req-3ae97b7e-efd2-4267-9102-91aa70cbfa84 service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:23.571610 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [req-0b94490b-ac3a-48dd-9fdf-a4a123edf368 req-3ae97b7e-efd2-4267-9102-91aa70cbfa84 service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:23.575010 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-28f81ff4-3ecb-4886-9d46-0082c4b12b81 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/12bb9b8b-86ee-463f-a3be-95894290b739" status: 200 len: 1514 microversion: 2.1 time: 0.741313 Nov 23 13:03:23.588435 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 321/682] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:03:22 2021] GET /compute/v2.1/servers/12bb9b8b-86ee-463f-a3be-95894290b739 => generated 1514 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 13:03:23.611112 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.compute.server_external_events [req-0b94490b-ac3a-48dd-9fdf-a4a123edf368 req-3ae97b7e-efd2-4267-9102-91aa70cbfa84 service nova] Creating event network-vif-plugged:9334a9ef-7661-4c37-bee0-88d739f97311 for instance 5a3c40e3-d194-4953-be2a-355e3cd882d7 on hv-cinder-81888 Nov 23 13:03:23.620218 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [req-0b94490b-ac3a-48dd-9fdf-a4a123edf368 req-3ae97b7e-efd2-4267-9102-91aa70cbfa84 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084767 Nov 23 13:03:23.621127 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 362/683] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Nov 23 13:03:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 13:03:23.989994 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-e3c526cf-a6af-41c1-97b6-fbe0011853bf tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:03:23.991520 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-e3c526cf-a6af-41c1-97b6-fbe0011853bf tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: 53633a05-ad06-454a-b540-5fc01821ae45] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:03:24.011536 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e3c526cf-a6af-41c1-97b6-fbe0011853bf tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:24.012077 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e3c526cf-a6af-41c1-97b6-fbe0011853bf tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:24.012970 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e3c526cf-a6af-41c1-97b6-fbe0011853bf tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:24.013471 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e3c526cf-a6af-41c1-97b6-fbe0011853bf tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:24.160621 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-8eec7e29-b931-484d-b2d7-9a5f45397912 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:03:24.161786 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-8eec7e29-b931-484d-b2d7-9a5f45397912 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:03:24.170687 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8eec7e29-b931-484d-b2d7-9a5f45397912 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:24.171276 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8eec7e29-b931-484d-b2d7-9a5f45397912 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:24.172208 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8eec7e29-b931-484d-b2d7-9a5f45397912 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:24.172803 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8eec7e29-b931-484d-b2d7-9a5f45397912 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:24.319799 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-8eec7e29-b931-484d-b2d7-9a5f45397912 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action" status: 200 len: 38209 microversion: 2.20 time: 0.163004 Nov 23 13:03:24.328014 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 363/684] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:03:24 2021] POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action => generated 38209 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 13:03:24.552079 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-220d400e-29fd-40af-921a-f9c2e3a4b873 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:03:24.553235 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-220d400e-29fd-40af-921a-f9c2e3a4b873 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:03:24.562013 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-220d400e-29fd-40af-921a-f9c2e3a4b873 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:24.569067 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-220d400e-29fd-40af-921a-f9c2e3a4b873 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:24.570286 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-220d400e-29fd-40af-921a-f9c2e3a4b873 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:24.572852 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-220d400e-29fd-40af-921a-f9c2e3a4b873 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:24.916588 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-220d400e-29fd-40af-921a-f9c2e3a4b873 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:03:24.925968 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-220d400e-29fd-40af-921a-f9c2e3a4b873 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1259 microversion: 2.1 time: 0.378025 Nov 23 13:03:24.926652 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 364/685] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:03:24 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1259 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:03:24.931310 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-b3a0f9b1-0205-4cd9-812d-b6f6a1eccc51 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:03:24.932138 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-b3a0f9b1-0205-4cd9-812d-b6f6a1eccc51 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: 12bb9b8b-86ee-463f-a3be-95894290b739] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:03:24.943516 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b3a0f9b1-0205-4cd9-812d-b6f6a1eccc51 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:24.944202 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b3a0f9b1-0205-4cd9-812d-b6f6a1eccc51 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:24.945244 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b3a0f9b1-0205-4cd9-812d-b6f6a1eccc51 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:24.945908 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b3a0f9b1-0205-4cd9-812d-b6f6a1eccc51 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:24.949340 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-e3c526cf-a6af-41c1-97b6-fbe0011853bf tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:03:24.957987 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-e3c526cf-a6af-41c1-97b6-fbe0011853bf tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45" status: 200 len: 1518 microversion: 2.1 time: 0.972408 Nov 23 13:03:24.969565 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 322/686] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:03:23 2021] GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45 => generated 1518 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:03:25.086745 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-b3a0f9b1-0205-4cd9-812d-b6f6a1eccc51 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c023f89fd3da4bc8b38963bed4e5cc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a31364455dc442f8df299a8ad758a4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:03:25.101439 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-b3a0f9b1-0205-4cd9-812d-b6f6a1eccc51 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/12bb9b8b-86ee-463f-a3be-95894290b739" status: 200 len: 1472 microversion: 2.1 time: 0.173312 Nov 23 13:03:25.101804 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 365/687] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:03:24 2021] GET /compute/v2.1/servers/12bb9b8b-86ee-463f-a3be-95894290b739 => generated 1472 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:03:25.139210 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [req-dfb658eb-84e4-4621-a1ab-aba620573de4 req-4b671fed-19b4-48b1-af47-0145b39612b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12bb9b8b-86ee-463f-a3be-95894290b739", "name": "network-vif-deleted", "tag": "a7974570-e152-43f9-91ff-1ff60c761971"}]} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:03:25.142364 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 13:03:25.142364 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: warnings.warn(msg) Nov 23 13:03:25.154135 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [req-dfb658eb-84e4-4621-a1ab-aba620573de4 req-4b671fed-19b4-48b1-af47-0145b39612b7 service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:25.154968 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [req-dfb658eb-84e4-4621-a1ab-aba620573de4 req-4b671fed-19b4-48b1-af47-0145b39612b7 service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:25.176074 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.compute.server_external_events [req-dfb658eb-84e4-4621-a1ab-aba620573de4 req-4b671fed-19b4-48b1-af47-0145b39612b7 service nova] Creating event network-vif-deleted:a7974570-e152-43f9-91ff-1ff60c761971 for instance 12bb9b8b-86ee-463f-a3be-95894290b739 on hv-cinder-81888 Nov 23 13:03:25.195125 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [req-dfb658eb-84e4-4621-a1ab-aba620573de4 req-4b671fed-19b4-48b1-af47-0145b39612b7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056939 Nov 23 13:03:25.196724 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 323/688] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Nov 23 13:03:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 13:03:25.337138 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-720ebbc9-61fb-4687-a3c9-8c496705a6ed tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:03:25.338852 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-720ebbc9-61fb-4687-a3c9-8c496705a6ed tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:03:25.374474 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-720ebbc9-61fb-4687-a3c9-8c496705a6ed tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:25.375213 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-720ebbc9-61fb-4687-a3c9-8c496705a6ed tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:25.376794 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-720ebbc9-61fb-4687-a3c9-8c496705a6ed tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:25.383476 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-720ebbc9-61fb-4687-a3c9-8c496705a6ed tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:25.741216 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-720ebbc9-61fb-4687-a3c9-8c496705a6ed tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action" status: 200 len: 38348 microversion: 2.20 time: 0.411748 Nov 23 13:03:25.751953 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 366/689] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:03:25 2021] POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action => generated 38348 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:03:25.753981 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-c195548b-dee1-4ce3-b7f4-394eb1414c24 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:03:25.754562 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-c195548b-dee1-4ce3-b7f4-394eb1414c24 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:03:25.769500 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c195548b-dee1-4ce3-b7f4-394eb1414c24 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:25.779994 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c195548b-dee1-4ce3-b7f4-394eb1414c24 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:25.785484 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c195548b-dee1-4ce3-b7f4-394eb1414c24 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:25.786201 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c195548b-dee1-4ce3-b7f4-394eb1414c24 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:25.872872 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-c195548b-dee1-4ce3-b7f4-394eb1414c24 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/ips" status: 200 len: 152 microversion: 2.20 time: 0.123182 Nov 23 13:03:25.880278 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 324/690] 10.222.0.60 () {60 vars in 1288 bytes} [Tue Nov 23 13:03:25 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/ips => generated 152 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 13:03:25.944424 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-3e53df6f-1f45-4672-8f02-c812b4b00a54 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:03:25.945207 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-3e53df6f-1f45-4672-8f02-c812b4b00a54 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:03:25.965023 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-3e53df6f-1f45-4672-8f02-c812b4b00a54 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:25.967982 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-3e53df6f-1f45-4672-8f02-c812b4b00a54 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:25.988922 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-341b055f-9fc9-4c73-bac0-423b6a2f9589 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:03:25.989878 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-341b055f-9fc9-4c73-bac0-423b6a2f9589 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: 53633a05-ad06-454a-b540-5fc01821ae45] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:03:26.029042 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-3e53df6f-1f45-4672-8f02-c812b4b00a54 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:26.029811 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-3e53df6f-1f45-4672-8f02-c812b4b00a54 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.060s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:26.069033 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-341b055f-9fc9-4c73-bac0-423b6a2f9589 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:26.072802 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-341b055f-9fc9-4c73-bac0-423b6a2f9589 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:26.078273 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-341b055f-9fc9-4c73-bac0-423b6a2f9589 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:26.080488 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-341b055f-9fc9-4c73-bac0-423b6a2f9589 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:26.660712 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-3e53df6f-1f45-4672-8f02-c812b4b00a54 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:03:26.678520 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-3e53df6f-1f45-4672-8f02-c812b4b00a54 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1259 microversion: 2.1 time: 0.739248 Nov 23 13:03:26.689799 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 367/691] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:03:25 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1259 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:03:26.695006 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-9b915452-f498-41fb-8850-7e62acd9d732 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:03:26.695965 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-9b915452-f498-41fb-8850-7e62acd9d732 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: 12bb9b8b-86ee-463f-a3be-95894290b739] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:03:26.705179 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-9b915452-f498-41fb-8850-7e62acd9d732 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:26.705785 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-9b915452-f498-41fb-8850-7e62acd9d732 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:26.706737 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-9b915452-f498-41fb-8850-7e62acd9d732 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:26.707468 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-9b915452-f498-41fb-8850-7e62acd9d732 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:26.819908 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.wsgi [None req-9b915452-f498-41fb-8850-7e62acd9d732 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] HTTP exception thrown: Instance 12bb9b8b-86ee-463f-a3be-95894290b739 could not be found. Nov 23 13:03:26.820530 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-9b915452-f498-41fb-8850-7e62acd9d732 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Returning 404 to user: Instance 12bb9b8b-86ee-463f-a3be-95894290b739 could not be found. {{(pid=100973) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Nov 23 13:03:26.825987 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-9b915452-f498-41fb-8850-7e62acd9d732 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/12bb9b8b-86ee-463f-a3be-95894290b739" status: 404 len: 111 microversion: 2.1 time: 0.134751 Nov 23 13:03:26.827509 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 368/692] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:03:26 2021] GET /compute/v2.1/servers/12bb9b8b-86ee-463f-a3be-95894290b739 => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 13:03:26.840314 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-b1ec2aac-5797-4959-8ac2-efcad83ee0e0 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:03:26.841936 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-b1ec2aac-5797-4959-8ac2-efcad83ee0e0 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: da72692d-5ac7-4e8e-9b7d-11d421a1f071] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:03:26.860790 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b1ec2aac-5797-4959-8ac2-efcad83ee0e0 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:26.862454 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b1ec2aac-5797-4959-8ac2-efcad83ee0e0 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:26.863566 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b1ec2aac-5797-4959-8ac2-efcad83ee0e0 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:26.864388 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b1ec2aac-5797-4959-8ac2-efcad83ee0e0 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:26.944785 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-b1ec2aac-5797-4959-8ac2-efcad83ee0e0 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: da72692d-5ac7-4e8e-9b7d-11d421a1f071] Going to try to terminate instance {{(pid=100973) delete /opt/stack/nova/nova/compute/api.py:2562}} Nov 23 13:03:27.078976 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-b1ec2aac-5797-4959-8ac2-efcad83ee0e0 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "DELETE /compute/v2.1/servers/da72692d-5ac7-4e8e-9b7d-11d421a1f071" status: 204 len: 0 microversion: 2.1 time: 0.247009 Nov 23 13:03:27.079836 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 369/693] 10.222.0.60 () {58 vars in 1238 bytes} [Tue Nov 23 13:03:26 2021] DELETE /compute/v2.1/servers/da72692d-5ac7-4e8e-9b7d-11d421a1f071 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 23 13:03:27.088804 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-84a4547d-5709-418c-b489-1bea53551bdc tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:03:27.090010 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-84a4547d-5709-418c-b489-1bea53551bdc tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: da72692d-5ac7-4e8e-9b7d-11d421a1f071] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:03:27.098045 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-84a4547d-5709-418c-b489-1bea53551bdc tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:27.098913 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-84a4547d-5709-418c-b489-1bea53551bdc tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:27.099984 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-84a4547d-5709-418c-b489-1bea53551bdc tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:27.100536 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-84a4547d-5709-418c-b489-1bea53551bdc tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:27.320631 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-84a4547d-5709-418c-b489-1bea53551bdc tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c023f89fd3da4bc8b38963bed4e5cc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a31364455dc442f8df299a8ad758a4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:03:27.329649 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-84a4547d-5709-418c-b489-1bea53551bdc tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/da72692d-5ac7-4e8e-9b7d-11d421a1f071" status: 200 len: 1514 microversion: 2.1 time: 0.245296 Nov 23 13:03:27.330474 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 370/694] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:03:27 2021] GET /compute/v2.1/servers/da72692d-5ac7-4e8e-9b7d-11d421a1f071 => generated 1514 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:03:27.334746 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [req-2c14669c-2409-4562-8eef-16a63a7a0c3a req-db0f1402-b81b-446e-a47e-1083a0008167 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53633a05-ad06-454a-b540-5fc01821ae45", "name": "network-vif-unplugged", "status": "completed", "tag": "12c0e1a4-3a5f-40d2-8b38-ebcd979a194c"}]} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:03:27.336511 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 13:03:27.336511 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: warnings.warn(msg) Nov 23 13:03:27.345483 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [req-2c14669c-2409-4562-8eef-16a63a7a0c3a req-db0f1402-b81b-446e-a47e-1083a0008167 service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:27.345913 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [req-2c14669c-2409-4562-8eef-16a63a7a0c3a req-db0f1402-b81b-446e-a47e-1083a0008167 service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:27.368607 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.compute.server_external_events [req-2c14669c-2409-4562-8eef-16a63a7a0c3a req-db0f1402-b81b-446e-a47e-1083a0008167 service nova] Creating event network-vif-unplugged:12c0e1a4-3a5f-40d2-8b38-ebcd979a194c for instance 53633a05-ad06-454a-b540-5fc01821ae45 on hv-cinder-81888 Nov 23 13:03:27.374331 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [req-2c14669c-2409-4562-8eef-16a63a7a0c3a req-db0f1402-b81b-446e-a47e-1083a0008167 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041933 Nov 23 13:03:27.374894 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 371/695] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Nov 23 13:03:27 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 13:03:27.411127 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-341b055f-9fc9-4c73-bac0-423b6a2f9589 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:03:27.421443 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-341b055f-9fc9-4c73-bac0-423b6a2f9589 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45" status: 200 len: 1518 microversion: 2.1 time: 1.447973 Nov 23 13:03:27.422247 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 325/696] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:03:25 2021] GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45 => generated 1518 bytes in 1450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:03:27.699433 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-0a189275-b94b-4ad8-af39-7cdc4b966aab tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:03:27.700139 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-0a189275-b94b-4ad8-af39-7cdc4b966aab tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:03:27.720423 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0a189275-b94b-4ad8-af39-7cdc4b966aab tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:27.721262 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0a189275-b94b-4ad8-af39-7cdc4b966aab tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:27.722675 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0a189275-b94b-4ad8-af39-7cdc4b966aab tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:27.723678 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0a189275-b94b-4ad8-af39-7cdc4b966aab tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:28.163710 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-0a189275-b94b-4ad8-af39-7cdc4b966aab tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:03:28.179761 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-0a189275-b94b-4ad8-af39-7cdc4b966aab tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1443 microversion: 2.1 time: 0.487755 Nov 23 13:03:28.181836 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 372/697] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:03:27 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1443 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:03:28.197867 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-747860ee-a6e2-4ca9-b62d-8f49f95ffba7 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:03:28.198705 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-747860ee-a6e2-4ca9-b62d-8f49f95ffba7 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:03:28.220372 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-747860ee-a6e2-4ca9-b62d-8f49f95ffba7 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:28.220712 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-747860ee-a6e2-4ca9-b62d-8f49f95ffba7 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:28.221927 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-747860ee-a6e2-4ca9-b62d-8f49f95ffba7 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:28.232875 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-747860ee-a6e2-4ca9-b62d-8f49f95ffba7 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:28.346676 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-ce942d6e-1155-4709-a596-d5c17291c83e tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:03:28.347280 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-ce942d6e-1155-4709-a596-d5c17291c83e tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: da72692d-5ac7-4e8e-9b7d-11d421a1f071] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:03:28.361491 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ce942d6e-1155-4709-a596-d5c17291c83e tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:28.361940 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ce942d6e-1155-4709-a596-d5c17291c83e tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:28.363092 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ce942d6e-1155-4709-a596-d5c17291c83e tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:28.363227 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ce942d6e-1155-4709-a596-d5c17291c83e tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:28.822900 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-ce942d6e-1155-4709-a596-d5c17291c83e tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c023f89fd3da4bc8b38963bed4e5cc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a31364455dc442f8df299a8ad758a4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:03:28.833111 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-ce942d6e-1155-4709-a596-d5c17291c83e tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/da72692d-5ac7-4e8e-9b7d-11d421a1f071" status: 200 len: 1514 microversion: 2.1 time: 0.490003 Nov 23 13:03:28.834550 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 373/698] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:03:28 2021] GET /compute/v2.1/servers/da72692d-5ac7-4e8e-9b7d-11d421a1f071 => generated 1514 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 13:03:28.847156 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-268716c5-23b3-42ba-84d5-a07546920135 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:03:28.848265 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-268716c5-23b3-42ba-84d5-a07546920135 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: 53633a05-ad06-454a-b540-5fc01821ae45] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:03:28.859839 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-268716c5-23b3-42ba-84d5-a07546920135 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:28.860370 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-268716c5-23b3-42ba-84d5-a07546920135 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:28.861164 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-268716c5-23b3-42ba-84d5-a07546920135 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:28.861611 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-268716c5-23b3-42ba-84d5-a07546920135 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:29.222124 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-268716c5-23b3-42ba-84d5-a07546920135 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:03:29.231505 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-268716c5-23b3-42ba-84d5-a07546920135 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45" status: 200 len: 1518 microversion: 2.1 time: 0.395472 Nov 23 13:03:29.234319 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 374/699] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:03:28 2021] GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45 => generated 1518 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:03:29.248064 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-f4862c6e-cbe4-4c75-a006-583559689621 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:03:29.248954 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-f4862c6e-cbe4-4c75-a006-583559689621 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:03:29.258508 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f4862c6e-cbe4-4c75-a006-583559689621 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:29.259253 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f4862c6e-cbe4-4c75-a006-583559689621 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:29.260153 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f4862c6e-cbe4-4c75-a006-583559689621 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:29.260698 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f4862c6e-cbe4-4c75-a006-583559689621 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:29.349104 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.objects.instance [None req-f4862c6e-cbe4-4c75-a006-583559689621 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lazy-loading 'flavor' on Instance uuid b9c21729-a176-4e26-9074-f5f0bfc0ce20 {{(pid=100973) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 23 13:03:29.730481 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-747860ee-a6e2-4ca9-b62d-8f49f95ffba7 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:03:29.739800 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-747860ee-a6e2-4ca9-b62d-8f49f95ffba7 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1443 microversion: 2.1 time: 1.545983 Nov 23 13:03:29.758379 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 326/700] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:03:28 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1443 bytes in 1565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:03:29.838199 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-f4862c6e-cbe4-4c75-a006-583559689621 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action" status: 202 len: 0 microversion: 2.20 time: 0.602183 Nov 23 13:03:29.851025 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-ff228633-9af6-4566-9d18-9d90f62c1ba2 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:03:29.851943 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-ff228633-9af6-4566-9d18-9d90f62c1ba2 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: da72692d-5ac7-4e8e-9b7d-11d421a1f071] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:03:29.858666 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 375/701] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:03:29 2021] POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action => generated 0 bytes in 624 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 23 13:03:29.877815 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ff228633-9af6-4566-9d18-9d90f62c1ba2 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:29.878302 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ff228633-9af6-4566-9d18-9d90f62c1ba2 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:29.879318 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ff228633-9af6-4566-9d18-9d90f62c1ba2 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:29.879495 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ff228633-9af6-4566-9d18-9d90f62c1ba2 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:29.892037 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-41b15759-2195-4ab4-83ee-e11ad9352820 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:03:29.894740 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-41b15759-2195-4ab4-83ee-e11ad9352820 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:03:29.932896 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-41b15759-2195-4ab4-83ee-e11ad9352820 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:29.933932 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-41b15759-2195-4ab4-83ee-e11ad9352820 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:29.939648 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-41b15759-2195-4ab4-83ee-e11ad9352820 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:29.947374 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-41b15759-2195-4ab4-83ee-e11ad9352820 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:30.579260 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-41b15759-2195-4ab4-83ee-e11ad9352820 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:03:30.599748 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-41b15759-2195-4ab4-83ee-e11ad9352820 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:03:30.603835 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-41b15759-2195-4ab4-83ee-e11ad9352820 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:03:30.611218 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-41b15759-2195-4ab4-83ee-e11ad9352820 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1723 microversion: 2.20 time: 0.739954 Nov 23 13:03:30.621966 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 376/702] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:03:29 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1723 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:03:30.645961 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-0318b525-d288-470c-96c8-84701d523e68 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:03:30.658484 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-0318b525-d288-470c-96c8-84701d523e68 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: 53633a05-ad06-454a-b540-5fc01821ae45] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:03:30.690303 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0318b525-d288-470c-96c8-84701d523e68 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:30.690838 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0318b525-d288-470c-96c8-84701d523e68 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:30.698616 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0318b525-d288-470c-96c8-84701d523e68 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:30.699278 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0318b525-d288-470c-96c8-84701d523e68 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:30.830502 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0318b525-d288-470c-96c8-84701d523e68 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:30.830950 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0318b525-d288-470c-96c8-84701d523e68 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:30.831824 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.objects.instance [None req-0318b525-d288-470c-96c8-84701d523e68 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lazy-loading 'fault' on Instance uuid 53633a05-ad06-454a-b540-5fc01821ae45 {{(pid=100973) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 23 13:03:30.959294 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-ff228633-9af6-4566-9d18-9d90f62c1ba2 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c023f89fd3da4bc8b38963bed4e5cc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a31364455dc442f8df299a8ad758a4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:03:30.971054 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-ff228633-9af6-4566-9d18-9d90f62c1ba2 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/da72692d-5ac7-4e8e-9b7d-11d421a1f071" status: 200 len: 1514 microversion: 2.1 time: 1.123976 Nov 23 13:03:30.972104 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 327/703] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:03:29 2021] GET /compute/v2.1/servers/da72692d-5ac7-4e8e-9b7d-11d421a1f071 => generated 1514 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 13:03:30.984683 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [req-3222f8dd-64d9-4760-9506-95f678b0448d req-c2502f0e-875e-40e4-b44a-3d81077f6c75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53633a05-ad06-454a-b540-5fc01821ae45", "name": "network-vif-deleted", "tag": "12c0e1a4-3a5f-40d2-8b38-ebcd979a194c"}]} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:03:30.999119 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 13:03:30.999119 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: warnings.warn(msg) Nov 23 13:03:31.015971 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-0318b525-d288-470c-96c8-84701d523e68 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9285e1edf7ed42029c54bcc4f86abda7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd7c1ce491e474c970f1a7cc5effe19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:03:31.026695 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [req-3222f8dd-64d9-4760-9506-95f678b0448d req-c2502f0e-875e-40e4-b44a-3d81077f6c75 service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:31.029623 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [req-3222f8dd-64d9-4760-9506-95f678b0448d req-c2502f0e-875e-40e4-b44a-3d81077f6c75 service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:31.039871 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-0318b525-d288-470c-96c8-84701d523e68 tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45" status: 200 len: 1311 microversion: 2.1 time: 0.405915 Nov 23 13:03:31.041433 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 377/704] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:03:30 2021] GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45 => generated 1311 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:03:31.091964 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.compute.server_external_events [req-3222f8dd-64d9-4760-9506-95f678b0448d req-c2502f0e-875e-40e4-b44a-3d81077f6c75 service nova] Creating event network-vif-deleted:12c0e1a4-3a5f-40d2-8b38-ebcd979a194c for instance 53633a05-ad06-454a-b540-5fc01821ae45 on hv-cinder-81888 Nov 23 13:03:31.113725 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [req-3222f8dd-64d9-4760-9506-95f678b0448d req-c2502f0e-875e-40e4-b44a-3d81077f6c75 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137347 Nov 23 13:03:31.115317 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 328/705] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Nov 23 13:03:30 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 13:03:31.651271 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-75dd2fc2-b25b-433a-bf91-3f5433c0239a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:03:31.652724 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-75dd2fc2-b25b-433a-bf91-3f5433c0239a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:03:31.673171 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-75dd2fc2-b25b-433a-bf91-3f5433c0239a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:31.674294 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-75dd2fc2-b25b-433a-bf91-3f5433c0239a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:31.675869 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-75dd2fc2-b25b-433a-bf91-3f5433c0239a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:31.677110 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-75dd2fc2-b25b-433a-bf91-3f5433c0239a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:31.991501 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-fe8fe6d2-ca81-4ddd-ac97-1ff2165ecab3 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:03:31.992195 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-fe8fe6d2-ca81-4ddd-ac97-1ff2165ecab3 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: da72692d-5ac7-4e8e-9b7d-11d421a1f071] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:03:32.000974 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-fe8fe6d2-ca81-4ddd-ac97-1ff2165ecab3 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:32.001700 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-fe8fe6d2-ca81-4ddd-ac97-1ff2165ecab3 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:32.002691 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-fe8fe6d2-ca81-4ddd-ac97-1ff2165ecab3 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:32.003279 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-fe8fe6d2-ca81-4ddd-ac97-1ff2165ecab3 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:32.185507 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-75dd2fc2-b25b-433a-bf91-3f5433c0239a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:03:32.190317 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-fe8fe6d2-ca81-4ddd-ac97-1ff2165ecab3 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c023f89fd3da4bc8b38963bed4e5cc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a31364455dc442f8df299a8ad758a4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:03:32.203338 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-fe8fe6d2-ca81-4ddd-ac97-1ff2165ecab3 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/da72692d-5ac7-4e8e-9b7d-11d421a1f071" status: 200 len: 1472 microversion: 2.1 time: 0.216718 Nov 23 13:03:32.205847 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-75dd2fc2-b25b-433a-bf91-3f5433c0239a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:03:32.207403 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-75dd2fc2-b25b-433a-bf91-3f5433c0239a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:03:32.208406 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 329/706] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:03:31 2021] GET /compute/v2.1/servers/da72692d-5ac7-4e8e-9b7d-11d421a1f071 => generated 1472 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:03:32.213743 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-75dd2fc2-b25b-433a-bf91-3f5433c0239a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1723 microversion: 2.20 time: 0.572005 Nov 23 13:03:32.217295 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 378/707] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:03:31 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1723 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:03:32.226755 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-95bd08a2-6b43-4fd0-86a3-6493111312da tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:03:32.228636 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-95bd08a2-6b43-4fd0-86a3-6493111312da tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] [instance: 53633a05-ad06-454a-b540-5fc01821ae45] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:03:32.240904 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-95bd08a2-6b43-4fd0-86a3-6493111312da tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:32.242118 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-95bd08a2-6b43-4fd0-86a3-6493111312da tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:32.243456 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-95bd08a2-6b43-4fd0-86a3-6493111312da tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:32.244375 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-95bd08a2-6b43-4fd0-86a3-6493111312da tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:32.305583 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.wsgi [None req-95bd08a2-6b43-4fd0-86a3-6493111312da tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] HTTP exception thrown: Instance 53633a05-ad06-454a-b540-5fc01821ae45 could not be found. Nov 23 13:03:32.306871 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-95bd08a2-6b43-4fd0-86a3-6493111312da tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] Returning 404 to user: Instance 53633a05-ad06-454a-b540-5fc01821ae45 could not be found. {{(pid=100974) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Nov 23 13:03:32.307908 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-95bd08a2-6b43-4fd0-86a3-6493111312da tempest-ServerRescueNegativeTestJSON-279136768 tempest-ServerRescueNegativeTestJSON-279136768-project] 10.222.0.60 "GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45" status: 404 len: 111 microversion: 2.1 time: 0.097973 Nov 23 13:03:32.308650 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 330/708] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:03:32 2021] GET /compute/v2.1/servers/53633a05-ad06-454a-b540-5fc01821ae45 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 13:03:33.175480 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [req-7346d047-d4a5-42cc-b88a-9c35f61fa0c5 req-57a227d8-b4d7-4a31-bd09-67944740e60b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da72692d-5ac7-4e8e-9b7d-11d421a1f071", "name": "network-vif-deleted", "tag": "43d88996-bc75-42de-a03e-4caf7be9d7d1"}]} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:03:33.178544 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 13:03:33.178544 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: warnings.warn(msg) Nov 23 13:03:33.199395 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [req-7346d047-d4a5-42cc-b88a-9c35f61fa0c5 req-57a227d8-b4d7-4a31-bd09-67944740e60b service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:33.200374 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [req-7346d047-d4a5-42cc-b88a-9c35f61fa0c5 req-57a227d8-b4d7-4a31-bd09-67944740e60b service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:33.221811 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-580de03c-98ff-4a6e-973c-e3e365d440c3 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:03:33.222587 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-580de03c-98ff-4a6e-973c-e3e365d440c3 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: da72692d-5ac7-4e8e-9b7d-11d421a1f071] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:03:33.226728 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.compute.server_external_events [req-7346d047-d4a5-42cc-b88a-9c35f61fa0c5 req-57a227d8-b4d7-4a31-bd09-67944740e60b service nova] Creating event network-vif-deleted:43d88996-bc75-42de-a03e-4caf7be9d7d1 for instance da72692d-5ac7-4e8e-9b7d-11d421a1f071 on hv-cinder-81888 Nov 23 13:03:33.234973 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [req-7346d047-d4a5-42cc-b88a-9c35f61fa0c5 req-57a227d8-b4d7-4a31-bd09-67944740e60b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063576 Nov 23 13:03:33.236376 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 379/709] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Nov 23 13:03:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 13:03:33.242623 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-580de03c-98ff-4a6e-973c-e3e365d440c3 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:33.243816 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-580de03c-98ff-4a6e-973c-e3e365d440c3 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:33.251133 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-580de03c-98ff-4a6e-973c-e3e365d440c3 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:33.252426 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-580de03c-98ff-4a6e-973c-e3e365d440c3 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:33.262967 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-4b4592dc-f926-40e6-b1c3-09bdce5e6463 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:03:33.264997 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-4b4592dc-f926-40e6-b1c3-09bdce5e6463 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:03:33.273332 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4b4592dc-f926-40e6-b1c3-09bdce5e6463 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:33.274107 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4b4592dc-f926-40e6-b1c3-09bdce5e6463 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:33.275369 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4b4592dc-f926-40e6-b1c3-09bdce5e6463 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:33.276038 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4b4592dc-f926-40e6-b1c3-09bdce5e6463 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:33.769375 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-580de03c-98ff-4a6e-973c-e3e365d440c3 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c023f89fd3da4bc8b38963bed4e5cc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a31364455dc442f8df299a8ad758a4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:03:33.780900 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-580de03c-98ff-4a6e-973c-e3e365d440c3 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/da72692d-5ac7-4e8e-9b7d-11d421a1f071" status: 200 len: 1472 microversion: 2.1 time: 0.562834 Nov 23 13:03:33.782341 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 331/710] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:03:33 2021] GET /compute/v2.1/servers/da72692d-5ac7-4e8e-9b7d-11d421a1f071 => generated 1472 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:03:34.131847 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-4b4592dc-f926-40e6-b1c3-09bdce5e6463 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:03:34.147078 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-4b4592dc-f926-40e6-b1c3-09bdce5e6463 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:03:34.149532 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-4b4592dc-f926-40e6-b1c3-09bdce5e6463 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:03:34.151452 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-4b4592dc-f926-40e6-b1c3-09bdce5e6463 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1723 microversion: 2.20 time: 0.908862 Nov 23 13:03:34.152557 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 380/711] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:03:33 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1723 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:03:34.799487 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-2bc44c08-2467-410c-8889-7739c176f3ef tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:03:34.801059 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-2bc44c08-2467-410c-8889-7739c176f3ef tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: da72692d-5ac7-4e8e-9b7d-11d421a1f071] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:03:34.811668 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2bc44c08-2467-410c-8889-7739c176f3ef tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:34.812553 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2bc44c08-2467-410c-8889-7739c176f3ef tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:34.813580 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2bc44c08-2467-410c-8889-7739c176f3ef tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:34.814224 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2bc44c08-2467-410c-8889-7739c176f3ef tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:34.994250 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-2bc44c08-2467-410c-8889-7739c176f3ef tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c023f89fd3da4bc8b38963bed4e5cc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a31364455dc442f8df299a8ad758a4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:03:35.005091 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-2bc44c08-2467-410c-8889-7739c176f3ef tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/da72692d-5ac7-4e8e-9b7d-11d421a1f071" status: 200 len: 1303 microversion: 2.1 time: 0.209895 Nov 23 13:03:35.023819 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 332/712] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:03:34 2021] GET /compute/v2.1/servers/da72692d-5ac7-4e8e-9b7d-11d421a1f071 => generated 1303 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:03:35.170659 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-347f6149-f647-4f5b-a138-084ab99acb3e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:03:35.171883 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-347f6149-f647-4f5b-a138-084ab99acb3e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:03:35.187709 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-347f6149-f647-4f5b-a138-084ab99acb3e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:35.188502 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-347f6149-f647-4f5b-a138-084ab99acb3e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:35.189625 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-347f6149-f647-4f5b-a138-084ab99acb3e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:35.190207 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-347f6149-f647-4f5b-a138-084ab99acb3e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:36.024086 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-abbe9b77-135c-4710-8097-f1eea4938c36 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:03:36.025560 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-abbe9b77-135c-4710-8097-f1eea4938c36 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: da72692d-5ac7-4e8e-9b7d-11d421a1f071] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:03:36.038525 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-abbe9b77-135c-4710-8097-f1eea4938c36 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:36.041123 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-abbe9b77-135c-4710-8097-f1eea4938c36 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:36.044531 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-abbe9b77-135c-4710-8097-f1eea4938c36 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:36.045558 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-abbe9b77-135c-4710-8097-f1eea4938c36 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:36.149921 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.wsgi [None req-abbe9b77-135c-4710-8097-f1eea4938c36 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] HTTP exception thrown: Instance da72692d-5ac7-4e8e-9b7d-11d421a1f071 could not be found. Nov 23 13:03:36.150866 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-abbe9b77-135c-4710-8097-f1eea4938c36 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Returning 404 to user: Instance da72692d-5ac7-4e8e-9b7d-11d421a1f071 could not be found. {{(pid=100974) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Nov 23 13:03:36.152040 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-abbe9b77-135c-4710-8097-f1eea4938c36 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/da72692d-5ac7-4e8e-9b7d-11d421a1f071" status: 404 len: 111 microversion: 2.1 time: 0.132751 Nov 23 13:03:36.155570 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 333/713] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:03:36 2021] GET /compute/v2.1/servers/da72692d-5ac7-4e8e-9b7d-11d421a1f071 => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 13:03:36.261945 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [req-6d80ca5a-6f5c-4436-a72b-76a5b05e7b47 req-2beb788c-3491-49a4-af5f-a424dd24cacd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a3c40e3-d194-4953-be2a-355e3cd882d7", "tag": "9334a9ef-7661-4c37-bee0-88d739f97311"}]} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:03:36.264221 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 13:03:36.264221 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: warnings.warn(msg) Nov 23 13:03:36.286328 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [req-6d80ca5a-6f5c-4436-a72b-76a5b05e7b47 req-2beb788c-3491-49a4-af5f-a424dd24cacd service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:36.288705 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [req-6d80ca5a-6f5c-4436-a72b-76a5b05e7b47 req-2beb788c-3491-49a4-af5f-a424dd24cacd service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:36.340100 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.compute.server_external_events [req-6d80ca5a-6f5c-4436-a72b-76a5b05e7b47 req-2beb788c-3491-49a4-af5f-a424dd24cacd service nova] Creating event network-changed:9334a9ef-7661-4c37-bee0-88d739f97311 for instance 5a3c40e3-d194-4953-be2a-355e3cd882d7 on hv-cinder-81888 Nov 23 13:03:36.364556 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [req-6d80ca5a-6f5c-4436-a72b-76a5b05e7b47 req-2beb788c-3491-49a4-af5f-a424dd24cacd service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106587 Nov 23 13:03:36.366883 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 334/714] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Nov 23 13:03:36 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 13:03:36.428938 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-347f6149-f647-4f5b-a138-084ab99acb3e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:03:36.445194 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-347f6149-f647-4f5b-a138-084ab99acb3e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:03:36.462699 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-347f6149-f647-4f5b-a138-084ab99acb3e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:03:36.464572 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-347f6149-f647-4f5b-a138-084ab99acb3e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1723 microversion: 2.20 time: 1.297981 Nov 23 13:03:36.466186 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 381/715] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:03:35 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1723 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:03:37.484708 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-2241e393-7483-4ff2-8d3c-eaf857d913f1 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:03:37.485968 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-2241e393-7483-4ff2-8d3c-eaf857d913f1 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:03:37.508980 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2241e393-7483-4ff2-8d3c-eaf857d913f1 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:37.509477 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2241e393-7483-4ff2-8d3c-eaf857d913f1 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:37.510305 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2241e393-7483-4ff2-8d3c-eaf857d913f1 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:37.522367 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2241e393-7483-4ff2-8d3c-eaf857d913f1 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:37.739281 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-f4c24cea-b327-4051-8d50-25117b8f4aa3 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:03:37.739903 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-f4c24cea-b327-4051-8d50-25117b8f4aa3 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: a3b02d0f-db9d-4996-a245-7237e989670d] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:03:37.754669 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f4c24cea-b327-4051-8d50-25117b8f4aa3 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:37.761892 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f4c24cea-b327-4051-8d50-25117b8f4aa3 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:37.771746 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f4c24cea-b327-4051-8d50-25117b8f4aa3 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:37.789147 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f4c24cea-b327-4051-8d50-25117b8f4aa3 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:38.053682 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-f4c24cea-b327-4051-8d50-25117b8f4aa3 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: a3b02d0f-db9d-4996-a245-7237e989670d] Going to try to terminate instance {{(pid=100973) delete /opt/stack/nova/nova/compute/api.py:2562}} Nov 23 13:03:38.347524 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-f4c24cea-b327-4051-8d50-25117b8f4aa3 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "DELETE /compute/v2.1/servers/a3b02d0f-db9d-4996-a245-7237e989670d" status: 204 len: 0 microversion: 2.1 time: 0.612466 Nov 23 13:03:38.355199 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 382/716] 10.222.0.60 () {58 vars in 1238 bytes} [Tue Nov 23 13:03:37 2021] DELETE /compute/v2.1/servers/a3b02d0f-db9d-4996-a245-7237e989670d => generated 0 bytes in 621 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 23 13:03:38.364940 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-0bd1a93e-13c3-4bce-b368-bae2dd269501 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:03:38.365646 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-0bd1a93e-13c3-4bce-b368-bae2dd269501 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: a3b02d0f-db9d-4996-a245-7237e989670d] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:03:38.379884 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0bd1a93e-13c3-4bce-b368-bae2dd269501 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:38.380355 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0bd1a93e-13c3-4bce-b368-bae2dd269501 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:38.392548 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0bd1a93e-13c3-4bce-b368-bae2dd269501 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:38.405836 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0bd1a93e-13c3-4bce-b368-bae2dd269501 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:38.435544 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-2241e393-7483-4ff2-8d3c-eaf857d913f1 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:03:38.452721 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-2241e393-7483-4ff2-8d3c-eaf857d913f1 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:03:38.454377 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-2241e393-7483-4ff2-8d3c-eaf857d913f1 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:03:38.455544 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-2241e393-7483-4ff2-8d3c-eaf857d913f1 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1723 microversion: 2.20 time: 0.975737 Nov 23 13:03:38.456268 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 335/717] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:03:37 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1723 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:03:38.875887 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-0bd1a93e-13c3-4bce-b368-bae2dd269501 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c023f89fd3da4bc8b38963bed4e5cc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a31364455dc442f8df299a8ad758a4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:03:38.895714 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-0bd1a93e-13c3-4bce-b368-bae2dd269501 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/a3b02d0f-db9d-4996-a245-7237e989670d" status: 200 len: 1513 microversion: 2.1 time: 0.536180 Nov 23 13:03:38.896328 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 383/718] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:03:38 2021] GET /compute/v2.1/servers/a3b02d0f-db9d-4996-a245-7237e989670d => generated 1513 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 13:03:39.474250 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-234b8e06-1231-4459-b618-8094490f0e33 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:03:39.475940 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-234b8e06-1231-4459-b618-8094490f0e33 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:03:39.495216 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-234b8e06-1231-4459-b618-8094490f0e33 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:39.495826 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-234b8e06-1231-4459-b618-8094490f0e33 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:39.509348 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-234b8e06-1231-4459-b618-8094490f0e33 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:39.509864 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-234b8e06-1231-4459-b618-8094490f0e33 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:39.913813 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-b6b1b8af-651c-419b-b3ac-b84cbac14e0c tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:03:39.914700 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-b6b1b8af-651c-419b-b3ac-b84cbac14e0c tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: a3b02d0f-db9d-4996-a245-7237e989670d] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:03:39.934382 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b6b1b8af-651c-419b-b3ac-b84cbac14e0c tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:39.935005 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b6b1b8af-651c-419b-b3ac-b84cbac14e0c tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:39.935632 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b6b1b8af-651c-419b-b3ac-b84cbac14e0c tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:39.936057 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b6b1b8af-651c-419b-b3ac-b84cbac14e0c tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:40.412689 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-b6b1b8af-651c-419b-b3ac-b84cbac14e0c tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c023f89fd3da4bc8b38963bed4e5cc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a31364455dc442f8df299a8ad758a4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:03:40.426158 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-b6b1b8af-651c-419b-b3ac-b84cbac14e0c tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/a3b02d0f-db9d-4996-a245-7237e989670d" status: 200 len: 1513 microversion: 2.1 time: 0.515794 Nov 23 13:03:40.442305 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 384/719] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:03:39 2021] GET /compute/v2.1/servers/a3b02d0f-db9d-4996-a245-7237e989670d => generated 1513 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 13:03:40.727025 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-234b8e06-1231-4459-b618-8094490f0e33 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:03:40.740657 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-234b8e06-1231-4459-b618-8094490f0e33 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:03:40.749979 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-234b8e06-1231-4459-b618-8094490f0e33 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:03:40.751591 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-234b8e06-1231-4459-b618-8094490f0e33 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1723 microversion: 2.20 time: 1.281419 Nov 23 13:03:40.764898 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 336/720] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:03:39 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1723 bytes in 1295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:03:41.446571 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-c6a26971-34de-4cbe-b474-2b2bcc0817b5 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:03:41.447348 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-c6a26971-34de-4cbe-b474-2b2bcc0817b5 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: a3b02d0f-db9d-4996-a245-7237e989670d] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:03:41.464202 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c6a26971-34de-4cbe-b474-2b2bcc0817b5 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:41.467030 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c6a26971-34de-4cbe-b474-2b2bcc0817b5 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:41.470257 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c6a26971-34de-4cbe-b474-2b2bcc0817b5 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:41.473164 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c6a26971-34de-4cbe-b474-2b2bcc0817b5 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:41.771060 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-5bec8188-e7e9-4484-93a7-63f3af28badf tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:03:41.772520 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-5bec8188-e7e9-4484-93a7-63f3af28badf tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:03:41.798247 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5bec8188-e7e9-4484-93a7-63f3af28badf tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:41.803094 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5bec8188-e7e9-4484-93a7-63f3af28badf tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:41.811740 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5bec8188-e7e9-4484-93a7-63f3af28badf tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:41.817284 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5bec8188-e7e9-4484-93a7-63f3af28badf tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:42.113943 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-c6a26971-34de-4cbe-b474-2b2bcc0817b5 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c023f89fd3da4bc8b38963bed4e5cc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a31364455dc442f8df299a8ad758a4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:03:42.127186 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-c6a26971-34de-4cbe-b474-2b2bcc0817b5 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/a3b02d0f-db9d-4996-a245-7237e989670d" status: 200 len: 1513 microversion: 2.1 time: 0.684624 Nov 23 13:03:42.138283 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 385/721] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:03:41 2021] GET /compute/v2.1/servers/a3b02d0f-db9d-4996-a245-7237e989670d => generated 1513 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:03:42.628840 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [req-0ca3bc96-7209-4b35-91b5-12a16d8d9e8f req-05e7da09-4201-4e6f-b5c6-b3ffc06e8e8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3b02d0f-db9d-4996-a245-7237e989670d", "name": "network-vif-deleted", "tag": "2c117b14-8ae9-4517-8547-e104cbcb9a21"}]} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:03:42.631112 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 13:03:42.631112 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: warnings.warn(msg) Nov 23 13:03:42.644874 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [req-0ca3bc96-7209-4b35-91b5-12a16d8d9e8f req-05e7da09-4201-4e6f-b5c6-b3ffc06e8e8b service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:42.645603 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [req-0ca3bc96-7209-4b35-91b5-12a16d8d9e8f req-05e7da09-4201-4e6f-b5c6-b3ffc06e8e8b service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:42.662978 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.compute.server_external_events [req-0ca3bc96-7209-4b35-91b5-12a16d8d9e8f req-05e7da09-4201-4e6f-b5c6-b3ffc06e8e8b service nova] Creating event network-vif-deleted:2c117b14-8ae9-4517-8547-e104cbcb9a21 for instance a3b02d0f-db9d-4996-a245-7237e989670d on hv-cinder-81888 Nov 23 13:03:42.673856 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [req-0ca3bc96-7209-4b35-91b5-12a16d8d9e8f req-05e7da09-4201-4e6f-b5c6-b3ffc06e8e8b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048714 Nov 23 13:03:42.675047 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 386/722] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Nov 23 13:03:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 13:03:42.745129 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-5bec8188-e7e9-4484-93a7-63f3af28badf tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:03:42.768408 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-5bec8188-e7e9-4484-93a7-63f3af28badf tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:03:42.770950 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-5bec8188-e7e9-4484-93a7-63f3af28badf tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:03:42.777029 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-5bec8188-e7e9-4484-93a7-63f3af28badf tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1723 microversion: 2.20 time: 1.010387 Nov 23 13:03:42.793039 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 337/723] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:03:41 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1723 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:03:43.147317 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-8f04f42e-a7bf-405b-81a4-1b46bc1e5317 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:03:43.148104 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-8f04f42e-a7bf-405b-81a4-1b46bc1e5317 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: a3b02d0f-db9d-4996-a245-7237e989670d] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:03:43.166652 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8f04f42e-a7bf-405b-81a4-1b46bc1e5317 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:43.167256 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8f04f42e-a7bf-405b-81a4-1b46bc1e5317 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:43.168075 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8f04f42e-a7bf-405b-81a4-1b46bc1e5317 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:43.168549 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8f04f42e-a7bf-405b-81a4-1b46bc1e5317 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:43.260727 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8f04f42e-a7bf-405b-81a4-1b46bc1e5317 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:43.261171 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8f04f42e-a7bf-405b-81a4-1b46bc1e5317 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:43.261630 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.objects.instance [None req-8f04f42e-a7bf-405b-81a4-1b46bc1e5317 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lazy-loading 'fault' on Instance uuid a3b02d0f-db9d-4996-a245-7237e989670d {{(pid=100973) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 23 13:03:43.394344 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-8f04f42e-a7bf-405b-81a4-1b46bc1e5317 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c023f89fd3da4bc8b38963bed4e5cc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a31364455dc442f8df299a8ad758a4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:03:43.410864 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-8f04f42e-a7bf-405b-81a4-1b46bc1e5317 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/a3b02d0f-db9d-4996-a245-7237e989670d" status: 200 len: 1307 microversion: 2.1 time: 0.262689 Nov 23 13:03:43.422021 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 387/724] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:03:43 2021] GET /compute/v2.1/servers/a3b02d0f-db9d-4996-a245-7237e989670d => generated 1307 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 13:03:43.800581 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-f0bc39a2-4500-4b02-b5c4-4b9d2cf3c544 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:03:43.801453 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-f0bc39a2-4500-4b02-b5c4-4b9d2cf3c544 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:03:43.816838 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f0bc39a2-4500-4b02-b5c4-4b9d2cf3c544 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:43.817624 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f0bc39a2-4500-4b02-b5c4-4b9d2cf3c544 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:43.818610 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f0bc39a2-4500-4b02-b5c4-4b9d2cf3c544 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:43.819237 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f0bc39a2-4500-4b02-b5c4-4b9d2cf3c544 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:44.095070 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-f0bc39a2-4500-4b02-b5c4-4b9d2cf3c544 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:03:44.105760 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-f0bc39a2-4500-4b02-b5c4-4b9d2cf3c544 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:03:44.107566 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-f0bc39a2-4500-4b02-b5c4-4b9d2cf3c544 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:03:44.108913 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-f0bc39a2-4500-4b02-b5c4-4b9d2cf3c544 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1723 microversion: 2.20 time: 0.312477 Nov 23 13:03:44.121269 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 338/725] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:03:43 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1723 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:03:44.429461 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-636f2523-6736-4619-a53e-729952490213 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:03:44.430495 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-636f2523-6736-4619-a53e-729952490213 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] [instance: a3b02d0f-db9d-4996-a245-7237e989670d] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:03:44.446816 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-636f2523-6736-4619-a53e-729952490213 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:44.447702 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-636f2523-6736-4619-a53e-729952490213 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:44.448645 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-636f2523-6736-4619-a53e-729952490213 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:44.452027 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-636f2523-6736-4619-a53e-729952490213 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:44.518736 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.wsgi [None req-636f2523-6736-4619-a53e-729952490213 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] HTTP exception thrown: Instance a3b02d0f-db9d-4996-a245-7237e989670d could not be found. Nov 23 13:03:44.519699 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-636f2523-6736-4619-a53e-729952490213 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] Returning 404 to user: Instance a3b02d0f-db9d-4996-a245-7237e989670d could not be found. {{(pid=100973) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Nov 23 13:03:44.520746 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-636f2523-6736-4619-a53e-729952490213 tempest-AttachVolumeNegativeTest-1497788275 tempest-AttachVolumeNegativeTest-1497788275-project] 10.222.0.60 "GET /compute/v2.1/servers/a3b02d0f-db9d-4996-a245-7237e989670d" status: 404 len: 111 microversion: 2.1 time: 0.095831 Nov 23 13:03:44.521486 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 388/726] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:03:44 2021] GET /compute/v2.1/servers/a3b02d0f-db9d-4996-a245-7237e989670d => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 13:03:45.135332 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-a7580434-ff02-4596-92a3-fabbd81c999d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:03:45.136543 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-a7580434-ff02-4596-92a3-fabbd81c999d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:03:45.157802 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a7580434-ff02-4596-92a3-fabbd81c999d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:45.158207 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a7580434-ff02-4596-92a3-fabbd81c999d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:45.159005 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a7580434-ff02-4596-92a3-fabbd81c999d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:45.159556 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a7580434-ff02-4596-92a3-fabbd81c999d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:45.773889 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-a7580434-ff02-4596-92a3-fabbd81c999d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:03:45.797419 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-a7580434-ff02-4596-92a3-fabbd81c999d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:03:45.799409 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-a7580434-ff02-4596-92a3-fabbd81c999d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:03:45.800980 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-a7580434-ff02-4596-92a3-fabbd81c999d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1723 microversion: 2.20 time: 0.675549 Nov 23 13:03:45.814850 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 339/727] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:03:45 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1723 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:03:46.836556 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-16156273-f703-4e2e-9596-52162f22455e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:03:46.838761 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-16156273-f703-4e2e-9596-52162f22455e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:03:46.863199 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-16156273-f703-4e2e-9596-52162f22455e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:46.864303 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-16156273-f703-4e2e-9596-52162f22455e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:46.865827 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-16156273-f703-4e2e-9596-52162f22455e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:46.866763 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-16156273-f703-4e2e-9596-52162f22455e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:47.354594 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-16156273-f703-4e2e-9596-52162f22455e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:03:47.364304 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-16156273-f703-4e2e-9596-52162f22455e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:03:47.366305 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-16156273-f703-4e2e-9596-52162f22455e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:03:47.368086 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-16156273-f703-4e2e-9596-52162f22455e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1744 microversion: 2.20 time: 0.550980 Nov 23 13:03:47.368821 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 389/728] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:03:46 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1744 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:03:48.387301 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-74e0d8ad-58e6-4bca-b31a-5a0970d3dde7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:03:48.388910 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-74e0d8ad-58e6-4bca-b31a-5a0970d3dde7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:03:48.406476 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-74e0d8ad-58e6-4bca-b31a-5a0970d3dde7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:48.408097 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-74e0d8ad-58e6-4bca-b31a-5a0970d3dde7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:48.410128 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-74e0d8ad-58e6-4bca-b31a-5a0970d3dde7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:48.412181 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-74e0d8ad-58e6-4bca-b31a-5a0970d3dde7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:48.708047 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-74e0d8ad-58e6-4bca-b31a-5a0970d3dde7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:03:48.721153 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-74e0d8ad-58e6-4bca-b31a-5a0970d3dde7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:03:48.724313 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-74e0d8ad-58e6-4bca-b31a-5a0970d3dde7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:03:48.725893 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-74e0d8ad-58e6-4bca-b31a-5a0970d3dde7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1744 microversion: 2.20 time: 0.342703 Nov 23 13:03:48.739493 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 340/729] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:03:48 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1744 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:03:49.748894 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-cad0fede-eefc-472e-93f8-75a6a34e9b44 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:03:49.750174 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-cad0fede-eefc-472e-93f8-75a6a34e9b44 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:03:49.770051 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-cad0fede-eefc-472e-93f8-75a6a34e9b44 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:49.770501 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-cad0fede-eefc-472e-93f8-75a6a34e9b44 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:49.771289 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-cad0fede-eefc-472e-93f8-75a6a34e9b44 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:49.771736 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-cad0fede-eefc-472e-93f8-75a6a34e9b44 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:50.192786 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-4eef01f1-f853-40eb-89e8-14ccb664c67e tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Action: 'create', calling method: .version_select at 0x7f1870382d30>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1807990828"}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:03:50.223544 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.quota [None req-4eef01f1-f853-40eb-89e8-14ccb664c67e tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Getting quotas for project 13128fc1ba014300bfb802722969331f. Resources: {'key_pairs'} {{(pid=100974) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 13:03:50.228329 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.quota [None req-4eef01f1-f853-40eb-89e8-14ccb664c67e tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Getting quotas for user b10dad24cdfa4e128b19e01548066a84 and project 13128fc1ba014300bfb802722969331f. Resources: {'key_pairs'} {{(pid=100974) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 13:03:50.274128 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-cad0fede-eefc-472e-93f8-75a6a34e9b44 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:03:50.283663 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-cad0fede-eefc-472e-93f8-75a6a34e9b44 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:03:50.285523 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-cad0fede-eefc-472e-93f8-75a6a34e9b44 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:03:50.286821 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-cad0fede-eefc-472e-93f8-75a6a34e9b44 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1744 microversion: 2.20 time: 0.545411 Nov 23 13:03:50.298317 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 390/730] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:03:49 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1744 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:03:50.442615 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.quota [None req-4eef01f1-f853-40eb-89e8-14ccb664c67e tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Getting quotas for project 13128fc1ba014300bfb802722969331f. Resources: {'key_pairs'} {{(pid=100974) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 13:03:50.447408 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.quota [None req-4eef01f1-f853-40eb-89e8-14ccb664c67e tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Getting quotas for user b10dad24cdfa4e128b19e01548066a84 and project 13128fc1ba014300bfb802722969331f. Resources: {'key_pairs'} {{(pid=100974) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 13:03:50.462059 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-4eef01f1-f853-40eb-89e8-14ccb664c67e tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 0.273141 Nov 23 13:03:50.462651 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 341/731] 10.222.0.60 () {60 vars in 1157 bytes} [Tue Nov 23 13:03:50 2021] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 13:03:50.592363 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-d79b9841-d194-421f-b311-510d0d55b54c tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-84377050", "imageRef": "a308d783-e9fb-457b-b54c-bbe1843c23bd", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1807990828", "networks": [{"uuid": "80f788ec-a296-4d2f-963c-ac1dae70507a"}]}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:03:50.663760 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.network.neutron [None req-d79b9841-d194-421f-b311-510d0d55b54c tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] validate_networks() for [('80f788ec-a296-4d2f-963c-ac1dae70507a', None, None, None)] {{(pid=100973) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Nov 23 13:03:51.308474 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-d0608896-22a2-40c5-8fff-4dee9c135174 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:03:51.309853 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-d0608896-22a2-40c5-8fff-4dee9c135174 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:03:51.318829 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d0608896-22a2-40c5-8fff-4dee9c135174 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:51.319627 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d0608896-22a2-40c5-8fff-4dee9c135174 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:51.320702 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d0608896-22a2-40c5-8fff-4dee9c135174 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:51.321338 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d0608896-22a2-40c5-8fff-4dee9c135174 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:51.581613 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-d0608896-22a2-40c5-8fff-4dee9c135174 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:03:51.592006 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-d0608896-22a2-40c5-8fff-4dee9c135174 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:03:51.593631 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-d0608896-22a2-40c5-8fff-4dee9c135174 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:03:51.594881 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-d0608896-22a2-40c5-8fff-4dee9c135174 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1744 microversion: 2.20 time: 0.293130 Nov 23 13:03:51.596663 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 342/732] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:03:51 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1744 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:03:51.604422 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-5b5a5696-0aca-45da-9aee-f801748987bf tempest-VolumesTestJSON-204964216 tempest-VolumesTestJSON-204964216-project] Calling method '.version_select at 0x7f18703824c0>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:03:51.709496 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-5b5a5696-0aca-45da-9aee-f801748987bf tempest-VolumesTestJSON-204964216 tempest-VolumesTestJSON-204964216-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/3180f8b4-e153-4a26-aae2-a634fdd9c3f1" status: 200 len: 351 microversion: 2.1 time: 0.111463 Nov 23 13:03:51.710346 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 343/733] 10.222.0.60 () {58 vars in 1244 bytes} [Tue Nov 23 13:03:51 2021] GET /compute/v2.1/os-volumes/3180f8b4-e153-4a26-aae2-a634fdd9c3f1 => generated 351 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 13:03:51.719162 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [req-f9204605-e5ae-4aeb-aad3-d51c48713345 req-b08d7c57-89ca-4cc5-b7da-2e24e10b3dfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9c21729-a176-4e26-9074-f5f0bfc0ce20", "name": "network-vif-plugged", "status": "completed", "tag": "acc6c8bf-82a2-4f88-b12e-f6a39d6ce970"}]} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:03:51.720753 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 13:03:51.720753 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: warnings.warn(msg) Nov 23 13:03:51.730073 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [req-f9204605-e5ae-4aeb-aad3-d51c48713345 req-b08d7c57-89ca-4cc5-b7da-2e24e10b3dfd service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:51.730514 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [req-f9204605-e5ae-4aeb-aad3-d51c48713345 req-b08d7c57-89ca-4cc5-b7da-2e24e10b3dfd service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:51.749251 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.compute.server_external_events [req-f9204605-e5ae-4aeb-aad3-d51c48713345 req-b08d7c57-89ca-4cc5-b7da-2e24e10b3dfd service nova] Creating event network-vif-plugged:acc6c8bf-82a2-4f88-b12e-f6a39d6ce970 for instance b9c21729-a176-4e26-9074-f5f0bfc0ce20 on hv-cinder-81888 Nov 23 13:03:51.754031 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [req-f9204605-e5ae-4aeb-aad3-d51c48713345 req-b08d7c57-89ca-4cc5-b7da-2e24e10b3dfd service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042407 Nov 23 13:03:51.754626 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 344/734] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Nov 23 13:03:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 13:03:51.772886 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.virt.hardware [None req-d79b9841-d194-421f-b311-510d0d55b54c tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Flavor limits 0:0:0 {{(pid=100973) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 23 13:03:51.773961 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.virt.hardware [None req-d79b9841-d194-421f-b311-510d0d55b54c tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Image limits 0:0:0 {{(pid=100973) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 23 13:03:51.774441 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.virt.hardware [None req-d79b9841-d194-421f-b311-510d0d55b54c tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Flavor pref 0:0:0 {{(pid=100973) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 23 13:03:51.775027 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.virt.hardware [None req-d79b9841-d194-421f-b311-510d0d55b54c tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Image pref 0:0:0 {{(pid=100973) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 23 13:03:51.775452 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.virt.hardware [None req-d79b9841-d194-421f-b311-510d0d55b54c tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100973) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 23 13:03:51.787022 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d79b9841-d194-421f-b311-510d0d55b54c tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:51.787561 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d79b9841-d194-421f-b311-510d0d55b54c tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:51.788483 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d79b9841-d194-421f-b311-510d0d55b54c tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:51.789088 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d79b9841-d194-421f-b311-510d0d55b54c tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:51.811042 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.quota [None req-d79b9841-d194-421f-b311-510d0d55b54c tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Getting quotas for project 13128fc1ba014300bfb802722969331f. Resources: {'ram', 'cores', 'instances'} {{(pid=100973) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 13:03:51.815404 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.quota [None req-d79b9841-d194-421f-b311-510d0d55b54c tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Getting quotas for user b10dad24cdfa4e128b19e01548066a84 and project 13128fc1ba014300bfb802722969331f. Resources: {'ram', 'cores', 'instances'} {{(pid=100973) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 13:03:51.834710 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-d79b9841-d194-421f-b311-510d0d55b54c tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Going to run 1 instances... {{(pid=100973) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Nov 23 13:03:51.837239 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-d79b9841-d194-421f-b311-510d0d55b54c tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a308d783-e9fb-457b-b54c-bbe1843c23bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100973) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Nov 23 13:03:51.888633 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-d79b9841-d194-421f-b311-510d0d55b54c tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.300257 Nov 23 13:03:51.889474 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 391/735] 10.222.0.60 () {60 vars in 1146 bytes} [Tue Nov 23 13:03:50 2021] POST /compute/v2.1/servers => generated 380 bytes in 1302 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 23 13:03:51.901013 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-a1f8085a-fd6c-4119-b4aa-8309730fd084 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:03:51.902034 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-a1f8085a-fd6c-4119-b4aa-8309730fd084 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:03:51.996329 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-a1f8085a-fd6c-4119-b4aa-8309730fd084 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:03:52.015991 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-a1f8085a-fd6c-4119-b4aa-8309730fd084 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1257 microversion: 2.1 time: 0.118596 Nov 23 13:03:52.017151 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 345/736] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:03:51 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1257 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:03:52.616051 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-7f6935ed-3bd7-47ee-9db2-f6c83fc9a443 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:03:52.617042 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-7f6935ed-3bd7-47ee-9db2-f6c83fc9a443 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:03:52.625523 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-7f6935ed-3bd7-47ee-9db2-f6c83fc9a443 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:52.625976 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-7f6935ed-3bd7-47ee-9db2-f6c83fc9a443 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:52.627116 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-7f6935ed-3bd7-47ee-9db2-f6c83fc9a443 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:52.627553 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-7f6935ed-3bd7-47ee-9db2-f6c83fc9a443 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:52.956032 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-7f6935ed-3bd7-47ee-9db2-f6c83fc9a443 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:03:52.967271 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-7f6935ed-3bd7-47ee-9db2-f6c83fc9a443 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:03:52.969024 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-7f6935ed-3bd7-47ee-9db2-f6c83fc9a443 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:03:52.970352 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-7f6935ed-3bd7-47ee-9db2-f6c83fc9a443 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1744 microversion: 2.20 time: 0.358490 Nov 23 13:03:52.971342 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 392/737] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:03:52 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1744 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:03:53.033691 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-223cb7b3-0018-46d1-b552-363483ba1cfc tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:03:53.034318 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-223cb7b3-0018-46d1-b552-363483ba1cfc tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:03:53.043217 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-223cb7b3-0018-46d1-b552-363483ba1cfc tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:53.043886 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-223cb7b3-0018-46d1-b552-363483ba1cfc tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:53.044855 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-223cb7b3-0018-46d1-b552-363483ba1cfc tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:53.045718 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-223cb7b3-0018-46d1-b552-363483ba1cfc tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:53.168952 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-223cb7b3-0018-46d1-b552-363483ba1cfc tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:03:53.181794 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-223cb7b3-0018-46d1-b552-363483ba1cfc tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1309 microversion: 2.1 time: 0.151200 Nov 23 13:03:53.181794 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 346/738] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:03:53 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1309 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:03:53.322593 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-1f8057b3-480b-4608-a479-8fc9d8199c49 tempest-VolumesTestJSON-204964216 tempest-VolumesTestJSON-204964216-project] Calling method '.version_select at 0x7f1870191b80>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:03:53.480591 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-1f8057b3-480b-4608-a479-8fc9d8199c49 tempest-VolumesTestJSON-204964216 tempest-VolumesTestJSON-204964216-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/f4626c80-3055-44bb-a9d1-db41a30f14b2" status: 200 len: 350 microversion: 2.1 time: 0.161732 Nov 23 13:03:53.492357 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 393/739] 10.222.0.60 () {58 vars in 1244 bytes} [Tue Nov 23 13:03:53 2021] GET /compute/v2.1/os-volumes/f4626c80-3055-44bb-a9d1-db41a30f14b2 => generated 350 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 13:03:53.990106 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-67ed588d-acbf-429c-8a81-3cec6039d7d4 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:03:53.990897 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-67ed588d-acbf-429c-8a81-3cec6039d7d4 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:03:54.008410 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-67ed588d-acbf-429c-8a81-3cec6039d7d4 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:54.010492 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-67ed588d-acbf-429c-8a81-3cec6039d7d4 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:54.012791 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-67ed588d-acbf-429c-8a81-3cec6039d7d4 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:54.016098 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-67ed588d-acbf-429c-8a81-3cec6039d7d4 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:54.200822 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-5c66b356-f60c-4efc-a42f-cd23a064d0b1 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:03:54.201533 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-5c66b356-f60c-4efc-a42f-cd23a064d0b1 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:03:54.216944 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5c66b356-f60c-4efc-a42f-cd23a064d0b1 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:54.217611 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5c66b356-f60c-4efc-a42f-cd23a064d0b1 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:54.219011 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5c66b356-f60c-4efc-a42f-cd23a064d0b1 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:54.219870 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5c66b356-f60c-4efc-a42f-cd23a064d0b1 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:54.424598 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-5c66b356-f60c-4efc-a42f-cd23a064d0b1 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:03:54.438256 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-5c66b356-f60c-4efc-a42f-cd23a064d0b1 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1315 microversion: 2.1 time: 0.241231 Nov 23 13:03:54.439206 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 394/740] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:03:54 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1315 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:03:54.633682 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-67ed588d-acbf-429c-8a81-3cec6039d7d4 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:03:54.649227 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-67ed588d-acbf-429c-8a81-3cec6039d7d4 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:03:54.664327 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-67ed588d-acbf-429c-8a81-3cec6039d7d4 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:03:54.677194 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-67ed588d-acbf-429c-8a81-3cec6039d7d4 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1739 microversion: 2.20 time: 0.691516 Nov 23 13:03:54.681584 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 347/741] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:03:53 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1739 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:03:55.376756 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-fb72e4a7-52ac-4210-8341-081f70f08dcd tempest-VolumesTestJSON-204964216 tempest-VolumesTestJSON-204964216-project] Calling method '.version_select at 0x7f18703ac3a0>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:03:55.458985 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-0f73b9c9-94b4-4eb8-8d58-96a2f6ed36ea tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:03:55.459997 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-0f73b9c9-94b4-4eb8-8d58-96a2f6ed36ea tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:03:55.467946 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0f73b9c9-94b4-4eb8-8d58-96a2f6ed36ea tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:55.468694 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0f73b9c9-94b4-4eb8-8d58-96a2f6ed36ea tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:55.469803 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0f73b9c9-94b4-4eb8-8d58-96a2f6ed36ea tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:55.470399 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0f73b9c9-94b4-4eb8-8d58-96a2f6ed36ea tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:55.533519 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-fb72e4a7-52ac-4210-8341-081f70f08dcd tempest-VolumesTestJSON-204964216 tempest-VolumesTestJSON-204964216-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/b2a2aab9-0112-4294-bd6e-b5ecc37bb468" status: 200 len: 350 microversion: 2.1 time: 0.161564 Nov 23 13:03:55.534941 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 395/742] 10.222.0.60 () {58 vars in 1244 bytes} [Tue Nov 23 13:03:55 2021] GET /compute/v2.1/os-volumes/b2a2aab9-0112-4294-bd6e-b5ecc37bb468 => generated 350 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 13:03:55.547238 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-853664ee-b93d-4c01-b396-7b3bfc37511f tempest-VolumesTestJSON-204964216 tempest-VolumesTestJSON-204964216-project] Calling method '.version_select at 0x7f18705f20d0>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:03:55.682362 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-853664ee-b93d-4c01-b396-7b3bfc37511f tempest-VolumesTestJSON-204964216 tempest-VolumesTestJSON-204964216-project] 10.222.0.60 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.138909 Nov 23 13:03:55.683384 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 396/743] 10.222.0.60 () {58 vars in 1133 bytes} [Tue Nov 23 13:03:55 2021] GET /compute/v2.1/os-volumes => generated 1034 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 13:03:55.699643 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-5a24c654-f775-4987-b55b-463898d4fd8f tempest-VolumesTestJSON-204964216 tempest-VolumesTestJSON-204964216-project] Calling method '.version_select at 0x7f187023e700>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:03:55.857200 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-5a24c654-f775-4987-b55b-463898d4fd8f tempest-VolumesTestJSON-204964216 tempest-VolumesTestJSON-204964216-project] 10.222.0.60 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.162991 Nov 23 13:03:55.858313 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 397/744] 10.222.0.60 () {58 vars in 1148 bytes} [Tue Nov 23 13:03:55 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 13:03:55.891717 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-878a4402-1816-4e73-b749-6fe06a67e5ba tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:03:55.893773 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-878a4402-1816-4e73-b749-6fe06a67e5ba tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:03:55.916485 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-878a4402-1816-4e73-b749-6fe06a67e5ba tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:55.918878 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-878a4402-1816-4e73-b749-6fe06a67e5ba tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:55.920030 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-878a4402-1816-4e73-b749-6fe06a67e5ba tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:55.921568 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-878a4402-1816-4e73-b749-6fe06a67e5ba tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:56.304680 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-0f73b9c9-94b4-4eb8-8d58-96a2f6ed36ea tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:03:56.323335 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-0f73b9c9-94b4-4eb8-8d58-96a2f6ed36ea tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1357 microversion: 2.1 time: 0.867910 Nov 23 13:03:56.330596 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 348/745] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:03:55 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1357 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:03:56.338079 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-a87ef567-1ecf-406b-8005-a8b551946c77 tempest-VolumesTestJSON-204964216 tempest-VolumesTestJSON-204964216-project] Calling method '.version_select at 0x7f18719798b0>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:03:56.369863 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-878a4402-1816-4e73-b749-6fe06a67e5ba tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:03:56.401935 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-878a4402-1816-4e73-b749-6fe06a67e5ba tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:03:56.404465 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-878a4402-1816-4e73-b749-6fe06a67e5ba tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:03:56.405814 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-878a4402-1816-4e73-b749-6fe06a67e5ba tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1739 microversion: 2.20 time: 0.546401 Nov 23 13:03:56.406973 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 398/746] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:03:55 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1739 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:03:56.471876 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-a87ef567-1ecf-406b-8005-a8b551946c77 tempest-VolumesTestJSON-204964216 tempest-VolumesTestJSON-204964216-project] 10.222.0.60 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.139795 Nov 23 13:03:56.472491 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 349/747] 10.222.0.60 () {58 vars in 1133 bytes} [Tue Nov 23 13:03:56 2021] GET /compute/v2.1/os-volumes => generated 1034 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:03:56.484815 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-5b1e4ae7-6865-4405-bf0b-4661f703d354 tempest-VolumesTestJSON-204964216 tempest-VolumesTestJSON-204964216-project] Calling method '.version_select at 0x7f1870406b80>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:03:56.489191 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [req-94229868-7859-44d6-ab0b-af8e10fadc11 req-17bc39ea-c9b8-41b1-873a-9b1844559dce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74e06412-022d-4ece-920d-1cba08639d76", "tag": "2f280c1a-d79b-4581-bd2b-add5ec70ac56"}]} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:03:56.519646 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 13:03:56.519646 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: warnings.warn(msg) Nov 23 13:03:56.551536 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [req-94229868-7859-44d6-ab0b-af8e10fadc11 req-17bc39ea-c9b8-41b1-873a-9b1844559dce service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:56.551986 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [req-94229868-7859-44d6-ab0b-af8e10fadc11 req-17bc39ea-c9b8-41b1-873a-9b1844559dce service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:56.596139 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.compute.server_external_events [req-94229868-7859-44d6-ab0b-af8e10fadc11 req-17bc39ea-c9b8-41b1-873a-9b1844559dce service nova] Creating event network-changed:2f280c1a-d79b-4581-bd2b-add5ec70ac56 for instance 74e06412-022d-4ece-920d-1cba08639d76 on hv-cinder-81888 Nov 23 13:03:56.602684 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [req-94229868-7859-44d6-ab0b-af8e10fadc11 req-17bc39ea-c9b8-41b1-873a-9b1844559dce service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121849 Nov 23 13:03:56.607558 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 399/748] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Nov 23 13:03:56 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 13:03:56.658275 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-5b1e4ae7-6865-4405-bf0b-4661f703d354 tempest-VolumesTestJSON-204964216 tempest-VolumesTestJSON-204964216-project] 10.222.0.60 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.177816 Nov 23 13:03:56.658899 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 350/749] 10.222.0.60 () {58 vars in 1166 bytes} [Tue Nov 23 13:03:56 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 13:03:56.671566 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-6ab9b3b6-cc6d-49c4-a476-98be2a3948d3 tempest-VolumesTestJSON-204964216 tempest-VolumesTestJSON-204964216-project] Calling method '.version_select at 0x7f18703ac430>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:03:56.811411 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-6ab9b3b6-cc6d-49c4-a476-98be2a3948d3 tempest-VolumesTestJSON-204964216 tempest-VolumesTestJSON-204964216-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.144096 Nov 23 13:03:56.819701 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 400/750] 10.222.0.60 () {58 vars in 1169 bytes} [Tue Nov 23 13:03:56 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 13:03:56.825847 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-d9d49706-225f-43d9-9402-8105545d86a8 tempest-VolumesTestJSON-204964216 tempest-VolumesTestJSON-204964216-project] Calling method '.version_select at 0x7f18702fe670>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:03:57.033065 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-d9d49706-225f-43d9-9402-8105545d86a8 tempest-VolumesTestJSON-204964216 tempest-VolumesTestJSON-204964216-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.211650 Nov 23 13:03:57.033949 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 351/751] 10.222.0.60 () {58 vars in 1154 bytes} [Tue Nov 23 13:03:56 2021] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 13:03:57.046319 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-59b859ba-8e1c-4f81-8666-1d313b2ad9da tempest-VolumesTestJSON-204964216 tempest-VolumesTestJSON-204964216-project] Calling method '.version_select at 0x7f18706bf5e0>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:03:57.217530 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-59b859ba-8e1c-4f81-8666-1d313b2ad9da tempest-VolumesTestJSON-204964216 tempest-VolumesTestJSON-204964216-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.175258 Nov 23 13:03:57.225431 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 401/752] 10.222.0.60 () {58 vars in 1187 bytes} [Tue Nov 23 13:03:57 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 13:03:57.232212 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-79b1fd24-5a95-4f35-8c0b-03260b8d1c5d tempest-VolumesTestJSON-204964216 tempest-VolumesTestJSON-204964216-project] Calling method '.version_select at 0x7f1870eb1e50>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:03:57.346960 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-fe560ed9-ef21-4bb1-af82-8ffb080c0f63 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:03:57.347690 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-fe560ed9-ef21-4bb1-af82-8ffb080c0f63 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:03:57.361720 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-fe560ed9-ef21-4bb1-af82-8ffb080c0f63 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:57.366337 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-fe560ed9-ef21-4bb1-af82-8ffb080c0f63 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:57.367652 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-fe560ed9-ef21-4bb1-af82-8ffb080c0f63 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:57.370039 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-fe560ed9-ef21-4bb1-af82-8ffb080c0f63 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:57.410976 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-79b1fd24-5a95-4f35-8c0b-03260b8d1c5d tempest-VolumesTestJSON-204964216 tempest-VolumesTestJSON-204964216-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.176762 Nov 23 13:03:57.413148 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 352/753] 10.222.0.60 () {58 vars in 1154 bytes} [Tue Nov 23 13:03:57 2021] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:03:57.436309 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-ebabb41d-f502-418d-a8d0-35f52eb5f983 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:03:57.437333 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-ebabb41d-f502-418d-a8d0-35f52eb5f983 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:03:57.493844 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ebabb41d-f502-418d-a8d0-35f52eb5f983 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:57.504350 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ebabb41d-f502-418d-a8d0-35f52eb5f983 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:57.513481 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ebabb41d-f502-418d-a8d0-35f52eb5f983 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:57.518420 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ebabb41d-f502-418d-a8d0-35f52eb5f983 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:57.926501 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-fe560ed9-ef21-4bb1-af82-8ffb080c0f63 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:03:57.939741 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-fe560ed9-ef21-4bb1-af82-8ffb080c0f63 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1357 microversion: 2.1 time: 0.596375 Nov 23 13:03:57.947621 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 402/754] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:03:57 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1357 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:03:58.719105 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-ebabb41d-f502-418d-a8d0-35f52eb5f983 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:03:58.778349 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-ebabb41d-f502-418d-a8d0-35f52eb5f983 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:03:58.781633 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-ebabb41d-f502-418d-a8d0-35f52eb5f983 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:03:58.791493 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-ebabb41d-f502-418d-a8d0-35f52eb5f983 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1739 microversion: 2.20 time: 1.360622 Nov 23 13:03:58.792828 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 353/755] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:03:57 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1739 bytes in 1365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 13:03:58.960947 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-0bc7f709-8059-4726-b2f4-15ec3deeebcc tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:03:58.961808 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-0bc7f709-8059-4726-b2f4-15ec3deeebcc tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:03:58.969968 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0bc7f709-8059-4726-b2f4-15ec3deeebcc tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:58.970421 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0bc7f709-8059-4726-b2f4-15ec3deeebcc tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:58.971403 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0bc7f709-8059-4726-b2f4-15ec3deeebcc tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:58.971989 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0bc7f709-8059-4726-b2f4-15ec3deeebcc tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:59.301490 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-0bc7f709-8059-4726-b2f4-15ec3deeebcc tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:03:59.311956 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-0bc7f709-8059-4726-b2f4-15ec3deeebcc tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1357 microversion: 2.1 time: 0.355210 Nov 23 13:03:59.313121 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 403/756] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:03:58 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1357 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:03:59.815082 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-8e2b3ef8-5389-43c8-8dec-f2bb9b9ed2c8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:03:59.816342 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-8e2b3ef8-5389-43c8-8dec-f2bb9b9ed2c8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:03:59.845374 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8e2b3ef8-5389-43c8-8dec-f2bb9b9ed2c8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:59.846065 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8e2b3ef8-5389-43c8-8dec-f2bb9b9ed2c8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:03:59.850063 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8e2b3ef8-5389-43c8-8dec-f2bb9b9ed2c8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:03:59.850943 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8e2b3ef8-5389-43c8-8dec-f2bb9b9ed2c8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:00.187869 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-8e2b3ef8-5389-43c8-8dec-f2bb9b9ed2c8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:00.203977 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-8e2b3ef8-5389-43c8-8dec-f2bb9b9ed2c8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:00.212769 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-8e2b3ef8-5389-43c8-8dec-f2bb9b9ed2c8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:00.214752 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-8e2b3ef8-5389-43c8-8dec-f2bb9b9ed2c8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1739 microversion: 2.20 time: 0.405949 Nov 23 13:04:00.226255 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 354/757] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:03:59 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1739 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:04:00.329746 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-eda7709f-3b1a-4c11-89a2-1d2e8bf83724 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:04:00.330378 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-eda7709f-3b1a-4c11-89a2-1d2e8bf83724 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:04:00.341025 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-eda7709f-3b1a-4c11-89a2-1d2e8bf83724 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:00.341727 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-eda7709f-3b1a-4c11-89a2-1d2e8bf83724 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:00.342686 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-eda7709f-3b1a-4c11-89a2-1d2e8bf83724 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:00.343268 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-eda7709f-3b1a-4c11-89a2-1d2e8bf83724 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:00.632051 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-eda7709f-3b1a-4c11-89a2-1d2e8bf83724 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:00.641656 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-eda7709f-3b1a-4c11-89a2-1d2e8bf83724 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1357 microversion: 2.1 time: 0.315883 Nov 23 13:04:00.642715 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 404/758] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:04:00 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1357 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 13:04:01.236073 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-8eb9bc8a-1f4a-4ccb-9bc0-bd100164123c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:04:01.237441 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-8eb9bc8a-1f4a-4ccb-9bc0-bd100164123c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:04:01.253868 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8eb9bc8a-1f4a-4ccb-9bc0-bd100164123c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:01.260193 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8eb9bc8a-1f4a-4ccb-9bc0-bd100164123c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:01.261345 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8eb9bc8a-1f4a-4ccb-9bc0-bd100164123c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:01.262051 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8eb9bc8a-1f4a-4ccb-9bc0-bd100164123c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:01.603519 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-8eb9bc8a-1f4a-4ccb-9bc0-bd100164123c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:01.614165 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-8eb9bc8a-1f4a-4ccb-9bc0-bd100164123c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:01.616012 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-8eb9bc8a-1f4a-4ccb-9bc0-bd100164123c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:01.617853 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-8eb9bc8a-1f4a-4ccb-9bc0-bd100164123c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1739 microversion: 2.20 time: 0.385716 Nov 23 13:04:01.630139 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 355/759] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:04:01 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1739 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:04:01.658913 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-052b8ee8-3d5b-48af-99c1-313f1ac0fe39 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:04:01.660256 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-052b8ee8-3d5b-48af-99c1-313f1ac0fe39 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:04:01.668873 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-052b8ee8-3d5b-48af-99c1-313f1ac0fe39 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:01.669602 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-052b8ee8-3d5b-48af-99c1-313f1ac0fe39 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:01.670568 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-052b8ee8-3d5b-48af-99c1-313f1ac0fe39 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:01.671172 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-052b8ee8-3d5b-48af-99c1-313f1ac0fe39 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:01.932413 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-052b8ee8-3d5b-48af-99c1-313f1ac0fe39 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:01.942902 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-052b8ee8-3d5b-48af-99c1-313f1ac0fe39 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1357 microversion: 2.1 time: 0.287689 Nov 23 13:04:01.944422 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 405/760] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:04:01 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1357 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:04:02.637430 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-66398b53-a886-45dc-9834-365ae42b44c6 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:04:02.638076 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-66398b53-a886-45dc-9834-365ae42b44c6 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:04:02.646473 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-66398b53-a886-45dc-9834-365ae42b44c6 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:02.646915 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-66398b53-a886-45dc-9834-365ae42b44c6 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:02.648036 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-66398b53-a886-45dc-9834-365ae42b44c6 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:02.648606 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-66398b53-a886-45dc-9834-365ae42b44c6 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:02.869160 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-66398b53-a886-45dc-9834-365ae42b44c6 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:02.879991 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-66398b53-a886-45dc-9834-365ae42b44c6 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:02.881927 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-66398b53-a886-45dc-9834-365ae42b44c6 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:02.883122 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-66398b53-a886-45dc-9834-365ae42b44c6 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1739 microversion: 2.20 time: 0.249610 Nov 23 13:04:02.886210 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 356/761] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:04:02 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1739 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:04:02.960502 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-fce5938f-feb9-4cc5-8e07-535d9a4d3821 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:04:02.961275 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-fce5938f-feb9-4cc5-8e07-535d9a4d3821 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:04:02.968680 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-fce5938f-feb9-4cc5-8e07-535d9a4d3821 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:02.969102 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-fce5938f-feb9-4cc5-8e07-535d9a4d3821 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:02.970094 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-fce5938f-feb9-4cc5-8e07-535d9a4d3821 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:02.970692 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-fce5938f-feb9-4cc5-8e07-535d9a4d3821 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:03.180218 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-fce5938f-feb9-4cc5-8e07-535d9a4d3821 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:03.193388 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-fce5938f-feb9-4cc5-8e07-535d9a4d3821 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1357 microversion: 2.1 time: 0.236358 Nov 23 13:04:03.193981 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 406/762] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:04:02 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1357 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:04:03.905426 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-57082df5-55c8-4931-a412-fc17201876a4 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:04:03.905991 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-57082df5-55c8-4931-a412-fc17201876a4 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:04:03.913815 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-57082df5-55c8-4931-a412-fc17201876a4 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:03.914259 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-57082df5-55c8-4931-a412-fc17201876a4 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:03.915404 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-57082df5-55c8-4931-a412-fc17201876a4 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:03.915821 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-57082df5-55c8-4931-a412-fc17201876a4 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:04.137793 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-57082df5-55c8-4931-a412-fc17201876a4 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:04.148332 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-57082df5-55c8-4931-a412-fc17201876a4 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:04.149838 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-57082df5-55c8-4931-a412-fc17201876a4 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:04.150999 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-57082df5-55c8-4931-a412-fc17201876a4 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1739 microversion: 2.20 time: 0.249517 Nov 23 13:04:04.151786 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 357/763] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:04:03 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1739 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 13:04:04.211074 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-9fa3d9b5-472c-4e83-a889-9402075b6f6b tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:04:04.212479 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-9fa3d9b5-472c-4e83-a889-9402075b6f6b tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:04:04.220184 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-9fa3d9b5-472c-4e83-a889-9402075b6f6b tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:04.220886 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-9fa3d9b5-472c-4e83-a889-9402075b6f6b tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:04.221846 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-9fa3d9b5-472c-4e83-a889-9402075b6f6b tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:04.222763 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-9fa3d9b5-472c-4e83-a889-9402075b6f6b tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:04.455564 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-9fa3d9b5-472c-4e83-a889-9402075b6f6b tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:04.466602 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-9fa3d9b5-472c-4e83-a889-9402075b6f6b tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1357 microversion: 2.1 time: 0.259475 Nov 23 13:04:04.467785 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 407/764] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:04:04 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1357 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:04:05.170009 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-79497573-ab4a-497f-993e-7bf77240bca9 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:04:05.170639 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-79497573-ab4a-497f-993e-7bf77240bca9 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:04:05.178901 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-79497573-ab4a-497f-993e-7bf77240bca9 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:05.179425 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-79497573-ab4a-497f-993e-7bf77240bca9 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:05.180269 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-79497573-ab4a-497f-993e-7bf77240bca9 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:05.180712 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-79497573-ab4a-497f-993e-7bf77240bca9 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:05.483376 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-90054676-919f-45f9-a1da-b61751f7bcd6 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:04:05.484819 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-90054676-919f-45f9-a1da-b61751f7bcd6 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:04:05.493183 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-79497573-ab4a-497f-993e-7bf77240bca9 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:05.502004 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-90054676-919f-45f9-a1da-b61751f7bcd6 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:05.504614 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-90054676-919f-45f9-a1da-b61751f7bcd6 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:05.505693 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-90054676-919f-45f9-a1da-b61751f7bcd6 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:05.506352 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-90054676-919f-45f9-a1da-b61751f7bcd6 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:05.507650 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-79497573-ab4a-497f-993e-7bf77240bca9 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:05.509304 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-79497573-ab4a-497f-993e-7bf77240bca9 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:05.510479 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-79497573-ab4a-497f-993e-7bf77240bca9 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1739 microversion: 2.20 time: 0.344607 Nov 23 13:04:05.521383 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 358/765] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:04:05 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1739 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:04:05.880839 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-90054676-919f-45f9-a1da-b61751f7bcd6 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:05.891300 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-90054676-919f-45f9-a1da-b61751f7bcd6 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1357 microversion: 2.1 time: 0.411744 Nov 23 13:04:05.892437 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 408/766] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:04:05 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1357 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:04:06.531188 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-0a47cefb-f8c0-4bdb-b690-f6c19f5fb48e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:04:06.531820 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-0a47cefb-f8c0-4bdb-b690-f6c19f5fb48e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:04:06.541430 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0a47cefb-f8c0-4bdb-b690-f6c19f5fb48e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:06.541881 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0a47cefb-f8c0-4bdb-b690-f6c19f5fb48e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:06.542672 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0a47cefb-f8c0-4bdb-b690-f6c19f5fb48e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:06.543104 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0a47cefb-f8c0-4bdb-b690-f6c19f5fb48e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:06.750203 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-0a47cefb-f8c0-4bdb-b690-f6c19f5fb48e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:06.759443 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-0a47cefb-f8c0-4bdb-b690-f6c19f5fb48e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:06.761007 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-0a47cefb-f8c0-4bdb-b690-f6c19f5fb48e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:06.762152 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-0a47cefb-f8c0-4bdb-b690-f6c19f5fb48e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1739 microversion: 2.20 time: 0.236143 Nov 23 13:04:06.762851 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 359/767] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:04:06 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1739 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 13:04:06.909594 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-f0cdeb1a-7f6d-4b04-966b-a32770e7a7f0 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:04:06.910285 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-f0cdeb1a-7f6d-4b04-966b-a32770e7a7f0 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:04:06.917562 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f0cdeb1a-7f6d-4b04-966b-a32770e7a7f0 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:06.918011 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f0cdeb1a-7f6d-4b04-966b-a32770e7a7f0 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:06.918774 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f0cdeb1a-7f6d-4b04-966b-a32770e7a7f0 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:06.919241 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f0cdeb1a-7f6d-4b04-966b-a32770e7a7f0 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:07.138409 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-f0cdeb1a-7f6d-4b04-966b-a32770e7a7f0 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:07.150633 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-f0cdeb1a-7f6d-4b04-966b-a32770e7a7f0 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1357 microversion: 2.1 time: 0.244766 Nov 23 13:04:07.151316 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 409/768] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:04:06 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1357 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:04:07.781359 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-1d9fc84c-b743-438b-b400-3543ebfff947 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:04:07.782024 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-1d9fc84c-b743-438b-b400-3543ebfff947 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:04:07.789694 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1d9fc84c-b743-438b-b400-3543ebfff947 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:07.790142 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1d9fc84c-b743-438b-b400-3543ebfff947 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:07.790882 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1d9fc84c-b743-438b-b400-3543ebfff947 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:07.791468 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1d9fc84c-b743-438b-b400-3543ebfff947 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:08.018463 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-1d9fc84c-b743-438b-b400-3543ebfff947 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:08.028218 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-1d9fc84c-b743-438b-b400-3543ebfff947 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:08.029798 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-1d9fc84c-b743-438b-b400-3543ebfff947 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:08.031179 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-1d9fc84c-b743-438b-b400-3543ebfff947 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1739 microversion: 2.20 time: 0.253779 Nov 23 13:04:08.031963 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 360/769] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:04:07 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1739 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:04:08.169048 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-d211dea9-2d89-45b7-840b-aa2d8773666c tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:04:08.169653 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-d211dea9-2d89-45b7-840b-aa2d8773666c tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:04:08.177252 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d211dea9-2d89-45b7-840b-aa2d8773666c tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:08.177703 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d211dea9-2d89-45b7-840b-aa2d8773666c tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:08.178471 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d211dea9-2d89-45b7-840b-aa2d8773666c tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:08.178935 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d211dea9-2d89-45b7-840b-aa2d8773666c tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:08.396350 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-d211dea9-2d89-45b7-840b-aa2d8773666c tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:08.405632 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-d211dea9-2d89-45b7-840b-aa2d8773666c tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1357 microversion: 2.1 time: 0.240234 Nov 23 13:04:08.406220 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 410/770] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:04:08 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1357 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:04:09.049770 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-bd42b2e2-a9a1-4323-a069-3e8e92fe64e1 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:04:09.050339 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-bd42b2e2-a9a1-4323-a069-3e8e92fe64e1 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:04:09.058029 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-bd42b2e2-a9a1-4323-a069-3e8e92fe64e1 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:09.058475 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-bd42b2e2-a9a1-4323-a069-3e8e92fe64e1 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:09.059250 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-bd42b2e2-a9a1-4323-a069-3e8e92fe64e1 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:09.059685 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-bd42b2e2-a9a1-4323-a069-3e8e92fe64e1 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:09.270661 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-bd42b2e2-a9a1-4323-a069-3e8e92fe64e1 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:09.284255 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-bd42b2e2-a9a1-4323-a069-3e8e92fe64e1 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:09.287700 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-bd42b2e2-a9a1-4323-a069-3e8e92fe64e1 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:09.288956 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-bd42b2e2-a9a1-4323-a069-3e8e92fe64e1 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1739 microversion: 2.20 time: 0.243078 Nov 23 13:04:09.289509 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 361/771] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:04:09 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1739 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:04:09.427827 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-3b1f08a1-1297-43bb-83eb-472ff495b95e tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:04:09.428465 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-3b1f08a1-1297-43bb-83eb-472ff495b95e tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:04:09.438977 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-3b1f08a1-1297-43bb-83eb-472ff495b95e tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:09.439528 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-3b1f08a1-1297-43bb-83eb-472ff495b95e tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:09.440464 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-3b1f08a1-1297-43bb-83eb-472ff495b95e tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:09.440986 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-3b1f08a1-1297-43bb-83eb-472ff495b95e tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:09.664080 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-3b1f08a1-1297-43bb-83eb-472ff495b95e tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:09.672585 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-3b1f08a1-1297-43bb-83eb-472ff495b95e tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1357 microversion: 2.1 time: 0.249311 Nov 23 13:04:09.673171 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 411/772] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:04:09 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1357 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:04:10.307242 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-96c2d937-d87e-48dd-b2d6-0497c6b6db64 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:04:10.307851 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-96c2d937-d87e-48dd-b2d6-0497c6b6db64 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:04:10.315703 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-96c2d937-d87e-48dd-b2d6-0497c6b6db64 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:10.316475 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-96c2d937-d87e-48dd-b2d6-0497c6b6db64 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:10.317466 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-96c2d937-d87e-48dd-b2d6-0497c6b6db64 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:10.318117 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-96c2d937-d87e-48dd-b2d6-0497c6b6db64 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:10.544721 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-96c2d937-d87e-48dd-b2d6-0497c6b6db64 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:10.553839 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-96c2d937-d87e-48dd-b2d6-0497c6b6db64 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:10.555998 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-96c2d937-d87e-48dd-b2d6-0497c6b6db64 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:10.556663 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-96c2d937-d87e-48dd-b2d6-0497c6b6db64 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1739 microversion: 2.20 time: 0.253461 Nov 23 13:04:10.557220 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 362/773] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:04:10 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1739 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:04:10.692257 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-7027fc8b-9862-477c-841b-9b4f32551714 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:04:10.692888 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-7027fc8b-9862-477c-841b-9b4f32551714 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:04:10.702426 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-7027fc8b-9862-477c-841b-9b4f32551714 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:10.703009 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-7027fc8b-9862-477c-841b-9b4f32551714 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:10.704218 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-7027fc8b-9862-477c-841b-9b4f32551714 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:10.704893 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-7027fc8b-9862-477c-841b-9b4f32551714 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:10.926228 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-7027fc8b-9862-477c-841b-9b4f32551714 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:10.934679 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-7027fc8b-9862-477c-841b-9b4f32551714 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1357 microversion: 2.1 time: 0.246483 Nov 23 13:04:10.935244 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 412/774] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:04:10 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1357 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:04:11.582715 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-f7ef7a2b-d4b4-4a42-aaa2-127f454a5ff9 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:04:11.583349 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-f7ef7a2b-d4b4-4a42-aaa2-127f454a5ff9 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:04:11.590935 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f7ef7a2b-d4b4-4a42-aaa2-127f454a5ff9 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:11.591578 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f7ef7a2b-d4b4-4a42-aaa2-127f454a5ff9 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:11.592635 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f7ef7a2b-d4b4-4a42-aaa2-127f454a5ff9 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:11.593211 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f7ef7a2b-d4b4-4a42-aaa2-127f454a5ff9 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:11.813759 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-f7ef7a2b-d4b4-4a42-aaa2-127f454a5ff9 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:11.842459 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-f7ef7a2b-d4b4-4a42-aaa2-127f454a5ff9 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:11.845805 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-f7ef7a2b-d4b4-4a42-aaa2-127f454a5ff9 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:11.852090 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-f7ef7a2b-d4b4-4a42-aaa2-127f454a5ff9 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1739 microversion: 2.20 time: 0.278298 Nov 23 13:04:11.854448 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 363/775] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:04:11 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1739 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:04:11.961566 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-10efc354-1d43-418d-a759-d6e6d7e62c0b tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:04:11.961566 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-10efc354-1d43-418d-a759-d6e6d7e62c0b tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:04:11.973127 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-10efc354-1d43-418d-a759-d6e6d7e62c0b tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:11.973887 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-10efc354-1d43-418d-a759-d6e6d7e62c0b tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:11.974928 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-10efc354-1d43-418d-a759-d6e6d7e62c0b tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:11.975630 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-10efc354-1d43-418d-a759-d6e6d7e62c0b tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:12.300270 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-10efc354-1d43-418d-a759-d6e6d7e62c0b tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:12.311147 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-10efc354-1d43-418d-a759-d6e6d7e62c0b tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1357 microversion: 2.1 time: 0.363413 Nov 23 13:04:12.321058 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 413/776] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:04:11 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1357 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:04:12.874120 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-f659596e-3d33-43ac-9f37-f658f73b3550 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:04:12.875471 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-f659596e-3d33-43ac-9f37-f658f73b3550 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:04:12.883081 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f659596e-3d33-43ac-9f37-f658f73b3550 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:12.883528 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f659596e-3d33-43ac-9f37-f658f73b3550 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:12.884514 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f659596e-3d33-43ac-9f37-f658f73b3550 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:12.884945 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f659596e-3d33-43ac-9f37-f658f73b3550 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:13.123052 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-f659596e-3d33-43ac-9f37-f658f73b3550 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:13.132628 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-f659596e-3d33-43ac-9f37-f658f73b3550 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:13.134451 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-f659596e-3d33-43ac-9f37-f658f73b3550 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:13.137007 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-f659596e-3d33-43ac-9f37-f658f73b3550 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1739 microversion: 2.20 time: 0.266505 Nov 23 13:04:13.138103 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 364/777] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:04:12 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1739 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:04:13.328098 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-e56e098a-2990-41f7-8f0b-f21a7e82221f tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:04:13.328733 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-e56e098a-2990-41f7-8f0b-f21a7e82221f tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:04:13.340789 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e56e098a-2990-41f7-8f0b-f21a7e82221f tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:13.341159 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e56e098a-2990-41f7-8f0b-f21a7e82221f tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:13.341949 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e56e098a-2990-41f7-8f0b-f21a7e82221f tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:13.342601 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e56e098a-2990-41f7-8f0b-f21a7e82221f tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:13.917816 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-e56e098a-2990-41f7-8f0b-f21a7e82221f tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:13.928588 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-e56e098a-2990-41f7-8f0b-f21a7e82221f tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1357 microversion: 2.1 time: 0.601858 Nov 23 13:04:13.928588 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 414/778] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:04:13 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1357 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:04:14.156579 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-11acd5e1-9f2f-48e7-9e1d-c61559728160 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:04:14.157193 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-11acd5e1-9f2f-48e7-9e1d-c61559728160 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:04:14.164969 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-11acd5e1-9f2f-48e7-9e1d-c61559728160 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:14.165989 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-11acd5e1-9f2f-48e7-9e1d-c61559728160 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:14.166851 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-11acd5e1-9f2f-48e7-9e1d-c61559728160 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:14.167290 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-11acd5e1-9f2f-48e7-9e1d-c61559728160 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:14.386474 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-11acd5e1-9f2f-48e7-9e1d-c61559728160 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:14.400039 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-11acd5e1-9f2f-48e7-9e1d-c61559728160 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:14.401871 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-11acd5e1-9f2f-48e7-9e1d-c61559728160 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:14.403019 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-11acd5e1-9f2f-48e7-9e1d-c61559728160 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1739 microversion: 2.20 time: 0.250673 Nov 23 13:04:14.403574 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 365/779] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:04:14 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1739 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:04:14.943240 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-0b2514e9-4e2b-4bfa-a06a-0ead29b155ca tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:04:14.943756 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-0b2514e9-4e2b-4bfa-a06a-0ead29b155ca tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:04:14.951164 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0b2514e9-4e2b-4bfa-a06a-0ead29b155ca tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:14.951705 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0b2514e9-4e2b-4bfa-a06a-0ead29b155ca tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:14.952598 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0b2514e9-4e2b-4bfa-a06a-0ead29b155ca tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:14.953097 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0b2514e9-4e2b-4bfa-a06a-0ead29b155ca tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:15.164787 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-0b2514e9-4e2b-4bfa-a06a-0ead29b155ca tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:15.173441 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-0b2514e9-4e2b-4bfa-a06a-0ead29b155ca tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1357 microversion: 2.1 time: 0.234401 Nov 23 13:04:15.174003 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 415/780] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:04:14 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1357 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:04:15.421755 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-05b34638-ddcd-4759-9f5e-c358f5311bf5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:04:15.423011 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-05b34638-ddcd-4759-9f5e-c358f5311bf5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:04:15.430362 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-05b34638-ddcd-4759-9f5e-c358f5311bf5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:15.430968 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-05b34638-ddcd-4759-9f5e-c358f5311bf5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:15.431900 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-05b34638-ddcd-4759-9f5e-c358f5311bf5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:15.432396 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-05b34638-ddcd-4759-9f5e-c358f5311bf5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:15.722111 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-05b34638-ddcd-4759-9f5e-c358f5311bf5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:15.732218 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-05b34638-ddcd-4759-9f5e-c358f5311bf5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:15.733731 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-05b34638-ddcd-4759-9f5e-c358f5311bf5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:15.734862 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-05b34638-ddcd-4759-9f5e-c358f5311bf5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1739 microversion: 2.20 time: 0.316926 Nov 23 13:04:15.735410 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 366/781] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:04:15 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1739 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:04:16.190716 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-e8e9f477-649d-468d-9c83-3be526542c7e tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:04:16.191475 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-e8e9f477-649d-468d-9c83-3be526542c7e tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:04:16.199056 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e8e9f477-649d-468d-9c83-3be526542c7e tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:16.199505 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e8e9f477-649d-468d-9c83-3be526542c7e tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:16.200308 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e8e9f477-649d-468d-9c83-3be526542c7e tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:16.200769 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e8e9f477-649d-468d-9c83-3be526542c7e tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:16.406114 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-e8e9f477-649d-468d-9c83-3be526542c7e tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:16.414695 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-e8e9f477-649d-468d-9c83-3be526542c7e tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1357 microversion: 2.1 time: 0.227987 Nov 23 13:04:16.415348 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 416/782] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:04:16 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1357 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:04:16.755986 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-25aac64f-0521-4618-99f5-4566f3294c99 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:04:16.756871 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-25aac64f-0521-4618-99f5-4566f3294c99 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:04:16.764929 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-25aac64f-0521-4618-99f5-4566f3294c99 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:16.765498 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-25aac64f-0521-4618-99f5-4566f3294c99 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:16.766880 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-25aac64f-0521-4618-99f5-4566f3294c99 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:16.767549 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-25aac64f-0521-4618-99f5-4566f3294c99 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:17.169243 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-25aac64f-0521-4618-99f5-4566f3294c99 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:17.180159 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-25aac64f-0521-4618-99f5-4566f3294c99 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:17.181903 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-25aac64f-0521-4618-99f5-4566f3294c99 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:17.183211 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-25aac64f-0521-4618-99f5-4566f3294c99 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1739 microversion: 2.20 time: 0.431913 Nov 23 13:04:17.183951 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 367/783] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:04:16 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1739 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:04:17.430993 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-4a3b905c-146f-4b1d-8674-81d373d0e22e tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:04:17.432291 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-4a3b905c-146f-4b1d-8674-81d373d0e22e tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:04:17.440004 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4a3b905c-146f-4b1d-8674-81d373d0e22e tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:17.440747 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4a3b905c-146f-4b1d-8674-81d373d0e22e tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:17.442531 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4a3b905c-146f-4b1d-8674-81d373d0e22e tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:17.442970 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4a3b905c-146f-4b1d-8674-81d373d0e22e tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:17.660854 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-4a3b905c-146f-4b1d-8674-81d373d0e22e tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:17.671117 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-4a3b905c-146f-4b1d-8674-81d373d0e22e tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1357 microversion: 2.1 time: 0.244022 Nov 23 13:04:17.671950 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 417/784] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:04:17 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1357 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:04:18.202811 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-3f399c26-6356-49fe-b089-4a6b4fbee8d7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:04:18.204077 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-3f399c26-6356-49fe-b089-4a6b4fbee8d7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:04:18.212277 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3f399c26-6356-49fe-b089-4a6b4fbee8d7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:18.212752 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3f399c26-6356-49fe-b089-4a6b4fbee8d7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:18.216738 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3f399c26-6356-49fe-b089-4a6b4fbee8d7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:18.218002 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3f399c26-6356-49fe-b089-4a6b4fbee8d7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:18.444466 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-3f399c26-6356-49fe-b089-4a6b4fbee8d7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:18.455296 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-3f399c26-6356-49fe-b089-4a6b4fbee8d7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:18.457112 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-3f399c26-6356-49fe-b089-4a6b4fbee8d7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:18.458414 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-3f399c26-6356-49fe-b089-4a6b4fbee8d7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1739 microversion: 2.20 time: 0.259445 Nov 23 13:04:18.459221 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 368/785] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:04:18 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1739 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:04:18.688090 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-456d5520-fac9-44cd-ae1d-6b58b36946cd tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:04:18.689334 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-456d5520-fac9-44cd-ae1d-6b58b36946cd tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:04:18.697234 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-456d5520-fac9-44cd-ae1d-6b58b36946cd tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:18.697882 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-456d5520-fac9-44cd-ae1d-6b58b36946cd tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:18.698823 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-456d5520-fac9-44cd-ae1d-6b58b36946cd tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:18.699403 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-456d5520-fac9-44cd-ae1d-6b58b36946cd tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:18.961244 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-456d5520-fac9-44cd-ae1d-6b58b36946cd tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:18.969771 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-456d5520-fac9-44cd-ae1d-6b58b36946cd tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1357 microversion: 2.1 time: 0.285534 Nov 23 13:04:18.970693 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 418/786] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:04:18 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1357 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 13:04:19.477722 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-5b4476fd-0bac-41d9-a4c5-b9d2774949fc tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:04:19.478366 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-5b4476fd-0bac-41d9-a4c5-b9d2774949fc tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:04:19.486241 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5b4476fd-0bac-41d9-a4c5-b9d2774949fc tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:19.486676 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5b4476fd-0bac-41d9-a4c5-b9d2774949fc tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:19.487451 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5b4476fd-0bac-41d9-a4c5-b9d2774949fc tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:19.487870 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5b4476fd-0bac-41d9-a4c5-b9d2774949fc tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:19.955654 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-5b4476fd-0bac-41d9-a4c5-b9d2774949fc tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:19.964942 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-5b4476fd-0bac-41d9-a4c5-b9d2774949fc tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:19.966422 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-5b4476fd-0bac-41d9-a4c5-b9d2774949fc tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:19.967540 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-5b4476fd-0bac-41d9-a4c5-b9d2774949fc tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1721 microversion: 2.20 time: 0.493911 Nov 23 13:04:19.968122 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 369/787] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:04:19 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1721 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:04:19.986984 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-c89f0bcb-05a1-4a90-8b45-e3e062de6823 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:04:19.987668 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-c89f0bcb-05a1-4a90-8b45-e3e062de6823 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:04:19.995182 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c89f0bcb-05a1-4a90-8b45-e3e062de6823 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:19.995632 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c89f0bcb-05a1-4a90-8b45-e3e062de6823 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:19.996459 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c89f0bcb-05a1-4a90-8b45-e3e062de6823 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:19.997205 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c89f0bcb-05a1-4a90-8b45-e3e062de6823 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:20.212499 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-c89f0bcb-05a1-4a90-8b45-e3e062de6823 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:20.220927 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-c89f0bcb-05a1-4a90-8b45-e3e062de6823 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1357 microversion: 2.1 time: 0.237367 Nov 23 13:04:20.221479 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 419/788] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:04:19 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1357 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:04:20.986108 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-ed322ccf-178c-4169-b559-31996e2b13d7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:04:20.986695 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-ed322ccf-178c-4169-b559-31996e2b13d7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:04:20.994011 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ed322ccf-178c-4169-b559-31996e2b13d7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:20.994455 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ed322ccf-178c-4169-b559-31996e2b13d7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:20.995220 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ed322ccf-178c-4169-b559-31996e2b13d7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:20.995649 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ed322ccf-178c-4169-b559-31996e2b13d7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:21.208185 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-ed322ccf-178c-4169-b559-31996e2b13d7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:21.217418 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-ed322ccf-178c-4169-b559-31996e2b13d7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:21.218906 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-ed322ccf-178c-4169-b559-31996e2b13d7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:21.220034 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-ed322ccf-178c-4169-b559-31996e2b13d7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1721 microversion: 2.20 time: 0.237728 Nov 23 13:04:21.220684 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 370/789] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:04:20 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1721 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:04:21.237835 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-a8f15d80-0e30-4d50-91d3-bc678c2b1d16 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:04:21.238421 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-a8f15d80-0e30-4d50-91d3-bc678c2b1d16 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:04:21.250001 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a8f15d80-0e30-4d50-91d3-bc678c2b1d16 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:21.250532 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a8f15d80-0e30-4d50-91d3-bc678c2b1d16 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:21.251308 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a8f15d80-0e30-4d50-91d3-bc678c2b1d16 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:21.251739 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a8f15d80-0e30-4d50-91d3-bc678c2b1d16 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:21.458347 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-a8f15d80-0e30-4d50-91d3-bc678c2b1d16 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:21.467314 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-a8f15d80-0e30-4d50-91d3-bc678c2b1d16 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1357 microversion: 2.1 time: 0.233306 Nov 23 13:04:21.467878 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 420/790] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:04:21 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1357 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:04:21.540719 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [req-463c6646-640f-4f1b-9f5a-222dd4e83156 req-86bc7dbe-0751-4a1f-b36c-5651c6a92df5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9c21729-a176-4e26-9074-f5f0bfc0ce20", "name": "network-vif-unplugged", "status": "completed", "tag": "acc6c8bf-82a2-4f88-b12e-f6a39d6ce970"}]} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:04:21.543850 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 13:04:21.543850 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: warnings.warn(msg) Nov 23 13:04:21.576040 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [req-463c6646-640f-4f1b-9f5a-222dd4e83156 req-86bc7dbe-0751-4a1f-b36c-5651c6a92df5 service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:21.576701 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [req-463c6646-640f-4f1b-9f5a-222dd4e83156 req-86bc7dbe-0751-4a1f-b36c-5651c6a92df5 service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:21.595384 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.compute.server_external_events [req-463c6646-640f-4f1b-9f5a-222dd4e83156 req-86bc7dbe-0751-4a1f-b36c-5651c6a92df5 service nova] Creating event network-vif-unplugged:acc6c8bf-82a2-4f88-b12e-f6a39d6ce970 for instance b9c21729-a176-4e26-9074-f5f0bfc0ce20 on hv-cinder-81888 Nov 23 13:04:21.601582 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [req-463c6646-640f-4f1b-9f5a-222dd4e83156 req-86bc7dbe-0751-4a1f-b36c-5651c6a92df5 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.071717 Nov 23 13:04:21.602431 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 371/791] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Nov 23 13:04:21 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 13:04:22.239255 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-fc63fee4-5cae-4666-a921-1df1d6a32e52 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:04:22.240026 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-fc63fee4-5cae-4666-a921-1df1d6a32e52 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:04:22.249741 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-fc63fee4-5cae-4666-a921-1df1d6a32e52 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:22.250415 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-fc63fee4-5cae-4666-a921-1df1d6a32e52 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:22.251467 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-fc63fee4-5cae-4666-a921-1df1d6a32e52 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:22.252119 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-fc63fee4-5cae-4666-a921-1df1d6a32e52 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:22.487252 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-c819cbf8-2a9b-4832-9fff-98700696e5c4 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:04:22.488911 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-c819cbf8-2a9b-4832-9fff-98700696e5c4 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:04:22.498535 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c819cbf8-2a9b-4832-9fff-98700696e5c4 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:22.499187 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c819cbf8-2a9b-4832-9fff-98700696e5c4 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:22.501372 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c819cbf8-2a9b-4832-9fff-98700696e5c4 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:22.501817 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c819cbf8-2a9b-4832-9fff-98700696e5c4 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:22.725881 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-c819cbf8-2a9b-4832-9fff-98700696e5c4 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:22.736345 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-c819cbf8-2a9b-4832-9fff-98700696e5c4 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1357 microversion: 2.1 time: 0.255235 Nov 23 13:04:22.737778 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 372/792] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:04:22 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1357 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 13:04:22.786854 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-fc63fee4-5cae-4666-a921-1df1d6a32e52 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:22.797298 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-fc63fee4-5cae-4666-a921-1df1d6a32e52 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:22.799142 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-fc63fee4-5cae-4666-a921-1df1d6a32e52 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:22.801487 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-fc63fee4-5cae-4666-a921-1df1d6a32e52 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1664 microversion: 2.20 time: 0.566393 Nov 23 13:04:22.802120 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 421/793] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:04:22 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1664 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:04:22.820435 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-b4d3d21e-c96b-47bd-9631-82a3b43be620 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "66d7d72e-ee37-4804-b7f1-7e8c9263cec1"}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:04:22.821821 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-b4d3d21e-c96b-47bd-9631-82a3b43be620 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:04:22.829844 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b4d3d21e-c96b-47bd-9631-82a3b43be620 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:22.830517 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b4d3d21e-c96b-47bd-9631-82a3b43be620 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:22.831495 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b4d3d21e-c96b-47bd-9631-82a3b43be620 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:22.832087 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b4d3d21e-c96b-47bd-9631-82a3b43be620 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:23.446741 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-b4d3d21e-c96b-47bd-9631-82a3b43be620 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.630328 Nov 23 13:04:23.447742 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 373/794] 10.222.0.60 () {62 vars in 1363 bytes} [Tue Nov 23 13:04:22 2021] POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 188 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 13:04:23.773315 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-4a671907-cdb2-41fd-b81b-fbe56ecb67eb tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:04:23.774316 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-f5fa093f-d52c-452a-90ca-6be3dea39a1d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:04:23.775636 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-f5fa093f-d52c-452a-90ca-6be3dea39a1d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:04:23.776327 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-4a671907-cdb2-41fd-b81b-fbe56ecb67eb tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:04:23.791208 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f5fa093f-d52c-452a-90ca-6be3dea39a1d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:23.793569 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f5fa093f-d52c-452a-90ca-6be3dea39a1d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:23.795116 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f5fa093f-d52c-452a-90ca-6be3dea39a1d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:23.802993 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f5fa093f-d52c-452a-90ca-6be3dea39a1d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:23.809589 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4a671907-cdb2-41fd-b81b-fbe56ecb67eb tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:23.811965 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4a671907-cdb2-41fd-b81b-fbe56ecb67eb tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:23.813083 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4a671907-cdb2-41fd-b81b-fbe56ecb67eb tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:23.815721 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4a671907-cdb2-41fd-b81b-fbe56ecb67eb tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:24.075023 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-f5fa093f-d52c-452a-90ca-6be3dea39a1d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action" status: 202 len: 0 microversion: 2.20 time: 0.310192 Nov 23 13:04:24.075689 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 374/795] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:04:23 2021] POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action => generated 0 bytes in 312 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 23 13:04:24.083883 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-4e32a411-5cb6-41b3-8ac3-344762e64a85 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:04:24.084538 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-4e32a411-5cb6-41b3-8ac3-344762e64a85 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:04:24.093436 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-4e32a411-5cb6-41b3-8ac3-344762e64a85 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:24.093436 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-4e32a411-5cb6-41b3-8ac3-344762e64a85 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:24.094404 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-4e32a411-5cb6-41b3-8ac3-344762e64a85 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:24.094943 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-4e32a411-5cb6-41b3-8ac3-344762e64a85 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:24.252007 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-4a671907-cdb2-41fd-b81b-fbe56ecb67eb tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:24.261813 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-4a671907-cdb2-41fd-b81b-fbe56ecb67eb tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1357 microversion: 2.1 time: 0.496933 Nov 23 13:04:24.263112 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 422/796] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:04:23 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1357 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:04:24.579997 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-4e32a411-5cb6-41b3-8ac3-344762e64a85 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:24.592200 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-4e32a411-5cb6-41b3-8ac3-344762e64a85 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:24.593746 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-4e32a411-5cb6-41b3-8ac3-344762e64a85 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:24.595277 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-4e32a411-5cb6-41b3-8ac3-344762e64a85 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1750 microversion: 2.20 time: 0.515241 Nov 23 13:04:24.596331 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 375/797] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:04:24 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1750 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:04:25.279652 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-606b8c57-bc0b-479e-85ee-be43bb1677de tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:04:25.280356 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-606b8c57-bc0b-479e-85ee-be43bb1677de tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:04:25.290268 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-606b8c57-bc0b-479e-85ee-be43bb1677de tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:25.290685 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-606b8c57-bc0b-479e-85ee-be43bb1677de tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:25.294079 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-606b8c57-bc0b-479e-85ee-be43bb1677de tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:25.295497 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-606b8c57-bc0b-479e-85ee-be43bb1677de tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:25.614178 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-428a75fe-9c30-469b-a38e-39e7c811c474 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:04:25.614801 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-428a75fe-9c30-469b-a38e-39e7c811c474 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:04:25.625990 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-428a75fe-9c30-469b-a38e-39e7c811c474 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:25.626460 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-428a75fe-9c30-469b-a38e-39e7c811c474 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:25.627275 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-428a75fe-9c30-469b-a38e-39e7c811c474 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:25.627689 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-428a75fe-9c30-469b-a38e-39e7c811c474 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:25.725890 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-606b8c57-bc0b-479e-85ee-be43bb1677de tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:25.735500 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-606b8c57-bc0b-479e-85ee-be43bb1677de tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1357 microversion: 2.1 time: 0.460099 Nov 23 13:04:25.745200 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 423/798] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:04:25 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1357 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:04:25.971245 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [req-33f0fbe6-996a-4ff7-a677-005e2e03cc2d req-d6e7bbaa-2261-43e6-b82f-381d520c9447 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74e06412-022d-4ece-920d-1cba08639d76", "name": "network-vif-plugged", "status": "completed", "tag": "2f280c1a-d79b-4581-bd2b-add5ec70ac56"}]} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:04:25.973141 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 13:04:25.973141 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: warnings.warn(msg) Nov 23 13:04:25.991707 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [req-33f0fbe6-996a-4ff7-a677-005e2e03cc2d req-d6e7bbaa-2261-43e6-b82f-381d520c9447 service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:25.993544 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [req-33f0fbe6-996a-4ff7-a677-005e2e03cc2d req-d6e7bbaa-2261-43e6-b82f-381d520c9447 service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:26.020675 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.compute.server_external_events [req-33f0fbe6-996a-4ff7-a677-005e2e03cc2d req-d6e7bbaa-2261-43e6-b82f-381d520c9447 service nova] Creating event network-vif-plugged:2f280c1a-d79b-4581-bd2b-add5ec70ac56 for instance 74e06412-022d-4ece-920d-1cba08639d76 on hv-cinder-81888 Nov 23 13:04:26.026822 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [req-33f0fbe6-996a-4ff7-a677-005e2e03cc2d req-d6e7bbaa-2261-43e6-b82f-381d520c9447 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059636 Nov 23 13:04:26.027942 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 424/799] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Nov 23 13:04:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 13:04:26.090902 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-428a75fe-9c30-469b-a38e-39e7c811c474 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:26.101757 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-428a75fe-9c30-469b-a38e-39e7c811c474 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:26.103340 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-428a75fe-9c30-469b-a38e-39e7c811c474 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:26.104529 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-428a75fe-9c30-469b-a38e-39e7c811c474 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1750 microversion: 2.20 time: 0.494220 Nov 23 13:04:26.105089 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 376/800] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:04:25 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1750 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 13:04:26.757476 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-6bbdc13a-20af-4fd1-a541-43c20d11cefa tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:04:26.758634 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-6bbdc13a-20af-4fd1-a541-43c20d11cefa tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:04:26.768298 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6bbdc13a-20af-4fd1-a541-43c20d11cefa tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:26.769094 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6bbdc13a-20af-4fd1-a541-43c20d11cefa tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:26.769928 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6bbdc13a-20af-4fd1-a541-43c20d11cefa tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:26.770573 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6bbdc13a-20af-4fd1-a541-43c20d11cefa tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:26.986560 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-6bbdc13a-20af-4fd1-a541-43c20d11cefa tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:26.995336 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-6bbdc13a-20af-4fd1-a541-43c20d11cefa tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1357 microversion: 2.1 time: 0.242625 Nov 23 13:04:26.995928 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 425/801] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:04:26 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1357 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:04:27.123645 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-b801d90d-00a3-4890-978c-7d22a7359a3a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:04:27.124282 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-b801d90d-00a3-4890-978c-7d22a7359a3a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:04:27.132202 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b801d90d-00a3-4890-978c-7d22a7359a3a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:27.132202 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b801d90d-00a3-4890-978c-7d22a7359a3a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:27.133688 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b801d90d-00a3-4890-978c-7d22a7359a3a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:27.133688 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b801d90d-00a3-4890-978c-7d22a7359a3a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:27.344608 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-b801d90d-00a3-4890-978c-7d22a7359a3a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:27.354603 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-b801d90d-00a3-4890-978c-7d22a7359a3a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:27.356149 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-b801d90d-00a3-4890-978c-7d22a7359a3a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:27.360871 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-b801d90d-00a3-4890-978c-7d22a7359a3a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1752 microversion: 2.20 time: 0.241767 Nov 23 13:04:27.361459 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 377/802] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:04:27 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1752 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:04:28.013874 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-6cd286ae-256c-49eb-9fc5-6548c20abee5 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:04:28.017701 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-6cd286ae-256c-49eb-9fc5-6548c20abee5 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:04:28.032018 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6cd286ae-256c-49eb-9fc5-6548c20abee5 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:28.032759 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6cd286ae-256c-49eb-9fc5-6548c20abee5 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:28.033883 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6cd286ae-256c-49eb-9fc5-6548c20abee5 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:28.034470 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6cd286ae-256c-49eb-9fc5-6548c20abee5 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:28.276123 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-6cd286ae-256c-49eb-9fc5-6548c20abee5 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:28.284475 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-6cd286ae-256c-49eb-9fc5-6548c20abee5 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1546 microversion: 2.1 time: 0.275838 Nov 23 13:04:28.285052 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 426/803] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:04:28 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1546 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:04:28.301452 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-55fcfceb-d2f8-4668-be33-566181a5c8ac tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:04:28.302031 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-55fcfceb-d2f8-4668-be33-566181a5c8ac tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:04:28.314088 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-55fcfceb-d2f8-4668-be33-566181a5c8ac tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:28.314573 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-55fcfceb-d2f8-4668-be33-566181a5c8ac tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:28.315350 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-55fcfceb-d2f8-4668-be33-566181a5c8ac tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:28.315772 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-55fcfceb-d2f8-4668-be33-566181a5c8ac tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:28.381172 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-00b65bbc-b6d0-40d9-bfa1-498cdb934e69 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:04:28.381858 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-00b65bbc-b6d0-40d9-bfa1-498cdb934e69 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:04:28.404062 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-00b65bbc-b6d0-40d9-bfa1-498cdb934e69 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:28.404062 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-00b65bbc-b6d0-40d9-bfa1-498cdb934e69 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:28.404865 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-00b65bbc-b6d0-40d9-bfa1-498cdb934e69 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:28.405303 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-00b65bbc-b6d0-40d9-bfa1-498cdb934e69 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:28.433190 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 13:04:28.433422 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: Tue Nov 23 13:04:28 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 (ip 10.222.0.60) !!! Nov 23 13:04:28.671813 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-55fcfceb-d2f8-4668-be33-566181a5c8ac tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:28.690477 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-55fcfceb-d2f8-4668-be33-566181a5c8ac tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1546 microversion: 2.1 time: 0.392900 Nov 23 13:04:28.694903 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 378/804] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:04:28 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1546 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:04:28.719820 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-00b65bbc-b6d0-40d9-bfa1-498cdb934e69 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:28.732599 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-00b65bbc-b6d0-40d9-bfa1-498cdb934e69 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:28.734435 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-00b65bbc-b6d0-40d9-bfa1-498cdb934e69 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:28.735775 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-00b65bbc-b6d0-40d9-bfa1-498cdb934e69 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1808 microversion: 2.20 time: 0.359097 Nov 23 13:04:28.738313 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 427/805] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:04:28 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1808 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:04:28.738724 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-8c1c9196-8f51-400b-a2f2-76b857311e8a tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:04:28.751527 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 13:04:28.751527 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: warnings.warn(msg) Nov 23 13:04:28.755439 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-8c1c9196-8f51-400b-a2f2-76b857311e8a tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:28.758889 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-8c1c9196-8f51-400b-a2f2-76b857311e8a tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Searching by: {'deleted': False, 'project_id': '13128fc1ba014300bfb802722969331f'} {{(pid=100974) get_all /opt/stack/nova/nova/compute/api.py:2855}} Nov 23 13:04:28.767915 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8c1c9196-8f51-400b-a2f2-76b857311e8a tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:28.770950 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8c1c9196-8f51-400b-a2f2-76b857311e8a tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:28.773602 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8c1c9196-8f51-400b-a2f2-76b857311e8a tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:28.774375 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8c1c9196-8f51-400b-a2f2-76b857311e8a tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:28.964786 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.multi_cell_list [None req-8c1c9196-8f51-400b-a2f2-76b857311e8a tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=100974) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Nov 23 13:04:29.074851 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-8c1c9196-8f51-400b-a2f2-76b857311e8a tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.345572 Nov 23 13:04:29.075360 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 379/806] 10.222.0.60 () {58 vars in 1124 bytes} [Tue Nov 23 13:04:28 2021] GET /compute/v2.1/servers => generated 341 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 13:04:29.089750 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-93959723-6c44-4b46-99d7-3ff3571314ab tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:04:29.090399 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-93959723-6c44-4b46-99d7-3ff3571314ab tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:04:29.098953 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-93959723-6c44-4b46-99d7-3ff3571314ab tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:29.099673 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-93959723-6c44-4b46-99d7-3ff3571314ab tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:29.100668 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-93959723-6c44-4b46-99d7-3ff3571314ab tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:29.101247 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-93959723-6c44-4b46-99d7-3ff3571314ab tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:29.452100 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-93959723-6c44-4b46-99d7-3ff3571314ab tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:29.465619 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-93959723-6c44-4b46-99d7-3ff3571314ab tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1546 microversion: 2.1 time: 0.380610 Nov 23 13:04:29.479609 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 428/807] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:04:29 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1546 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:04:29.757744 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-00002186-d6f2-40e7-b588-e6a7871b7e21 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:04:29.758351 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-00002186-d6f2-40e7-b588-e6a7871b7e21 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:04:29.766479 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-00002186-d6f2-40e7-b588-e6a7871b7e21 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:29.766833 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-00002186-d6f2-40e7-b588-e6a7871b7e21 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:29.767580 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-00002186-d6f2-40e7-b588-e6a7871b7e21 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:29.768067 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-00002186-d6f2-40e7-b588-e6a7871b7e21 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:30.285890 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-00002186-d6f2-40e7-b588-e6a7871b7e21 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:30.299841 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-00002186-d6f2-40e7-b588-e6a7871b7e21 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:30.301488 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-00002186-d6f2-40e7-b588-e6a7871b7e21 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:30.302821 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-00002186-d6f2-40e7-b588-e6a7871b7e21 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1808 microversion: 2.20 time: 0.549685 Nov 23 13:04:30.303800 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 380/808] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:04:29 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1808 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:04:31.326030 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-72f28508-d6f1-41f4-9727-459bdf621f9d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:04:31.332842 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-72f28508-d6f1-41f4-9727-459bdf621f9d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:04:31.357905 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-72f28508-d6f1-41f4-9727-459bdf621f9d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:31.360868 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-72f28508-d6f1-41f4-9727-459bdf621f9d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:31.362708 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-72f28508-d6f1-41f4-9727-459bdf621f9d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:31.367441 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-72f28508-d6f1-41f4-9727-459bdf621f9d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:31.754198 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-72f28508-d6f1-41f4-9727-459bdf621f9d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:31.771945 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-72f28508-d6f1-41f4-9727-459bdf621f9d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:31.774039 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-72f28508-d6f1-41f4-9727-459bdf621f9d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:31.775403 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-72f28508-d6f1-41f4-9727-459bdf621f9d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1808 microversion: 2.20 time: 0.456386 Nov 23 13:04:31.775927 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 429/809] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:04:31 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1808 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:04:31.792710 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-44b6096f-9c89-4ca2-a737-469f54c66645 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "780ab5a6-5bff-4988-8b16-8e33cc762d8c"}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:04:31.794606 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-44b6096f-9c89-4ca2-a737-469f54c66645 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:04:31.804496 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-44b6096f-9c89-4ca2-a737-469f54c66645 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:31.805366 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-44b6096f-9c89-4ca2-a737-469f54c66645 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:31.806518 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-44b6096f-9c89-4ca2-a737-469f54c66645 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:31.807079 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-44b6096f-9c89-4ca2-a737-469f54c66645 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:32.793715 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-d32d1902-73b7-429d-b51a-3be762afc337 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:04:32.794453 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-d32d1902-73b7-429d-b51a-3be762afc337 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:04:32.801892 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d32d1902-73b7-429d-b51a-3be762afc337 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:32.802352 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d32d1902-73b7-429d-b51a-3be762afc337 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:32.803156 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d32d1902-73b7-429d-b51a-3be762afc337 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:32.803769 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d32d1902-73b7-429d-b51a-3be762afc337 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:33.103386 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-d32d1902-73b7-429d-b51a-3be762afc337 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:33.114615 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-d32d1902-73b7-429d-b51a-3be762afc337 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:33.116933 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-d32d1902-73b7-429d-b51a-3be762afc337 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:33.118490 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-d32d1902-73b7-429d-b51a-3be762afc337 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1808 microversion: 2.20 time: 0.328751 Nov 23 13:04:33.129827 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 430/810] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:04:32 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1808 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 13:04:34.145067 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-7ac8ce71-3eee-41a9-a5bf-190cc5348734 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:04:34.145844 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-7ac8ce71-3eee-41a9-a5bf-190cc5348734 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:04:34.153729 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-7ac8ce71-3eee-41a9-a5bf-190cc5348734 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:34.154477 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-7ac8ce71-3eee-41a9-a5bf-190cc5348734 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:34.155429 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-7ac8ce71-3eee-41a9-a5bf-190cc5348734 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:34.156067 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-7ac8ce71-3eee-41a9-a5bf-190cc5348734 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:34.376027 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-7ac8ce71-3eee-41a9-a5bf-190cc5348734 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:34.387177 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-7ac8ce71-3eee-41a9-a5bf-190cc5348734 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:34.388706 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-7ac8ce71-3eee-41a9-a5bf-190cc5348734 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:34.389866 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-7ac8ce71-3eee-41a9-a5bf-190cc5348734 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1808 microversion: 2.20 time: 0.248675 Nov 23 13:04:34.390419 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 431/811] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:04:34 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1808 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 13:04:35.408656 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-9e293c74-46f6-45fc-85ba-4ed74acec369 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:04:35.410532 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-9e293c74-46f6-45fc-85ba-4ed74acec369 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:04:35.419435 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-9e293c74-46f6-45fc-85ba-4ed74acec369 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:35.420270 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-9e293c74-46f6-45fc-85ba-4ed74acec369 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:35.421300 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-9e293c74-46f6-45fc-85ba-4ed74acec369 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:35.422023 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-9e293c74-46f6-45fc-85ba-4ed74acec369 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:35.650155 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-9e293c74-46f6-45fc-85ba-4ed74acec369 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:35.661414 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-9e293c74-46f6-45fc-85ba-4ed74acec369 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:35.662936 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-9e293c74-46f6-45fc-85ba-4ed74acec369 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:35.664110 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-9e293c74-46f6-45fc-85ba-4ed74acec369 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1808 microversion: 2.20 time: 0.260071 Nov 23 13:04:35.674866 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 432/812] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:04:35 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1808 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:04:36.683269 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-c9b32c35-f22a-4d35-bc80-e8af86512fa7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:04:36.684402 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-c9b32c35-f22a-4d35-bc80-e8af86512fa7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:04:36.693226 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c9b32c35-f22a-4d35-bc80-e8af86512fa7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:36.693741 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c9b32c35-f22a-4d35-bc80-e8af86512fa7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:36.694498 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c9b32c35-f22a-4d35-bc80-e8af86512fa7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:36.694926 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c9b32c35-f22a-4d35-bc80-e8af86512fa7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:36.937322 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-c9b32c35-f22a-4d35-bc80-e8af86512fa7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:36.947747 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-c9b32c35-f22a-4d35-bc80-e8af86512fa7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:36.949270 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-c9b32c35-f22a-4d35-bc80-e8af86512fa7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:36.950448 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-c9b32c35-f22a-4d35-bc80-e8af86512fa7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1808 microversion: 2.20 time: 0.271571 Nov 23 13:04:36.951400 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 433/813] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:04:36 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1808 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:04:37.969113 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-a8b1e1da-05f0-4f56-9cea-49b3170774d6 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:04:37.969865 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-a8b1e1da-05f0-4f56-9cea-49b3170774d6 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:04:37.978399 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a8b1e1da-05f0-4f56-9cea-49b3170774d6 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:37.979634 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a8b1e1da-05f0-4f56-9cea-49b3170774d6 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:37.980718 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a8b1e1da-05f0-4f56-9cea-49b3170774d6 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:37.981209 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a8b1e1da-05f0-4f56-9cea-49b3170774d6 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:38.184402 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-a8b1e1da-05f0-4f56-9cea-49b3170774d6 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:38.195520 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-a8b1e1da-05f0-4f56-9cea-49b3170774d6 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:38.197417 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-a8b1e1da-05f0-4f56-9cea-49b3170774d6 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:38.198709 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-a8b1e1da-05f0-4f56-9cea-49b3170774d6 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1808 microversion: 2.20 time: 0.233756 Nov 23 13:04:38.199543 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 434/814] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:04:37 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1808 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 13:04:39.221024 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-5f1d67ac-eb9f-4843-a303-bff78ea3bf9a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:04:39.221731 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-5f1d67ac-eb9f-4843-a303-bff78ea3bf9a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:04:39.229239 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5f1d67ac-eb9f-4843-a303-bff78ea3bf9a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:39.229680 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5f1d67ac-eb9f-4843-a303-bff78ea3bf9a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:39.230560 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5f1d67ac-eb9f-4843-a303-bff78ea3bf9a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:39.230981 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5f1d67ac-eb9f-4843-a303-bff78ea3bf9a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:39.433304 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-5f1d67ac-eb9f-4843-a303-bff78ea3bf9a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:39.446817 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-5f1d67ac-eb9f-4843-a303-bff78ea3bf9a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:39.448326 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-5f1d67ac-eb9f-4843-a303-bff78ea3bf9a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:39.449476 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-5f1d67ac-eb9f-4843-a303-bff78ea3bf9a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1808 microversion: 2.20 time: 0.234272 Nov 23 13:04:39.450080 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 435/815] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:04:39 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1808 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:04:40.472190 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-d67783ca-13a6-478d-a968-74858cc068a2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:04:40.472898 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-d67783ca-13a6-478d-a968-74858cc068a2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:04:40.480763 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d67783ca-13a6-478d-a968-74858cc068a2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:40.481214 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d67783ca-13a6-478d-a968-74858cc068a2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:40.481986 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d67783ca-13a6-478d-a968-74858cc068a2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:40.482552 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d67783ca-13a6-478d-a968-74858cc068a2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:40.707429 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-d67783ca-13a6-478d-a968-74858cc068a2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:40.717114 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-d67783ca-13a6-478d-a968-74858cc068a2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:40.718654 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-d67783ca-13a6-478d-a968-74858cc068a2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:40.719834 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-d67783ca-13a6-478d-a968-74858cc068a2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1808 microversion: 2.20 time: 0.254178 Nov 23 13:04:40.720466 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 436/816] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:04:40 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1808 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:04:41.741911 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-fc903d3f-abb3-414f-b2ba-4095eaceb47d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:04:41.742786 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-fc903d3f-abb3-414f-b2ba-4095eaceb47d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:04:41.751191 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-fc903d3f-abb3-414f-b2ba-4095eaceb47d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:41.751648 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-fc903d3f-abb3-414f-b2ba-4095eaceb47d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:41.752448 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-fc903d3f-abb3-414f-b2ba-4095eaceb47d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:41.752898 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-fc903d3f-abb3-414f-b2ba-4095eaceb47d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:41.963840 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-fc903d3f-abb3-414f-b2ba-4095eaceb47d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:41.973765 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-fc903d3f-abb3-414f-b2ba-4095eaceb47d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:41.975496 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-fc903d3f-abb3-414f-b2ba-4095eaceb47d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:41.976658 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-fc903d3f-abb3-414f-b2ba-4095eaceb47d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1808 microversion: 2.20 time: 0.240951 Nov 23 13:04:41.977194 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 437/817] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:04:41 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1808 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:04:42.995514 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-6a15b7d9-d93a-420a-823e-4d3c87dc707a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:04:42.996373 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-6a15b7d9-d93a-420a-823e-4d3c87dc707a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:04:43.005329 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6a15b7d9-d93a-420a-823e-4d3c87dc707a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:43.005855 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6a15b7d9-d93a-420a-823e-4d3c87dc707a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:43.006736 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6a15b7d9-d93a-420a-823e-4d3c87dc707a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:43.007170 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6a15b7d9-d93a-420a-823e-4d3c87dc707a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:43.226760 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-6a15b7d9-d93a-420a-823e-4d3c87dc707a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:43.237786 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-6a15b7d9-d93a-420a-823e-4d3c87dc707a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:43.239472 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-6a15b7d9-d93a-420a-823e-4d3c87dc707a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:43.240669 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-6a15b7d9-d93a-420a-823e-4d3c87dc707a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1808 microversion: 2.20 time: 0.249318 Nov 23 13:04:43.241221 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 438/818] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:04:42 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1808 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:04:44.263459 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-2fc6ae37-e732-436c-9f00-86c982aa3bf3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:04:44.264615 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-2fc6ae37-e732-436c-9f00-86c982aa3bf3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:04:44.276990 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-2fc6ae37-e732-436c-9f00-86c982aa3bf3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:44.277746 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-2fc6ae37-e732-436c-9f00-86c982aa3bf3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:44.279037 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-2fc6ae37-e732-436c-9f00-86c982aa3bf3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:44.279721 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-2fc6ae37-e732-436c-9f00-86c982aa3bf3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:44.568807 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-2fc6ae37-e732-436c-9f00-86c982aa3bf3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:44.581989 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-2fc6ae37-e732-436c-9f00-86c982aa3bf3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:44.583694 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-2fc6ae37-e732-436c-9f00-86c982aa3bf3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:44.584867 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-2fc6ae37-e732-436c-9f00-86c982aa3bf3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1808 microversion: 2.20 time: 0.328015 Nov 23 13:04:44.585697 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 439/819] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:04:44 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1808 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:04:45.604197 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-b5dad4f9-cff5-47b7-af62-c300a78d2f71 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:04:45.605074 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-b5dad4f9-cff5-47b7-af62-c300a78d2f71 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:04:45.613849 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b5dad4f9-cff5-47b7-af62-c300a78d2f71 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:45.614574 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b5dad4f9-cff5-47b7-af62-c300a78d2f71 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:45.615169 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b5dad4f9-cff5-47b7-af62-c300a78d2f71 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:45.615643 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b5dad4f9-cff5-47b7-af62-c300a78d2f71 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:45.814284 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-b5dad4f9-cff5-47b7-af62-c300a78d2f71 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:45.823675 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-b5dad4f9-cff5-47b7-af62-c300a78d2f71 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:45.825175 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-b5dad4f9-cff5-47b7-af62-c300a78d2f71 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:45.826308 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-b5dad4f9-cff5-47b7-af62-c300a78d2f71 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1808 microversion: 2.20 time: 0.226145 Nov 23 13:04:45.826914 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 440/820] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:04:45 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1808 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:04:46.845835 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-f26ee002-29ba-4ef4-8359-78406f5adf87 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:04:46.847509 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-f26ee002-29ba-4ef4-8359-78406f5adf87 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:04:46.856711 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f26ee002-29ba-4ef4-8359-78406f5adf87 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:46.857237 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f26ee002-29ba-4ef4-8359-78406f5adf87 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:46.858015 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f26ee002-29ba-4ef4-8359-78406f5adf87 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:46.858444 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f26ee002-29ba-4ef4-8359-78406f5adf87 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:47.076695 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-f26ee002-29ba-4ef4-8359-78406f5adf87 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:47.086276 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-f26ee002-29ba-4ef4-8359-78406f5adf87 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:47.087744 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-f26ee002-29ba-4ef4-8359-78406f5adf87 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:47.088871 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-f26ee002-29ba-4ef4-8359-78406f5adf87 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1808 microversion: 2.20 time: 0.247648 Nov 23 13:04:47.089399 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 441/821] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:04:46 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1808 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 13:04:47.325601 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-44b6096f-9c89-4ca2-a737-469f54c66645 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "POST /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 15.537701 Nov 23 13:04:47.326229 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 381/822] 10.222.0.60 () {60 vars in 1322 bytes} [Tue Nov 23 13:04:31 2021] POST /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76/os-volume_attachments => generated 194 bytes in 15539 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 13:04:48.111161 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-c55c23e7-c01f-4bad-b71a-d3858c4ad30c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:04:48.111698 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-c55c23e7-c01f-4bad-b71a-d3858c4ad30c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:04:48.119974 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c55c23e7-c01f-4bad-b71a-d3858c4ad30c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:48.120466 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c55c23e7-c01f-4bad-b71a-d3858c4ad30c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:48.121274 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c55c23e7-c01f-4bad-b71a-d3858c4ad30c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:48.122218 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c55c23e7-c01f-4bad-b71a-d3858c4ad30c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:48.344989 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-c55c23e7-c01f-4bad-b71a-d3858c4ad30c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:48.354732 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-c55c23e7-c01f-4bad-b71a-d3858c4ad30c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:48.356211 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-c55c23e7-c01f-4bad-b71a-d3858c4ad30c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:48.357395 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-c55c23e7-c01f-4bad-b71a-d3858c4ad30c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1808 microversion: 2.20 time: 0.250324 Nov 23 13:04:48.357968 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 442/823] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:04:48 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1808 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:04:49.377068 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-d14662ba-2928-46bb-8d7a-8f93fae3efa6 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:04:49.377760 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-d14662ba-2928-46bb-8d7a-8f93fae3efa6 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:04:49.386529 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d14662ba-2928-46bb-8d7a-8f93fae3efa6 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:49.387097 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d14662ba-2928-46bb-8d7a-8f93fae3efa6 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:49.387823 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d14662ba-2928-46bb-8d7a-8f93fae3efa6 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:49.388263 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d14662ba-2928-46bb-8d7a-8f93fae3efa6 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:49.596386 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-d14662ba-2928-46bb-8d7a-8f93fae3efa6 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:49.606167 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-d14662ba-2928-46bb-8d7a-8f93fae3efa6 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:49.607578 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-d14662ba-2928-46bb-8d7a-8f93fae3efa6 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:49.608766 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-d14662ba-2928-46bb-8d7a-8f93fae3efa6 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1808 microversion: 2.20 time: 0.236418 Nov 23 13:04:49.609311 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 382/824] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:04:49 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1808 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:04:50.630519 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-6c28dadc-299a-437a-8f95-9c2202eb12f9 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:04:50.631178 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-6c28dadc-299a-437a-8f95-9c2202eb12f9 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:04:50.639995 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6c28dadc-299a-437a-8f95-9c2202eb12f9 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:50.640510 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6c28dadc-299a-437a-8f95-9c2202eb12f9 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:50.641348 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6c28dadc-299a-437a-8f95-9c2202eb12f9 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:50.641815 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6c28dadc-299a-437a-8f95-9c2202eb12f9 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:50.850693 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-6c28dadc-299a-437a-8f95-9c2202eb12f9 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:50.860773 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-6c28dadc-299a-437a-8f95-9c2202eb12f9 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:50.862261 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-6c28dadc-299a-437a-8f95-9c2202eb12f9 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:50.863444 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-6c28dadc-299a-437a-8f95-9c2202eb12f9 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1808 microversion: 2.20 time: 0.237495 Nov 23 13:04:50.864011 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 443/825] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:04:50 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1808 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:04:51.883244 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-bc7e0aa9-830c-4983-b58c-7d6962958bcd tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:04:51.883875 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-bc7e0aa9-830c-4983-b58c-7d6962958bcd tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:04:51.891771 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-bc7e0aa9-830c-4983-b58c-7d6962958bcd tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:51.892224 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-bc7e0aa9-830c-4983-b58c-7d6962958bcd tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:51.893009 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-bc7e0aa9-830c-4983-b58c-7d6962958bcd tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:51.893439 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-bc7e0aa9-830c-4983-b58c-7d6962958bcd tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:52.105238 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-bc7e0aa9-830c-4983-b58c-7d6962958bcd tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:52.115860 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-bc7e0aa9-830c-4983-b58c-7d6962958bcd tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:52.117454 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-bc7e0aa9-830c-4983-b58c-7d6962958bcd tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:52.118699 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-bc7e0aa9-830c-4983-b58c-7d6962958bcd tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1808 microversion: 2.20 time: 0.239424 Nov 23 13:04:52.119279 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 383/826] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:04:51 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1808 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:04:53.139227 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-8d779155-ec46-458f-9a47-7e87051669ae tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:04:53.139822 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-8d779155-ec46-458f-9a47-7e87051669ae tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:04:53.147816 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8d779155-ec46-458f-9a47-7e87051669ae tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:53.148271 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8d779155-ec46-458f-9a47-7e87051669ae tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:53.149140 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8d779155-ec46-458f-9a47-7e87051669ae tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:53.149631 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8d779155-ec46-458f-9a47-7e87051669ae tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:53.374104 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-8d779155-ec46-458f-9a47-7e87051669ae tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:53.383561 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-8d779155-ec46-458f-9a47-7e87051669ae tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:53.385087 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-8d779155-ec46-458f-9a47-7e87051669ae tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:53.386205 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-8d779155-ec46-458f-9a47-7e87051669ae tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1808 microversion: 2.20 time: 0.251025 Nov 23 13:04:53.386725 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 444/827] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:04:53 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1808 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:04:54.408586 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-64e204b9-dd92-40a8-b20f-7c1664f19268 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:04:54.409553 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-64e204b9-dd92-40a8-b20f-7c1664f19268 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:04:54.419467 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-64e204b9-dd92-40a8-b20f-7c1664f19268 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:54.419922 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-64e204b9-dd92-40a8-b20f-7c1664f19268 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:54.420704 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-64e204b9-dd92-40a8-b20f-7c1664f19268 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:54.421161 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-64e204b9-dd92-40a8-b20f-7c1664f19268 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:54.626570 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-64e204b9-dd92-40a8-b20f-7c1664f19268 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:54.635720 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-64e204b9-dd92-40a8-b20f-7c1664f19268 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:54.637228 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-64e204b9-dd92-40a8-b20f-7c1664f19268 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:54.638342 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-64e204b9-dd92-40a8-b20f-7c1664f19268 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1808 microversion: 2.20 time: 0.235854 Nov 23 13:04:54.638887 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 384/828] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:04:54 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1808 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:04:55.657071 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-734dff08-8566-4f42-8d8a-2fa1c74ca145 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:04:55.657742 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-734dff08-8566-4f42-8d8a-2fa1c74ca145 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:04:55.665182 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-734dff08-8566-4f42-8d8a-2fa1c74ca145 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:55.665627 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-734dff08-8566-4f42-8d8a-2fa1c74ca145 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:55.666407 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-734dff08-8566-4f42-8d8a-2fa1c74ca145 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:55.666824 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-734dff08-8566-4f42-8d8a-2fa1c74ca145 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:55.874965 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-734dff08-8566-4f42-8d8a-2fa1c74ca145 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:55.884131 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-734dff08-8566-4f42-8d8a-2fa1c74ca145 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:55.885659 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-734dff08-8566-4f42-8d8a-2fa1c74ca145 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:55.886860 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-734dff08-8566-4f42-8d8a-2fa1c74ca145 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1808 microversion: 2.20 time: 0.233814 Nov 23 13:04:55.887418 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 445/829] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:04:55 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1808 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:04:56.907921 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-e7cd43e9-0a54-442c-9145-34e88b52384e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:04:56.908591 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-e7cd43e9-0a54-442c-9145-34e88b52384e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:04:56.920643 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e7cd43e9-0a54-442c-9145-34e88b52384e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:56.921061 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e7cd43e9-0a54-442c-9145-34e88b52384e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:56.921865 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e7cd43e9-0a54-442c-9145-34e88b52384e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:56.922291 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e7cd43e9-0a54-442c-9145-34e88b52384e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:57.130732 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-e7cd43e9-0a54-442c-9145-34e88b52384e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:57.143527 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-e7cd43e9-0a54-442c-9145-34e88b52384e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:57.145590 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-e7cd43e9-0a54-442c-9145-34e88b52384e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:57.147283 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-e7cd43e9-0a54-442c-9145-34e88b52384e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1808 microversion: 2.20 time: 0.244775 Nov 23 13:04:57.148124 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 385/830] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:04:56 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1808 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:04:58.172279 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-c5be3901-72c1-4beb-b620-e237e18a3b93 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:04:58.173262 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-c5be3901-72c1-4beb-b620-e237e18a3b93 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:04:58.186015 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c5be3901-72c1-4beb-b620-e237e18a3b93 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:58.186745 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c5be3901-72c1-4beb-b620-e237e18a3b93 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:58.187986 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c5be3901-72c1-4beb-b620-e237e18a3b93 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:58.188748 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c5be3901-72c1-4beb-b620-e237e18a3b93 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:58.398063 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-c5be3901-72c1-4beb-b620-e237e18a3b93 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:58.407989 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-c5be3901-72c1-4beb-b620-e237e18a3b93 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:58.409509 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-c5be3901-72c1-4beb-b620-e237e18a3b93 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:58.410632 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-c5be3901-72c1-4beb-b620-e237e18a3b93 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1808 microversion: 2.20 time: 0.245176 Nov 23 13:04:58.411555 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 446/831] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:04:58 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1808 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:04:59.435207 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-953696a6-aaca-40fd-973d-e19f579b841b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:04:59.435811 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-953696a6-aaca-40fd-973d-e19f579b841b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:04:59.443504 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-953696a6-aaca-40fd-973d-e19f579b841b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:59.443973 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-953696a6-aaca-40fd-973d-e19f579b841b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:59.444782 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-953696a6-aaca-40fd-973d-e19f579b841b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:04:59.445236 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-953696a6-aaca-40fd-973d-e19f579b841b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:04:59.651098 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-953696a6-aaca-40fd-973d-e19f579b841b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:59.661206 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-953696a6-aaca-40fd-973d-e19f579b841b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:59.662097 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-953696a6-aaca-40fd-973d-e19f579b841b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:04:59.663225 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-953696a6-aaca-40fd-973d-e19f579b841b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1808 microversion: 2.20 time: 0.235212 Nov 23 13:04:59.664133 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 386/832] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:04:59 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1808 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:05:00.693615 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-3f29e732-35a1-4b07-b879-b44167968597 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:05:00.694226 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-3f29e732-35a1-4b07-b879-b44167968597 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:05:00.702116 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-3f29e732-35a1-4b07-b879-b44167968597 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:05:00.702560 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-3f29e732-35a1-4b07-b879-b44167968597 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:05:00.703551 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-3f29e732-35a1-4b07-b879-b44167968597 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:05:00.704006 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-3f29e732-35a1-4b07-b879-b44167968597 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:05:00.914931 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-3f29e732-35a1-4b07-b879-b44167968597 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:05:00.925077 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-3f29e732-35a1-4b07-b879-b44167968597 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:05:00.926648 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-3f29e732-35a1-4b07-b879-b44167968597 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:05:00.927769 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-3f29e732-35a1-4b07-b879-b44167968597 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1808 microversion: 2.20 time: 0.240631 Nov 23 13:05:00.928350 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 447/833] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:05:00 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1808 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:05:01.950383 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-b32bfedb-34be-49f8-9162-1d4ba2183523 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:05:01.951189 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-b32bfedb-34be-49f8-9162-1d4ba2183523 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:05:01.961129 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b32bfedb-34be-49f8-9162-1d4ba2183523 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:05:01.961592 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b32bfedb-34be-49f8-9162-1d4ba2183523 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:05:01.962324 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b32bfedb-34be-49f8-9162-1d4ba2183523 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:05:01.962748 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b32bfedb-34be-49f8-9162-1d4ba2183523 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:05:02.161968 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-b32bfedb-34be-49f8-9162-1d4ba2183523 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:05:02.179801 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-b32bfedb-34be-49f8-9162-1d4ba2183523 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:05:02.179801 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-b32bfedb-34be-49f8-9162-1d4ba2183523 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:05:02.179801 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-b32bfedb-34be-49f8-9162-1d4ba2183523 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1808 microversion: 2.20 time: 0.231506 Nov 23 13:05:02.180082 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 387/834] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:05:01 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1808 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:05:03.195710 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-6a72bfa5-e7a4-45a1-ba2c-ddcc171007f9 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:05:03.196415 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-6a72bfa5-e7a4-45a1-ba2c-ddcc171007f9 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:05:03.205304 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6a72bfa5-e7a4-45a1-ba2c-ddcc171007f9 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:05:03.205747 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6a72bfa5-e7a4-45a1-ba2c-ddcc171007f9 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:05:03.206525 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6a72bfa5-e7a4-45a1-ba2c-ddcc171007f9 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:05:03.206950 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6a72bfa5-e7a4-45a1-ba2c-ddcc171007f9 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:05:03.410429 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-6a72bfa5-e7a4-45a1-ba2c-ddcc171007f9 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:05:03.424970 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-6a72bfa5-e7a4-45a1-ba2c-ddcc171007f9 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:05:03.426919 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-6a72bfa5-e7a4-45a1-ba2c-ddcc171007f9 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:05:03.428085 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-6a72bfa5-e7a4-45a1-ba2c-ddcc171007f9 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1808 microversion: 2.20 time: 0.236642 Nov 23 13:05:03.428668 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 448/835] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:05:03 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1808 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:05:04.447122 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-4da3fc30-a67c-423a-a6f9-d1049cc22a9b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:05:04.447856 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-4da3fc30-a67c-423a-a6f9-d1049cc22a9b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:05:04.455718 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-4da3fc30-a67c-423a-a6f9-d1049cc22a9b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:05:04.456166 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-4da3fc30-a67c-423a-a6f9-d1049cc22a9b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:05:04.458994 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-4da3fc30-a67c-423a-a6f9-d1049cc22a9b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:05:04.458994 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-4da3fc30-a67c-423a-a6f9-d1049cc22a9b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:05:04.663146 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-4da3fc30-a67c-423a-a6f9-d1049cc22a9b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:05:04.672952 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-4da3fc30-a67c-423a-a6f9-d1049cc22a9b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:05:04.674508 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-4da3fc30-a67c-423a-a6f9-d1049cc22a9b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:05:04.675644 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-4da3fc30-a67c-423a-a6f9-d1049cc22a9b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1808 microversion: 2.20 time: 0.232476 Nov 23 13:05:04.676220 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 388/836] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:05:04 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1808 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:05:05.702479 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-150ee41f-3d07-4657-914d-39a1e086a1c3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:05:05.703055 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-150ee41f-3d07-4657-914d-39a1e086a1c3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:05:05.711881 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-150ee41f-3d07-4657-914d-39a1e086a1c3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:05:05.714048 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-150ee41f-3d07-4657-914d-39a1e086a1c3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:05:05.714929 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-150ee41f-3d07-4657-914d-39a1e086a1c3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:05:05.715414 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-150ee41f-3d07-4657-914d-39a1e086a1c3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:05:05.925217 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-150ee41f-3d07-4657-914d-39a1e086a1c3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:05:05.938892 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-150ee41f-3d07-4657-914d-39a1e086a1c3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:05:05.940574 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-150ee41f-3d07-4657-914d-39a1e086a1c3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:05:05.941718 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-150ee41f-3d07-4657-914d-39a1e086a1c3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1808 microversion: 2.20 time: 0.245409 Nov 23 13:05:05.942538 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 449/837] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:05:05 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1808 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:05:06.966610 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-6320d959-732e-46a7-82a2-2a6868eb31f1 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:05:06.967544 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-6320d959-732e-46a7-82a2-2a6868eb31f1 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:05:06.980356 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-6320d959-732e-46a7-82a2-2a6868eb31f1 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:05:06.981140 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-6320d959-732e-46a7-82a2-2a6868eb31f1 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:05:06.982752 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-6320d959-732e-46a7-82a2-2a6868eb31f1 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:05:06.983835 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-6320d959-732e-46a7-82a2-2a6868eb31f1 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:05:07.200785 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-6320d959-732e-46a7-82a2-2a6868eb31f1 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:05:07.210693 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-6320d959-732e-46a7-82a2-2a6868eb31f1 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:05:07.212225 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-6320d959-732e-46a7-82a2-2a6868eb31f1 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:05:07.213406 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-6320d959-732e-46a7-82a2-2a6868eb31f1 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1808 microversion: 2.20 time: 0.253511 Nov 23 13:05:07.213976 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 389/838] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:05:06 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1808 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:05:08.230967 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-841d7c6f-c150-490a-bad7-9a40cb97ff14 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:05:08.231585 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-841d7c6f-c150-490a-bad7-9a40cb97ff14 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:05:08.239350 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-841d7c6f-c150-490a-bad7-9a40cb97ff14 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:05:08.239798 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-841d7c6f-c150-490a-bad7-9a40cb97ff14 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:05:08.240627 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-841d7c6f-c150-490a-bad7-9a40cb97ff14 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:05:08.241054 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-841d7c6f-c150-490a-bad7-9a40cb97ff14 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:05:08.437997 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-841d7c6f-c150-490a-bad7-9a40cb97ff14 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:05:08.447808 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-841d7c6f-c150-490a-bad7-9a40cb97ff14 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:05:08.449330 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-841d7c6f-c150-490a-bad7-9a40cb97ff14 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:05:08.450448 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-841d7c6f-c150-490a-bad7-9a40cb97ff14 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1808 microversion: 2.20 time: 0.223427 Nov 23 13:05:08.451173 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 450/839] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:05:08 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1808 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:05:08.553643 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-6e8dbe3b-7c3c-47c4-bc17-ac49ec44bfa6 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:05:08.554262 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-6e8dbe3b-7c3c-47c4-bc17-ac49ec44bfa6 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:05:08.562093 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-6e8dbe3b-7c3c-47c4-bc17-ac49ec44bfa6 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:05:08.562512 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-6e8dbe3b-7c3c-47c4-bc17-ac49ec44bfa6 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:05:08.563282 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-6e8dbe3b-7c3c-47c4-bc17-ac49ec44bfa6 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:05:08.563748 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-6e8dbe3b-7c3c-47c4-bc17-ac49ec44bfa6 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:05:08.783059 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-6e8dbe3b-7c3c-47c4-bc17-ac49ec44bfa6 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:05:08.791900 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-6e8dbe3b-7c3c-47c4-bc17-ac49ec44bfa6 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1592 microversion: 2.1 time: 0.242080 Nov 23 13:05:08.792512 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 390/840] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:05:08 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1592 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:05:09.470810 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-c638ebc4-9178-4dc3-8c20-ebb6d3b57877 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:05:09.472317 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-c638ebc4-9178-4dc3-8c20-ebb6d3b57877 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:05:09.482158 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c638ebc4-9178-4dc3-8c20-ebb6d3b57877 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:05:09.482627 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c638ebc4-9178-4dc3-8c20-ebb6d3b57877 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:05:09.483542 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c638ebc4-9178-4dc3-8c20-ebb6d3b57877 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:05:09.483979 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c638ebc4-9178-4dc3-8c20-ebb6d3b57877 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:05:09.823850 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [req-08f81004-3877-4bc6-b208-84d1ca1562e4 req-bcd38f21-9980-4548-bcba-d498d3bf2bb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9c21729-a176-4e26-9074-f5f0bfc0ce20", "name": "network-vif-plugged", "status": "completed", "tag": "acc6c8bf-82a2-4f88-b12e-f6a39d6ce970"}]} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:05:09.825652 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 13:05:09.825652 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: warnings.warn(msg) Nov 23 13:05:09.840547 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [req-08f81004-3877-4bc6-b208-84d1ca1562e4 req-bcd38f21-9980-4548-bcba-d498d3bf2bb0 service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:05:09.840986 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [req-08f81004-3877-4bc6-b208-84d1ca1562e4 req-bcd38f21-9980-4548-bcba-d498d3bf2bb0 service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:05:09.881117 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.compute.server_external_events [req-08f81004-3877-4bc6-b208-84d1ca1562e4 req-bcd38f21-9980-4548-bcba-d498d3bf2bb0 service nova] Creating event network-vif-plugged:acc6c8bf-82a2-4f88-b12e-f6a39d6ce970 for instance b9c21729-a176-4e26-9074-f5f0bfc0ce20 on hv-cinder-81888 Nov 23 13:05:09.887853 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [req-08f81004-3877-4bc6-b208-84d1ca1562e4 req-bcd38f21-9980-4548-bcba-d498d3bf2bb0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.207269 Nov 23 13:05:09.891038 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 391/841] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Nov 23 13:05:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 13:05:10.025557 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-c638ebc4-9178-4dc3-8c20-ebb6d3b57877 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:05:10.036008 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-c638ebc4-9178-4dc3-8c20-ebb6d3b57877 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:05:10.037642 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-c638ebc4-9178-4dc3-8c20-ebb6d3b57877 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:05:10.038777 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-c638ebc4-9178-4dc3-8c20-ebb6d3b57877 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1808 microversion: 2.20 time: 0.573692 Nov 23 13:05:10.039322 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 451/842] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:05:09 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1808 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:05:11.058686 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-79155f49-b212-4cef-a766-dedb15902c68 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:05:11.059458 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-79155f49-b212-4cef-a766-dedb15902c68 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:05:11.067326 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-79155f49-b212-4cef-a766-dedb15902c68 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:05:11.067775 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-79155f49-b212-4cef-a766-dedb15902c68 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:05:11.068574 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-79155f49-b212-4cef-a766-dedb15902c68 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:05:11.068999 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-79155f49-b212-4cef-a766-dedb15902c68 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:05:11.273975 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-79155f49-b212-4cef-a766-dedb15902c68 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:05:11.283623 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-79155f49-b212-4cef-a766-dedb15902c68 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:05:11.285166 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-79155f49-b212-4cef-a766-dedb15902c68 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:05:11.286303 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-79155f49-b212-4cef-a766-dedb15902c68 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1808 microversion: 2.20 time: 0.231823 Nov 23 13:05:11.286846 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 392/843] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:05:11 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1808 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:05:11.717644 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [req-2424b11b-54b6-479c-94c1-dd932fba980f req-77b6b43f-6dce-4129-965f-93e2d91e0f02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74e06412-022d-4ece-920d-1cba08639d76", "tag": "2f280c1a-d79b-4581-bd2b-add5ec70ac56"}]} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:05:11.720601 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 13:05:11.720601 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: warnings.warn(msg) Nov 23 13:05:11.730136 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [req-2424b11b-54b6-479c-94c1-dd932fba980f req-77b6b43f-6dce-4129-965f-93e2d91e0f02 service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:05:11.730586 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [req-2424b11b-54b6-479c-94c1-dd932fba980f req-77b6b43f-6dce-4129-965f-93e2d91e0f02 service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:05:11.749606 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.compute.server_external_events [req-2424b11b-54b6-479c-94c1-dd932fba980f req-77b6b43f-6dce-4129-965f-93e2d91e0f02 service nova] Creating event network-changed:2f280c1a-d79b-4581-bd2b-add5ec70ac56 for instance 74e06412-022d-4ece-920d-1cba08639d76 on hv-cinder-81888 Nov 23 13:05:11.755149 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [req-2424b11b-54b6-479c-94c1-dd932fba980f req-77b6b43f-6dce-4129-965f-93e2d91e0f02 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111686 Nov 23 13:05:11.756189 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 452/844] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Nov 23 13:05:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 13:05:12.304728 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-77e05ad7-958e-4521-8e8b-bb79d0b4cddb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:05:12.305492 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-77e05ad7-958e-4521-8e8b-bb79d0b4cddb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:05:12.315767 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-77e05ad7-958e-4521-8e8b-bb79d0b4cddb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:05:12.316223 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-77e05ad7-958e-4521-8e8b-bb79d0b4cddb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:05:12.317371 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-77e05ad7-958e-4521-8e8b-bb79d0b4cddb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:05:12.318339 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-77e05ad7-958e-4521-8e8b-bb79d0b4cddb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:05:12.743481 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-77e05ad7-958e-4521-8e8b-bb79d0b4cddb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:05:12.770929 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-77e05ad7-958e-4521-8e8b-bb79d0b4cddb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:05:12.772847 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-77e05ad7-958e-4521-8e8b-bb79d0b4cddb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:05:12.774647 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-77e05ad7-958e-4521-8e8b-bb79d0b4cddb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1808 microversion: 2.20 time: 0.473733 Nov 23 13:05:12.776114 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 393/845] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:05:12 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1808 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 13:05:12.978320 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-0784329a-94c7-4821-a4f5-e2ec2380c2bb tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-808218229"}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:05:12.978946 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-0784329a-94c7-4821-a4f5-e2ec2380c2bb tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:05:12.988160 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0784329a-94c7-4821-a4f5-e2ec2380c2bb tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:05:12.988905 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0784329a-94c7-4821-a4f5-e2ec2380c2bb tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:05:12.989990 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0784329a-94c7-4821-a4f5-e2ec2380c2bb tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:05:12.990762 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0784329a-94c7-4821-a4f5-e2ec2380c2bb tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:05:13.228651 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.network.security_group_api [None req-0784329a-94c7-4821-a4f5-e2ec2380c2bb tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Adding security group 92c6093d-188a-4e7e-92b1-c3497d5f8bb1 to port 2f280c1a-d79b-4581-bd2b-add5ec70ac56 Nov 23 13:05:13.795458 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-a8236c70-8704-481e-998a-616137c859f5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:05:13.799431 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-0784329a-94c7-4821-a4f5-e2ec2380c2bb tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "POST /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76/action" status: 202 len: 0 microversion: 2.1 time: 0.825343 Nov 23 13:05:13.800512 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 453/846] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:05:12 2021] POST /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76/action => generated 0 bytes in 827 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:05:13.801839 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-a8236c70-8704-481e-998a-616137c859f5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:05:13.808846 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-f2d33dfe-7907-4f53-ba37-2526a3e3189a tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:05:13.816151 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-f2d33dfe-7907-4f53-ba37-2526a3e3189a tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:05:13.835767 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a8236c70-8704-481e-998a-616137c859f5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:05:13.846966 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a8236c70-8704-481e-998a-616137c859f5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:05:13.849470 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a8236c70-8704-481e-998a-616137c859f5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:05:13.849889 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a8236c70-8704-481e-998a-616137c859f5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:05:13.861950 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f2d33dfe-7907-4f53-ba37-2526a3e3189a tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:05:13.862391 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f2d33dfe-7907-4f53-ba37-2526a3e3189a tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:05:13.863183 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f2d33dfe-7907-4f53-ba37-2526a3e3189a tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:05:13.863611 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f2d33dfe-7907-4f53-ba37-2526a3e3189a tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:05:14.186087 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-a8236c70-8704-481e-998a-616137c859f5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:05:14.198047 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-a8236c70-8704-481e-998a-616137c859f5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:05:14.200001 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-a8236c70-8704-481e-998a-616137c859f5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:05:14.202164 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-a8236c70-8704-481e-998a-616137c859f5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1808 microversion: 2.20 time: 0.411399 Nov 23 13:05:14.203461 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 394/847] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:05:13 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1808 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:05:14.209211 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [req-67769cbf-e6df-4934-8a2a-a61b78ddbe22 req-69c5d360-5893-4d91-8765-98e17c31c9d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74e06412-022d-4ece-920d-1cba08639d76", "tag": "2f280c1a-d79b-4581-bd2b-add5ec70ac56"}]} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:05:14.211055 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 13:05:14.211055 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: warnings.warn(msg) Nov 23 13:05:14.220819 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [req-67769cbf-e6df-4934-8a2a-a61b78ddbe22 req-69c5d360-5893-4d91-8765-98e17c31c9d8 service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:05:14.221846 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [req-67769cbf-e6df-4934-8a2a-a61b78ddbe22 req-69c5d360-5893-4d91-8765-98e17c31c9d8 service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:05:14.252593 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-f2d33dfe-7907-4f53-ba37-2526a3e3189a tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:05:14.268057 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-f2d33dfe-7907-4f53-ba37-2526a3e3189a tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1757 microversion: 2.1 time: 0.459218 Nov 23 13:05:14.269200 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 454/848] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:05:13 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1757 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:05:14.286588 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.compute.server_external_events [req-67769cbf-e6df-4934-8a2a-a61b78ddbe22 req-69c5d360-5893-4d91-8765-98e17c31c9d8 service nova] Creating event network-changed:2f280c1a-d79b-4581-bd2b-add5ec70ac56 for instance 74e06412-022d-4ece-920d-1cba08639d76 on hv-cinder-81888 Nov 23 13:05:14.295445 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [req-67769cbf-e6df-4934-8a2a-a61b78ddbe22 req-69c5d360-5893-4d91-8765-98e17c31c9d8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090425 Nov 23 13:05:14.298319 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 395/849] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Nov 23 13:05:14 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 13:05:15.222892 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-2396804d-2230-493d-9868-7d06bcee0367 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:05:15.223719 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-2396804d-2230-493d-9868-7d06bcee0367 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:05:15.233295 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-2396804d-2230-493d-9868-7d06bcee0367 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:05:15.233940 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-2396804d-2230-493d-9868-7d06bcee0367 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:05:15.234912 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-2396804d-2230-493d-9868-7d06bcee0367 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:05:15.235593 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-2396804d-2230-493d-9868-7d06bcee0367 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:05:15.477946 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-2396804d-2230-493d-9868-7d06bcee0367 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:05:15.490285 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-2396804d-2230-493d-9868-7d06bcee0367 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:05:15.491827 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-2396804d-2230-493d-9868-7d06bcee0367 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:05:15.493004 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-2396804d-2230-493d-9868-7d06bcee0367 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1795 microversion: 2.20 time: 0.275311 Nov 23 13:05:15.496946 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 455/850] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:05:15 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1795 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:05:37.893796 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-fca39fa9-7f98-4ddc-b9b1-cf3f9e9d257c tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1805219601", "imageRef": "d01e1b62-4f14-4f64-9d63-d155732e33e8", "flavorRef": "452", "networks": [{"uuid": "e1230013-ce46-4fbc-acb4-a6a5cbb5b11d"}]}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:05:37.959934 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.network.neutron [None req-fca39fa9-7f98-4ddc-b9b1-cf3f9e9d257c tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] validate_networks() for [('e1230013-ce46-4fbc-acb4-a6a5cbb5b11d', None, None, None)] {{(pid=100974) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Nov 23 13:05:38.529970 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.virt.hardware [None req-fca39fa9-7f98-4ddc-b9b1-cf3f9e9d257c tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Flavor limits 0:0:0 {{(pid=100974) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 23 13:05:38.530395 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.virt.hardware [None req-fca39fa9-7f98-4ddc-b9b1-cf3f9e9d257c tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Image limits 0:0:0 {{(pid=100974) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 23 13:05:38.530867 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.virt.hardware [None req-fca39fa9-7f98-4ddc-b9b1-cf3f9e9d257c tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Flavor pref 0:0:0 {{(pid=100974) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 23 13:05:38.531291 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.virt.hardware [None req-fca39fa9-7f98-4ddc-b9b1-cf3f9e9d257c tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Image pref 0:0:0 {{(pid=100974) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 23 13:05:38.531699 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.virt.hardware [None req-fca39fa9-7f98-4ddc-b9b1-cf3f9e9d257c tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100974) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 23 13:05:38.540565 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-fca39fa9-7f98-4ddc-b9b1-cf3f9e9d257c tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:05:38.541006 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-fca39fa9-7f98-4ddc-b9b1-cf3f9e9d257c tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:05:38.541794 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-fca39fa9-7f98-4ddc-b9b1-cf3f9e9d257c tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:05:38.542218 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-fca39fa9-7f98-4ddc-b9b1-cf3f9e9d257c tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:05:38.559157 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.quota [None req-fca39fa9-7f98-4ddc-b9b1-cf3f9e9d257c tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Getting quotas for project 90112b6f3d31421a8ee18cbe7d6b0537. Resources: {'ram', 'cores', 'instances'} {{(pid=100974) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 13:05:38.563242 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.quota [None req-fca39fa9-7f98-4ddc-b9b1-cf3f9e9d257c tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Getting quotas for user 6eb8e090f8ae4a2381c9b82a8090f112 and project 90112b6f3d31421a8ee18cbe7d6b0537. Resources: {'ram', 'cores', 'instances'} {{(pid=100974) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 13:05:38.574489 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-fca39fa9-7f98-4ddc-b9b1-cf3f9e9d257c tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Going to run 1 instances... {{(pid=100974) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Nov 23 13:05:38.576943 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-fca39fa9-7f98-4ddc-b9b1-cf3f9e9d257c tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] [instance: f6d81116-5b48-433f-8c7e-88f2a9687167] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d01e1b62-4f14-4f64-9d63-d155732e33e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100974) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Nov 23 13:05:38.624972 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-fca39fa9-7f98-4ddc-b9b1-cf3f9e9d257c tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.736046 Nov 23 13:05:38.625605 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 396/851] 10.222.0.60 () {60 vars in 1146 bytes} [Tue Nov 23 13:05:37 2021] POST /compute/v2.1/servers => generated 380 bytes in 738 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 23 13:05:38.635891 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-39e9f791-913b-4ea2-bb7d-fb56ff0abae3 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:05:38.636579 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-39e9f791-913b-4ea2-bb7d-fb56ff0abae3 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] [instance: f6d81116-5b48-433f-8c7e-88f2a9687167] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:05:38.710111 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-39e9f791-913b-4ea2-bb7d-fb56ff0abae3 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb8e090f8ae4a2381c9b82a8090f112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90112b6f3d31421a8ee18cbe7d6b0537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:05:38.717795 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-39e9f791-913b-4ea2-bb7d-fb56ff0abae3 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] 10.222.0.60 "GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167" status: 200 len: 1219 microversion: 2.1 time: 0.085777 Nov 23 13:05:38.718366 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 456/852] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:05:38 2021] GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:05:39.735598 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-267f5e18-6305-48f8-b0cd-671e83744835 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:05:39.736186 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-267f5e18-6305-48f8-b0cd-671e83744835 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] [instance: f6d81116-5b48-433f-8c7e-88f2a9687167] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:05:39.744387 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-267f5e18-6305-48f8-b0cd-671e83744835 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:05:39.744837 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-267f5e18-6305-48f8-b0cd-671e83744835 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:05:39.745610 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-267f5e18-6305-48f8-b0cd-671e83744835 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:05:39.746040 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-267f5e18-6305-48f8-b0cd-671e83744835 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:05:39.860955 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-267f5e18-6305-48f8-b0cd-671e83744835 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb8e090f8ae4a2381c9b82a8090f112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90112b6f3d31421a8ee18cbe7d6b0537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:05:39.873256 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-267f5e18-6305-48f8-b0cd-671e83744835 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] 10.222.0.60 "GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167" status: 200 len: 1223 microversion: 2.1 time: 0.141355 Nov 23 13:05:39.874118 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 397/853] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:05:39 2021] GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167 => generated 1223 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:05:40.894067 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-e7e84824-92d9-4fa7-92d4-d0a03a0301a0 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:05:40.895150 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-e7e84824-92d9-4fa7-92d4-d0a03a0301a0 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] [instance: f6d81116-5b48-433f-8c7e-88f2a9687167] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:05:40.906001 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e7e84824-92d9-4fa7-92d4-d0a03a0301a0 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:05:40.906439 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e7e84824-92d9-4fa7-92d4-d0a03a0301a0 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:05:40.907194 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e7e84824-92d9-4fa7-92d4-d0a03a0301a0 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:05:40.907649 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e7e84824-92d9-4fa7-92d4-d0a03a0301a0 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:05:41.021008 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-e7e84824-92d9-4fa7-92d4-d0a03a0301a0 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb8e090f8ae4a2381c9b82a8090f112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90112b6f3d31421a8ee18cbe7d6b0537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:05:41.029660 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-e7e84824-92d9-4fa7-92d4-d0a03a0301a0 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] 10.222.0.60 "GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167" status: 200 len: 1215 microversion: 2.1 time: 0.142303 Nov 23 13:05:41.030236 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 457/854] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:05:40 2021] GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167 => generated 1215 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:05:42.049851 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-458b45ed-0fbf-46cd-ab8d-51460d4d92ac tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:05:42.050571 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-458b45ed-0fbf-46cd-ab8d-51460d4d92ac tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] [instance: f6d81116-5b48-433f-8c7e-88f2a9687167] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:05:42.060447 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-458b45ed-0fbf-46cd-ab8d-51460d4d92ac tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:05:42.060998 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-458b45ed-0fbf-46cd-ab8d-51460d4d92ac tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:05:42.061941 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-458b45ed-0fbf-46cd-ab8d-51460d4d92ac tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:05:42.062468 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-458b45ed-0fbf-46cd-ab8d-51460d4d92ac tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:05:42.183870 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-458b45ed-0fbf-46cd-ab8d-51460d4d92ac tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb8e090f8ae4a2381c9b82a8090f112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90112b6f3d31421a8ee18cbe7d6b0537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:05:42.198116 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-458b45ed-0fbf-46cd-ab8d-51460d4d92ac tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] 10.222.0.60 "GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167" status: 200 len: 1215 microversion: 2.1 time: 0.152849 Nov 23 13:05:42.199037 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 398/855] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:05:42 2021] GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167 => generated 1215 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:05:43.215827 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-ec0b75b0-440c-425f-a572-abb868b83a57 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:05:43.216434 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-ec0b75b0-440c-425f-a572-abb868b83a57 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] [instance: f6d81116-5b48-433f-8c7e-88f2a9687167] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:05:43.225110 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ec0b75b0-440c-425f-a572-abb868b83a57 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:05:43.225735 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ec0b75b0-440c-425f-a572-abb868b83a57 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:05:43.226558 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ec0b75b0-440c-425f-a572-abb868b83a57 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:05:43.227040 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ec0b75b0-440c-425f-a572-abb868b83a57 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:05:43.346333 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-ec0b75b0-440c-425f-a572-abb868b83a57 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb8e090f8ae4a2381c9b82a8090f112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90112b6f3d31421a8ee18cbe7d6b0537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:05:43.354549 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-ec0b75b0-440c-425f-a572-abb868b83a57 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] 10.222.0.60 "GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167" status: 200 len: 1279 microversion: 2.1 time: 0.142636 Nov 23 13:05:43.355323 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 458/856] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:05:43 2021] GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167 => generated 1279 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:05:44.371037 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-50694a78-c68b-4d24-9386-b9b618bb8819 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:05:44.371910 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-50694a78-c68b-4d24-9386-b9b618bb8819 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] [instance: f6d81116-5b48-433f-8c7e-88f2a9687167] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:05:44.379395 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-50694a78-c68b-4d24-9386-b9b618bb8819 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:05:44.379891 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-50694a78-c68b-4d24-9386-b9b618bb8819 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:05:44.380968 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-50694a78-c68b-4d24-9386-b9b618bb8819 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:05:44.381378 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-50694a78-c68b-4d24-9386-b9b618bb8819 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:05:44.791935 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-50694a78-c68b-4d24-9386-b9b618bb8819 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb8e090f8ae4a2381c9b82a8090f112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90112b6f3d31421a8ee18cbe7d6b0537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:05:44.800393 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-50694a78-c68b-4d24-9386-b9b618bb8819 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] 10.222.0.60 "GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167" status: 200 len: 1319 microversion: 2.1 time: 0.433149 Nov 23 13:05:44.811523 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 399/857] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:05:44 2021] GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167 => generated 1319 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:05:45.374167 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [req-8b8f2c08-bff5-4404-b200-e345cb1bf26f req-5abd7ee5-2daa-4313-b62e-dc08dffe8fa9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6d81116-5b48-433f-8c7e-88f2a9687167", "tag": "387ca8eb-21e0-4037-8ccb-e97d8f90b3e2"}]} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:05:45.375722 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 13:05:45.375722 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: warnings.warn(msg) Nov 23 13:05:45.383993 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [req-8b8f2c08-bff5-4404-b200-e345cb1bf26f req-5abd7ee5-2daa-4313-b62e-dc08dffe8fa9 service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:05:45.384466 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [req-8b8f2c08-bff5-4404-b200-e345cb1bf26f req-5abd7ee5-2daa-4313-b62e-dc08dffe8fa9 service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:05:45.400317 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.compute.server_external_events [req-8b8f2c08-bff5-4404-b200-e345cb1bf26f req-5abd7ee5-2daa-4313-b62e-dc08dffe8fa9 service nova] Creating event network-changed:387ca8eb-21e0-4037-8ccb-e97d8f90b3e2 for instance f6d81116-5b48-433f-8c7e-88f2a9687167 on hv-cinder-81888 Nov 23 13:05:45.405463 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [req-8b8f2c08-bff5-4404-b200-e345cb1bf26f req-5abd7ee5-2daa-4313-b62e-dc08dffe8fa9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.169598 Nov 23 13:05:45.406028 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 459/858] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Nov 23 13:05:45 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 13:05:45.819934 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-0f029fb7-3546-49ed-8278-d2575f1402d3 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:05:45.820688 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-0f029fb7-3546-49ed-8278-d2575f1402d3 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] [instance: f6d81116-5b48-433f-8c7e-88f2a9687167] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:05:45.828375 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0f029fb7-3546-49ed-8278-d2575f1402d3 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:05:45.828831 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0f029fb7-3546-49ed-8278-d2575f1402d3 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:05:45.829603 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0f029fb7-3546-49ed-8278-d2575f1402d3 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:05:45.830037 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0f029fb7-3546-49ed-8278-d2575f1402d3 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:05:46.049935 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-0f029fb7-3546-49ed-8278-d2575f1402d3 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb8e090f8ae4a2381c9b82a8090f112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90112b6f3d31421a8ee18cbe7d6b0537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:05:46.058181 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-0f029fb7-3546-49ed-8278-d2575f1402d3 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] 10.222.0.60 "GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167" status: 200 len: 1319 microversion: 2.1 time: 0.242906 Nov 23 13:05:46.067736 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 400/859] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:05:45 2021] GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167 => generated 1319 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:05:47.080965 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-4f6d2498-9c47-4ade-a7f1-a0cf6135aa65 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:05:47.082162 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-4f6d2498-9c47-4ade-a7f1-a0cf6135aa65 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] [instance: f6d81116-5b48-433f-8c7e-88f2a9687167] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:05:47.094558 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4f6d2498-9c47-4ade-a7f1-a0cf6135aa65 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:05:47.095035 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4f6d2498-9c47-4ade-a7f1-a0cf6135aa65 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:05:47.095800 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4f6d2498-9c47-4ade-a7f1-a0cf6135aa65 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:05:47.096248 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4f6d2498-9c47-4ade-a7f1-a0cf6135aa65 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:05:47.325906 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-4f6d2498-9c47-4ade-a7f1-a0cf6135aa65 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb8e090f8ae4a2381c9b82a8090f112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90112b6f3d31421a8ee18cbe7d6b0537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:05:47.334475 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-4f6d2498-9c47-4ade-a7f1-a0cf6135aa65 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] 10.222.0.60 "GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167" status: 200 len: 1319 microversion: 2.1 time: 0.261626 Nov 23 13:05:47.335197 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 460/860] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:05:47 2021] GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167 => generated 1319 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:05:48.355276 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-a241daf8-97cd-4bf8-bd38-093544a6423e tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:05:48.356211 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-a241daf8-97cd-4bf8-bd38-093544a6423e tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] [instance: f6d81116-5b48-433f-8c7e-88f2a9687167] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:05:48.368721 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a241daf8-97cd-4bf8-bd38-093544a6423e tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:05:48.369466 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a241daf8-97cd-4bf8-bd38-093544a6423e tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:05:48.370730 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a241daf8-97cd-4bf8-bd38-093544a6423e tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:05:48.371792 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a241daf8-97cd-4bf8-bd38-093544a6423e tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:05:48.584200 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-a241daf8-97cd-4bf8-bd38-093544a6423e tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb8e090f8ae4a2381c9b82a8090f112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90112b6f3d31421a8ee18cbe7d6b0537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:05:48.592697 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-a241daf8-97cd-4bf8-bd38-093544a6423e tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] 10.222.0.60 "GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167" status: 200 len: 1319 microversion: 2.1 time: 0.244017 Nov 23 13:05:48.593540 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 401/861] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:05:48 2021] GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167 => generated 1319 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:05:49.611817 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-82f3c9dd-b4cb-45b7-8188-7486aeb0fc5d tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:05:49.612774 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-82f3c9dd-b4cb-45b7-8188-7486aeb0fc5d tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] [instance: f6d81116-5b48-433f-8c7e-88f2a9687167] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:05:49.621995 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-82f3c9dd-b4cb-45b7-8188-7486aeb0fc5d tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:05:49.622526 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-82f3c9dd-b4cb-45b7-8188-7486aeb0fc5d tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:05:49.623470 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-82f3c9dd-b4cb-45b7-8188-7486aeb0fc5d tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:05:49.623996 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-82f3c9dd-b4cb-45b7-8188-7486aeb0fc5d tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:05:49.833937 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-82f3c9dd-b4cb-45b7-8188-7486aeb0fc5d tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb8e090f8ae4a2381c9b82a8090f112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90112b6f3d31421a8ee18cbe7d6b0537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:05:49.845886 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-82f3c9dd-b4cb-45b7-8188-7486aeb0fc5d tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] 10.222.0.60 "GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167" status: 200 len: 1319 microversion: 2.1 time: 0.239049 Nov 23 13:05:49.856122 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 461/862] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:05:49 2021] GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167 => generated 1319 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:05:50.863101 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-2b7da132-5045-4794-8c88-e0d30a0343d9 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:05:50.864094 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-2b7da132-5045-4794-8c88-e0d30a0343d9 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] [instance: f6d81116-5b48-433f-8c7e-88f2a9687167] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:05:50.872508 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2b7da132-5045-4794-8c88-e0d30a0343d9 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:05:50.872961 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2b7da132-5045-4794-8c88-e0d30a0343d9 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:05:50.874004 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2b7da132-5045-4794-8c88-e0d30a0343d9 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:05:50.874229 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2b7da132-5045-4794-8c88-e0d30a0343d9 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:05:51.074228 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-2b7da132-5045-4794-8c88-e0d30a0343d9 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb8e090f8ae4a2381c9b82a8090f112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90112b6f3d31421a8ee18cbe7d6b0537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:05:51.082986 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-2b7da132-5045-4794-8c88-e0d30a0343d9 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] 10.222.0.60 "GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167" status: 200 len: 1319 microversion: 2.1 time: 0.223657 Nov 23 13:05:51.083808 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 402/863] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:05:50 2021] GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167 => generated 1319 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:05:52.062000 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [req-c8bb1fed-0fb6-45f4-9962-f914524c5d1a req-a2fb2f20-5946-4a18-8820-abf994672926 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6d81116-5b48-433f-8c7e-88f2a9687167", "name": "network-vif-plugged", "status": "completed", "tag": "387ca8eb-21e0-4037-8ccb-e97d8f90b3e2"}]} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:05:52.063622 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 13:05:52.063622 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: warnings.warn(msg) Nov 23 13:05:52.073522 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [req-c8bb1fed-0fb6-45f4-9962-f914524c5d1a req-a2fb2f20-5946-4a18-8820-abf994672926 service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:05:52.073978 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [req-c8bb1fed-0fb6-45f4-9962-f914524c5d1a req-a2fb2f20-5946-4a18-8820-abf994672926 service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:05:52.090843 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.compute.server_external_events [req-c8bb1fed-0fb6-45f4-9962-f914524c5d1a req-a2fb2f20-5946-4a18-8820-abf994672926 service nova] Creating event network-vif-plugged:387ca8eb-21e0-4037-8ccb-e97d8f90b3e2 for instance f6d81116-5b48-433f-8c7e-88f2a9687167 on hv-cinder-81888 Nov 23 13:05:52.097728 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [req-c8bb1fed-0fb6-45f4-9962-f914524c5d1a req-a2fb2f20-5946-4a18-8820-abf994672926 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040355 Nov 23 13:05:52.098839 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 462/864] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Nov 23 13:05:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 13:05:52.100745 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-2c578137-6172-49de-8975-55c77afb4af0 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:05:52.101350 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-2c578137-6172-49de-8975-55c77afb4af0 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] [instance: f6d81116-5b48-433f-8c7e-88f2a9687167] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:05:52.109210 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2c578137-6172-49de-8975-55c77afb4af0 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:05:52.109767 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2c578137-6172-49de-8975-55c77afb4af0 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:05:52.110422 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2c578137-6172-49de-8975-55c77afb4af0 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:05:52.111027 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2c578137-6172-49de-8975-55c77afb4af0 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:05:52.454813 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-2c578137-6172-49de-8975-55c77afb4af0 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb8e090f8ae4a2381c9b82a8090f112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90112b6f3d31421a8ee18cbe7d6b0537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:05:52.465108 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-2c578137-6172-49de-8975-55c77afb4af0 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] 10.222.0.60 "GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167" status: 200 len: 1319 microversion: 2.1 time: 0.368164 Nov 23 13:05:52.477074 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 403/865] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:05:52 2021] GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167 => generated 1319 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 13:05:53.484032 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-82896355-55e1-43d5-8fca-8339dca3bcfe tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:05:53.485632 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-82896355-55e1-43d5-8fca-8339dca3bcfe tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] [instance: f6d81116-5b48-433f-8c7e-88f2a9687167] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:05:53.494779 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-82896355-55e1-43d5-8fca-8339dca3bcfe tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:05:53.495740 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-82896355-55e1-43d5-8fca-8339dca3bcfe tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:05:53.497275 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-82896355-55e1-43d5-8fca-8339dca3bcfe tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:05:53.497909 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-82896355-55e1-43d5-8fca-8339dca3bcfe tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:05:53.961167 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-82896355-55e1-43d5-8fca-8339dca3bcfe tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb8e090f8ae4a2381c9b82a8090f112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90112b6f3d31421a8ee18cbe7d6b0537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:05:53.970430 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-82896355-55e1-43d5-8fca-8339dca3bcfe tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] 10.222.0.60 "GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167" status: 200 len: 1319 microversion: 2.1 time: 0.490754 Nov 23 13:05:53.971161 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 463/866] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:05:53 2021] GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167 => generated 1319 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:05:54.986978 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-77a8c11b-5754-4442-afbb-987b6f9bf8e6 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:05:54.987662 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-77a8c11b-5754-4442-afbb-987b6f9bf8e6 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] [instance: f6d81116-5b48-433f-8c7e-88f2a9687167] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:05:54.995364 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-77a8c11b-5754-4442-afbb-987b6f9bf8e6 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:05:54.995760 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-77a8c11b-5754-4442-afbb-987b6f9bf8e6 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:05:54.996893 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-77a8c11b-5754-4442-afbb-987b6f9bf8e6 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:05:54.997314 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-77a8c11b-5754-4442-afbb-987b6f9bf8e6 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:05:55.226944 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-77a8c11b-5754-4442-afbb-987b6f9bf8e6 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb8e090f8ae4a2381c9b82a8090f112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90112b6f3d31421a8ee18cbe7d6b0537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:05:55.236361 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-77a8c11b-5754-4442-afbb-987b6f9bf8e6 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] 10.222.0.60 "GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167" status: 200 len: 1508 microversion: 2.1 time: 0.253118 Nov 23 13:05:55.237231 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 404/867] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:05:54 2021] GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167 => generated 1508 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:06:05.041249 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-2ee2dda3-7d1b-4bfa-9f60-4a7ee8427c9e tempest-TestVolumeBootPattern-744547849 tempest-TestVolumeBootPattern-744547849-project] Action: 'create', calling method: .version_select at 0x7f1870f0ca60>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-2045982548"}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:06:05.076309 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.quota [None req-2ee2dda3-7d1b-4bfa-9f60-4a7ee8427c9e tempest-TestVolumeBootPattern-744547849 tempest-TestVolumeBootPattern-744547849-project] Getting quotas for project 7d8b6261db1f41d39a82cf016dcfe817. Resources: {'key_pairs'} {{(pid=100973) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 13:06:05.081179 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.quota [None req-2ee2dda3-7d1b-4bfa-9f60-4a7ee8427c9e tempest-TestVolumeBootPattern-744547849 tempest-TestVolumeBootPattern-744547849-project] Getting quotas for user 39e11a5cfec24eabac7da23b114116a5 and project 7d8b6261db1f41d39a82cf016dcfe817. Resources: {'key_pairs'} {{(pid=100973) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 13:06:05.374270 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.quota [None req-2ee2dda3-7d1b-4bfa-9f60-4a7ee8427c9e tempest-TestVolumeBootPattern-744547849 tempest-TestVolumeBootPattern-744547849-project] Getting quotas for project 7d8b6261db1f41d39a82cf016dcfe817. Resources: {'key_pairs'} {{(pid=100973) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 13:06:05.378277 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.quota [None req-2ee2dda3-7d1b-4bfa-9f60-4a7ee8427c9e tempest-TestVolumeBootPattern-744547849 tempest-TestVolumeBootPattern-744547849-project] Getting quotas for user 39e11a5cfec24eabac7da23b114116a5 and project 7d8b6261db1f41d39a82cf016dcfe817. Resources: {'key_pairs'} {{(pid=100973) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 13:06:05.391534 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-2ee2dda3-7d1b-4bfa-9f60-4a7ee8427c9e tempest-TestVolumeBootPattern-744547849 tempest-TestVolumeBootPattern-744547849-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.550989 Nov 23 13:06:05.392150 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 464/868] 10.222.0.60 () {60 vars in 1157 bytes} [Tue Nov 23 13:06:04 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:06:23.486685 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-ac0e9f41-0743-4129-89fc-e673c32b2837 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b954c2b0-5fce-44b9-8d2d-4325f6201837", "device": "/dev/sdb"}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:06:23.488383 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-ac0e9f41-0743-4129-89fc-e673c32b2837 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] [instance: f6d81116-5b48-433f-8c7e-88f2a9687167] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:06:23.495934 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ac0e9f41-0743-4129-89fc-e673c32b2837 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:06:23.496760 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ac0e9f41-0743-4129-89fc-e673c32b2837 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:06:23.497533 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ac0e9f41-0743-4129-89fc-e673c32b2837 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:06:23.497968 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ac0e9f41-0743-4129-89fc-e673c32b2837 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:06:23.912188 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-ac0e9f41-0743-4129-89fc-e673c32b2837 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] 10.222.0.60 "POST /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.430003 Nov 23 13:06:23.912816 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 405/869] 10.222.0.60 () {60 vars in 1322 bytes} [Tue Nov 23 13:06:23 2021] POST /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167/os-volume_attachments => generated 194 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 13:06:30.646085 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8c3a1481-9693-4499-8478-a55e09a5b02f] AMQP server on 10.222.0.60:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 23 13:06:30.649517 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-9091282f-6d9c-427a-975c-0311a9810144 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:06:30.650046 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-9091282f-6d9c-427a-975c-0311a9810144 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:06:30.658553 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-9091282f-6d9c-427a-975c-0311a9810144 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:06:30.659008 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-9091282f-6d9c-427a-975c-0311a9810144 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:06:30.659777 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-9091282f-6d9c-427a-975c-0311a9810144 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:06:30.660211 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-9091282f-6d9c-427a-975c-0311a9810144 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:06:30.717989 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.objects.instance [None req-9091282f-6d9c-427a-975c-0311a9810144 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lazy-loading 'flavor' on Instance uuid 5a3c40e3-d194-4953-be2a-355e3cd882d7 {{(pid=100973) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 23 13:06:30.863605 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-9091282f-6d9c-427a-975c-0311a9810144 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "POST /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7/action" status: 202 len: 0 microversion: 2.1 time: 0.218626 Nov 23 13:06:30.865250 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 465/870] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:06:30 2021] POST /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7/action => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:06:30.876478 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-6626fafc-21e7-4c6c-8a13-70160d91402b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:06:30.877182 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-6626fafc-21e7-4c6c-8a13-70160d91402b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:06:30.885977 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-6626fafc-21e7-4c6c-8a13-70160d91402b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:06:30.886415 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-6626fafc-21e7-4c6c-8a13-70160d91402b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:06:30.887173 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-6626fafc-21e7-4c6c-8a13-70160d91402b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:06:30.887594 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-6626fafc-21e7-4c6c-8a13-70160d91402b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:06:31.114212 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-6626fafc-21e7-4c6c-8a13-70160d91402b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:06:31.122942 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-6626fafc-21e7-4c6c-8a13-70160d91402b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.252615 Nov 23 13:06:31.123899 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 406/871] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:06:30 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:06:32.156223 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-18534fc2-dc16-40a0-b8fc-e319d63b0b68 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:06:32.156810 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-18534fc2-dc16-40a0-b8fc-e319d63b0b68 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:06:32.165574 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-18534fc2-dc16-40a0-b8fc-e319d63b0b68 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:06:32.166030 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-18534fc2-dc16-40a0-b8fc-e319d63b0b68 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:06:32.166883 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-18534fc2-dc16-40a0-b8fc-e319d63b0b68 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:06:32.167320 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-18534fc2-dc16-40a0-b8fc-e319d63b0b68 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:06:32.192027 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO oslo.messaging._drivers.impl_rabbit [-] [8c3a1481-9693-4499-8478-a55e09a5b02f] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 46902. Nov 23 13:06:32.381435 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-18534fc2-dc16-40a0-b8fc-e319d63b0b68 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:06:32.389949 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-18534fc2-dc16-40a0-b8fc-e319d63b0b68 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.250814 Nov 23 13:06:32.390525 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 466/872] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:06:32 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 13:06:32.647690 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-c846a5c5-9f1f-4fba-98bd-f270554bc48a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:06:32.648675 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-c846a5c5-9f1f-4fba-98bd-f270554bc48a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:06:32.660151 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c846a5c5-9f1f-4fba-98bd-f270554bc48a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:06:32.660635 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c846a5c5-9f1f-4fba-98bd-f270554bc48a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:06:32.661401 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c846a5c5-9f1f-4fba-98bd-f270554bc48a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:06:32.661838 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c846a5c5-9f1f-4fba-98bd-f270554bc48a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:06:32.731101 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-c846a5c5-9f1f-4fba-98bd-f270554bc48a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments/66d7d72e-ee37-4804-b7f1-7e8c9263cec1" status: 200 len: 194 microversion: 2.20 time: 0.089788 Nov 23 13:06:32.731605 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 407/873] 10.222.0.60 () {60 vars in 1453 bytes} [Tue Nov 23 13:06:32 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments/66d7d72e-ee37-4804-b7f1-7e8c9263cec1 => generated 194 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:06:32.841576 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-36b47662-6696-472b-bc5f-55990d50c3fe tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:06:32.842073 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-36b47662-6696-472b-bc5f-55990d50c3fe tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:06:32.851379 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-36b47662-6696-472b-bc5f-55990d50c3fe tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:06:32.851846 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-36b47662-6696-472b-bc5f-55990d50c3fe tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:06:32.852649 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-36b47662-6696-472b-bc5f-55990d50c3fe tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:06:32.853076 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-36b47662-6696-472b-bc5f-55990d50c3fe tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:06:33.144392 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.objects.instance [None req-36b47662-6696-472b-bc5f-55990d50c3fe tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lazy-loading 'services' on Instance uuid b9c21729-a176-4e26-9074-f5f0bfc0ce20 {{(pid=100973) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 23 13:06:33.292692 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-36b47662-6696-472b-bc5f-55990d50c3fe tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "DELETE /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments/66d7d72e-ee37-4804-b7f1-7e8c9263cec1" status: 202 len: 0 microversion: 2.20 time: 0.457614 Nov 23 13:06:33.293340 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 467/874] 10.222.0.60 () {60 vars in 1456 bytes} [Tue Nov 23 13:06:32 2021] DELETE /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments/66d7d72e-ee37-4804-b7f1-7e8c9263cec1 => generated 0 bytes in 459 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 23 13:06:33.302938 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-89970a94-a961-4577-907c-5a73a3857224 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:06:33.303941 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-89970a94-a961-4577-907c-5a73a3857224 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:06:33.312536 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-89970a94-a961-4577-907c-5a73a3857224 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:06:33.313147 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-89970a94-a961-4577-907c-5a73a3857224 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:06:33.313930 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-89970a94-a961-4577-907c-5a73a3857224 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:06:33.314366 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-89970a94-a961-4577-907c-5a73a3857224 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:06:33.381748 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-89970a94-a961-4577-907c-5a73a3857224 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.083420 Nov 23 13:06:33.382309 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 408/875] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:06:33 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 13:06:33.407526 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-550cf00d-2ed2-408b-accb-dc7cb48c9deb tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:06:33.408258 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-550cf00d-2ed2-408b-accb-dc7cb48c9deb tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:06:33.416126 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-550cf00d-2ed2-408b-accb-dc7cb48c9deb tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:06:33.416599 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-550cf00d-2ed2-408b-accb-dc7cb48c9deb tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:06:33.417351 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-550cf00d-2ed2-408b-accb-dc7cb48c9deb tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:06:33.417801 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-550cf00d-2ed2-408b-accb-dc7cb48c9deb tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:06:33.630870 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-550cf00d-2ed2-408b-accb-dc7cb48c9deb tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:06:33.639851 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-550cf00d-2ed2-408b-accb-dc7cb48c9deb tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.236619 Nov 23 13:06:33.640485 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 468/876] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:06:33 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:06:34.394353 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-8ceb80b7-5545-4af8-be4f-95771e07b01c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:06:34.395250 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-8ceb80b7-5545-4af8-be4f-95771e07b01c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:06:34.402903 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8ceb80b7-5545-4af8-be4f-95771e07b01c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:06:34.403343 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8ceb80b7-5545-4af8-be4f-95771e07b01c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:06:34.404109 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8ceb80b7-5545-4af8-be4f-95771e07b01c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:06:34.404573 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8ceb80b7-5545-4af8-be4f-95771e07b01c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:06:34.473610 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-8ceb80b7-5545-4af8-be4f-95771e07b01c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.082127 Nov 23 13:06:34.474100 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 409/877] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:06:34 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:06:34.658465 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-568df96e-5a54-4f2d-a6a1-2d2cc00678a7 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:06:34.659058 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-568df96e-5a54-4f2d-a6a1-2d2cc00678a7 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:06:34.670721 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-568df96e-5a54-4f2d-a6a1-2d2cc00678a7 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:06:34.671358 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-568df96e-5a54-4f2d-a6a1-2d2cc00678a7 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:06:34.672621 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-568df96e-5a54-4f2d-a6a1-2d2cc00678a7 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:06:34.673206 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-568df96e-5a54-4f2d-a6a1-2d2cc00678a7 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:06:34.898455 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-568df96e-5a54-4f2d-a6a1-2d2cc00678a7 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:06:34.911472 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-568df96e-5a54-4f2d-a6a1-2d2cc00678a7 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.258119 Nov 23 13:06:34.912063 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 469/878] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:06:34 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:06:35.487746 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-3650b2ea-1f34-44ce-b462-04d82caa9c41 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:06:35.488665 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-3650b2ea-1f34-44ce-b462-04d82caa9c41 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:06:35.496977 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3650b2ea-1f34-44ce-b462-04d82caa9c41 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:06:35.497424 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3650b2ea-1f34-44ce-b462-04d82caa9c41 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:06:35.498197 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3650b2ea-1f34-44ce-b462-04d82caa9c41 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:06:35.498625 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3650b2ea-1f34-44ce-b462-04d82caa9c41 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:06:35.568562 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-3650b2ea-1f34-44ce-b462-04d82caa9c41 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.084859 Nov 23 13:06:35.569637 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 410/879] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:06:35 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:06:35.936440 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-4a1e8921-888e-4fd7-b182-4c394b4844a3 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:06:35.937462 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-4a1e8921-888e-4fd7-b182-4c394b4844a3 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:06:35.949767 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4a1e8921-888e-4fd7-b182-4c394b4844a3 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:06:35.950509 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4a1e8921-888e-4fd7-b182-4c394b4844a3 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:06:35.951829 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4a1e8921-888e-4fd7-b182-4c394b4844a3 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:06:35.952614 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4a1e8921-888e-4fd7-b182-4c394b4844a3 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:06:36.168504 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-4a1e8921-888e-4fd7-b182-4c394b4844a3 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:06:36.177695 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-4a1e8921-888e-4fd7-b182-4c394b4844a3 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.247590 Nov 23 13:06:36.178334 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 470/880] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:06:35 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:06:36.587158 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-008809b3-43c4-4985-b183-ab5250ae334c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:06:36.588729 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-008809b3-43c4-4985-b183-ab5250ae334c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:06:36.599519 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-008809b3-43c4-4985-b183-ab5250ae334c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:06:36.599977 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-008809b3-43c4-4985-b183-ab5250ae334c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:06:36.600776 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-008809b3-43c4-4985-b183-ab5250ae334c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:06:36.601286 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-008809b3-43c4-4985-b183-ab5250ae334c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:06:36.672434 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-008809b3-43c4-4985-b183-ab5250ae334c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.091802 Nov 23 13:06:36.672997 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 411/881] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:06:36 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:06:37.197676 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-f50c1a1f-6129-4f6b-a66a-9c89c6efa9f6 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:06:37.198493 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-f50c1a1f-6129-4f6b-a66a-9c89c6efa9f6 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:06:37.211322 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f50c1a1f-6129-4f6b-a66a-9c89c6efa9f6 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:06:37.212104 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f50c1a1f-6129-4f6b-a66a-9c89c6efa9f6 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:06:37.213428 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f50c1a1f-6129-4f6b-a66a-9c89c6efa9f6 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:06:37.214141 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f50c1a1f-6129-4f6b-a66a-9c89c6efa9f6 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:06:37.425405 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-f50c1a1f-6129-4f6b-a66a-9c89c6efa9f6 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:06:37.434522 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-f50c1a1f-6129-4f6b-a66a-9c89c6efa9f6 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.242775 Nov 23 13:06:37.435096 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 471/882] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:06:37 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:06:37.691773 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-1a150d3e-4339-4ea1-b99c-056e4d4640f1 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:06:37.693330 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-1a150d3e-4339-4ea1-b99c-056e4d4640f1 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:06:37.708481 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1a150d3e-4339-4ea1-b99c-056e4d4640f1 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:06:37.708931 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1a150d3e-4339-4ea1-b99c-056e4d4640f1 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:06:37.709714 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1a150d3e-4339-4ea1-b99c-056e4d4640f1 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:06:37.710149 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1a150d3e-4339-4ea1-b99c-056e4d4640f1 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:06:37.784984 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-1a150d3e-4339-4ea1-b99c-056e4d4640f1 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.099630 Nov 23 13:06:37.785555 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 412/883] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:06:37 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:06:38.451472 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-1a86ed8a-b6d2-46fd-a350-5dd9f77790d7 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:06:38.452063 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-1a86ed8a-b6d2-46fd-a350-5dd9f77790d7 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:06:38.459841 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-1a86ed8a-b6d2-46fd-a350-5dd9f77790d7 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:06:38.460277 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-1a86ed8a-b6d2-46fd-a350-5dd9f77790d7 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:06:38.461067 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-1a86ed8a-b6d2-46fd-a350-5dd9f77790d7 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:06:38.461498 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-1a86ed8a-b6d2-46fd-a350-5dd9f77790d7 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:06:38.666248 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-1a86ed8a-b6d2-46fd-a350-5dd9f77790d7 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:06:38.675088 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-1a86ed8a-b6d2-46fd-a350-5dd9f77790d7 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.227270 Nov 23 13:06:38.675618 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 472/884] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:06:38 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:06:38.801800 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-c40f223b-fc41-4ecb-90a9-9354823ad872 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:06:38.803498 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-c40f223b-fc41-4ecb-90a9-9354823ad872 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:06:38.815778 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c40f223b-fc41-4ecb-90a9-9354823ad872 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:06:38.816615 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c40f223b-fc41-4ecb-90a9-9354823ad872 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:06:38.817561 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c40f223b-fc41-4ecb-90a9-9354823ad872 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:06:38.818111 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c40f223b-fc41-4ecb-90a9-9354823ad872 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:06:38.882917 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-c40f223b-fc41-4ecb-90a9-9354823ad872 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.088185 Nov 23 13:06:38.883505 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 413/885] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:06:38 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:06:39.702030 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-52a709bd-08b6-4e54-957f-cc9c02904b2d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:06:39.702903 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-52a709bd-08b6-4e54-957f-cc9c02904b2d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:06:39.711958 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-52a709bd-08b6-4e54-957f-cc9c02904b2d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:06:39.712444 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-52a709bd-08b6-4e54-957f-cc9c02904b2d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:06:39.713237 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-52a709bd-08b6-4e54-957f-cc9c02904b2d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:06:39.713681 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-52a709bd-08b6-4e54-957f-cc9c02904b2d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:06:39.894961 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-5e20c296-faf0-44c7-a5c5-40769e5d4a1e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:06:39.895866 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-5e20c296-faf0-44c7-a5c5-40769e5d4a1e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:06:39.903283 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5e20c296-faf0-44c7-a5c5-40769e5d4a1e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:06:39.903724 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5e20c296-faf0-44c7-a5c5-40769e5d4a1e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:06:39.904510 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5e20c296-faf0-44c7-a5c5-40769e5d4a1e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:06:39.904938 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5e20c296-faf0-44c7-a5c5-40769e5d4a1e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:06:40.023897 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-52a709bd-08b6-4e54-957f-cc9c02904b2d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:06:40.033584 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-52a709bd-08b6-4e54-957f-cc9c02904b2d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.337917 Nov 23 13:06:40.034380 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 473/886] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:06:39 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:06:40.128888 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-5e20c296-faf0-44c7-a5c5-40769e5d4a1e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.238000 Nov 23 13:06:40.129501 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 414/887] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:06:39 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:06:41.051655 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-20ad778a-f50a-4ff3-a105-a3cefe723e1b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:06:41.052225 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-20ad778a-f50a-4ff3-a105-a3cefe723e1b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:06:41.060200 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-20ad778a-f50a-4ff3-a105-a3cefe723e1b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:06:41.060687 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-20ad778a-f50a-4ff3-a105-a3cefe723e1b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:06:41.061431 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-20ad778a-f50a-4ff3-a105-a3cefe723e1b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:06:41.061882 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-20ad778a-f50a-4ff3-a105-a3cefe723e1b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:06:41.140888 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-170ef17c-3cb4-4a1e-9ce1-8b8d7329d043 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:06:41.141726 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-170ef17c-3cb4-4a1e-9ce1-8b8d7329d043 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:06:41.149371 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-170ef17c-3cb4-4a1e-9ce1-8b8d7329d043 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:06:41.149827 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-170ef17c-3cb4-4a1e-9ce1-8b8d7329d043 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:06:41.150612 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-170ef17c-3cb4-4a1e-9ce1-8b8d7329d043 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:06:41.151041 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-170ef17c-3cb4-4a1e-9ce1-8b8d7329d043 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:06:41.216071 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-170ef17c-3cb4-4a1e-9ce1-8b8d7329d043 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.078944 Nov 23 13:06:41.216677 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 415/888] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:06:41 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 13:06:41.272176 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-20ad778a-f50a-4ff3-a105-a3cefe723e1b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:06:41.284668 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-20ad778a-f50a-4ff3-a105-a3cefe723e1b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.236565 Nov 23 13:06:41.285454 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 474/889] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:06:41 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:06:42.232407 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-8f1da3e2-af22-4894-8609-57b7f2f80000 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:06:42.234334 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-8f1da3e2-af22-4894-8609-57b7f2f80000 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:06:42.246987 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8f1da3e2-af22-4894-8609-57b7f2f80000 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:06:42.247725 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8f1da3e2-af22-4894-8609-57b7f2f80000 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:06:42.249053 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8f1da3e2-af22-4894-8609-57b7f2f80000 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:06:42.249779 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8f1da3e2-af22-4894-8609-57b7f2f80000 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:06:42.306730 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-adb0af1b-f289-47d6-bb56-3df14b773217 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:06:42.307365 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-adb0af1b-f289-47d6-bb56-3df14b773217 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:06:42.315285 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-adb0af1b-f289-47d6-bb56-3df14b773217 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:06:42.315936 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-adb0af1b-f289-47d6-bb56-3df14b773217 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:06:42.316143 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-8f1da3e2-af22-4894-8609-57b7f2f80000 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.090375 Nov 23 13:06:42.320154 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-adb0af1b-f289-47d6-bb56-3df14b773217 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:06:42.320315 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 416/890] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:06:42 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:06:42.320405 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-adb0af1b-f289-47d6-bb56-3df14b773217 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:06:42.519206 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-adb0af1b-f289-47d6-bb56-3df14b773217 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:06:42.528142 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-adb0af1b-f289-47d6-bb56-3df14b773217 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.225221 Nov 23 13:06:42.528814 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 475/891] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:06:42 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:06:43.331127 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-880d2ee4-ffe2-44ec-b15c-c731e085f4ca tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:06:43.332423 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-880d2ee4-ffe2-44ec-b15c-c731e085f4ca tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:06:43.341469 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-880d2ee4-ffe2-44ec-b15c-c731e085f4ca tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:06:43.341917 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-880d2ee4-ffe2-44ec-b15c-c731e085f4ca tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:06:43.342690 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-880d2ee4-ffe2-44ec-b15c-c731e085f4ca tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:06:43.343089 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-880d2ee4-ffe2-44ec-b15c-c731e085f4ca tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:06:43.409382 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-880d2ee4-ffe2-44ec-b15c-c731e085f4ca tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.083652 Nov 23 13:06:43.409934 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 417/892] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:06:43 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:06:43.546725 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-03500079-2e93-49be-93c9-6dc1e8f93f54 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:06:43.547283 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-03500079-2e93-49be-93c9-6dc1e8f93f54 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:06:43.555308 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-03500079-2e93-49be-93c9-6dc1e8f93f54 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:06:43.555748 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-03500079-2e93-49be-93c9-6dc1e8f93f54 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:06:43.556540 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-03500079-2e93-49be-93c9-6dc1e8f93f54 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:06:43.556965 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-03500079-2e93-49be-93c9-6dc1e8f93f54 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:06:43.759277 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-03500079-2e93-49be-93c9-6dc1e8f93f54 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:06:43.772967 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-03500079-2e93-49be-93c9-6dc1e8f93f54 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.229895 Nov 23 13:06:43.773674 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 476/893] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:06:43 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:06:44.425832 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-63e33318-b99e-4bbe-9213-0039e2ad146b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:06:44.427765 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-63e33318-b99e-4bbe-9213-0039e2ad146b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:06:44.435628 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-63e33318-b99e-4bbe-9213-0039e2ad146b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:06:44.436073 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-63e33318-b99e-4bbe-9213-0039e2ad146b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:06:44.436914 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-63e33318-b99e-4bbe-9213-0039e2ad146b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:06:44.437342 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-63e33318-b99e-4bbe-9213-0039e2ad146b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:06:44.501367 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-63e33318-b99e-4bbe-9213-0039e2ad146b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.082260 Nov 23 13:06:44.501907 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 418/894] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:06:44 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:06:44.798583 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-5d8bb744-2bbb-41cd-b198-a0ec1f0fbf8d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:06:44.799527 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-5d8bb744-2bbb-41cd-b198-a0ec1f0fbf8d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:06:44.812286 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5d8bb744-2bbb-41cd-b198-a0ec1f0fbf8d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:06:44.813059 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5d8bb744-2bbb-41cd-b198-a0ec1f0fbf8d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:06:44.814314 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5d8bb744-2bbb-41cd-b198-a0ec1f0fbf8d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:06:44.815032 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5d8bb744-2bbb-41cd-b198-a0ec1f0fbf8d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:06:45.028680 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-5d8bb744-2bbb-41cd-b198-a0ec1f0fbf8d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:06:45.041086 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-5d8bb744-2bbb-41cd-b198-a0ec1f0fbf8d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.248451 Nov 23 13:06:45.041867 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 477/895] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:06:44 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:06:45.517009 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-87012793-8f9e-469c-9d80-d5cb9a961512 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:06:45.518573 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-87012793-8f9e-469c-9d80-d5cb9a961512 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:06:45.530770 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-87012793-8f9e-469c-9d80-d5cb9a961512 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:06:45.531489 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-87012793-8f9e-469c-9d80-d5cb9a961512 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:06:45.532855 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-87012793-8f9e-469c-9d80-d5cb9a961512 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:06:45.533555 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-87012793-8f9e-469c-9d80-d5cb9a961512 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:06:45.597144 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-87012793-8f9e-469c-9d80-d5cb9a961512 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.086540 Nov 23 13:06:45.597676 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 419/896] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:06:45 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:06:46.059217 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-98426cc1-4504-4461-9176-dcec52f87046 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:06:46.059793 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-98426cc1-4504-4461-9176-dcec52f87046 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:06:46.069563 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-98426cc1-4504-4461-9176-dcec52f87046 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:06:46.071881 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-98426cc1-4504-4461-9176-dcec52f87046 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:06:46.071881 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-98426cc1-4504-4461-9176-dcec52f87046 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:06:46.071881 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-98426cc1-4504-4461-9176-dcec52f87046 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:06:46.284859 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-98426cc1-4504-4461-9176-dcec52f87046 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:06:46.293736 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-98426cc1-4504-4461-9176-dcec52f87046 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.238824 Nov 23 13:06:46.294315 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 478/897] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:06:46 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:06:46.613791 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-cd4890b3-a507-49ec-8d0a-69daab12c804 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:06:46.615171 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-cd4890b3-a507-49ec-8d0a-69daab12c804 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:06:46.623485 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-cd4890b3-a507-49ec-8d0a-69daab12c804 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:06:46.623941 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-cd4890b3-a507-49ec-8d0a-69daab12c804 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:06:46.624747 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-cd4890b3-a507-49ec-8d0a-69daab12c804 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:06:46.625639 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-cd4890b3-a507-49ec-8d0a-69daab12c804 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:06:46.695349 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-cd4890b3-a507-49ec-8d0a-69daab12c804 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.088164 Nov 23 13:06:46.695920 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 420/898] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:06:46 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:06:47.318158 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-58a441cb-b44b-489f-b999-a01cb24c429f tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:06:47.319081 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-58a441cb-b44b-489f-b999-a01cb24c429f tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:06:47.331903 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-58a441cb-b44b-489f-b999-a01cb24c429f tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:06:47.332735 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-58a441cb-b44b-489f-b999-a01cb24c429f tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:06:47.333934 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-58a441cb-b44b-489f-b999-a01cb24c429f tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:06:47.334396 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-58a441cb-b44b-489f-b999-a01cb24c429f tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:06:47.541666 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-58a441cb-b44b-489f-b999-a01cb24c429f tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:06:47.553516 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-58a441cb-b44b-489f-b999-a01cb24c429f tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.241536 Nov 23 13:06:47.554366 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 479/899] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:06:47 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:06:47.711084 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-23c30050-2934-49cf-a751-cdb25e32e626 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:06:47.712301 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-23c30050-2934-49cf-a751-cdb25e32e626 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:06:47.722765 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-23c30050-2934-49cf-a751-cdb25e32e626 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:06:47.723391 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-23c30050-2934-49cf-a751-cdb25e32e626 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:06:47.724378 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-23c30050-2934-49cf-a751-cdb25e32e626 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:06:47.724812 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-23c30050-2934-49cf-a751-cdb25e32e626 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:06:47.796612 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-23c30050-2934-49cf-a751-cdb25e32e626 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.092352 Nov 23 13:06:47.797830 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 421/900] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:06:47 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:06:48.576078 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-2bad4990-e401-473d-ac7d-005cfc41e40a tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:06:48.577203 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-2bad4990-e401-473d-ac7d-005cfc41e40a tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:06:48.589842 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-2bad4990-e401-473d-ac7d-005cfc41e40a tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:06:48.590599 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-2bad4990-e401-473d-ac7d-005cfc41e40a tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:06:48.591890 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-2bad4990-e401-473d-ac7d-005cfc41e40a tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:06:48.592682 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-2bad4990-e401-473d-ac7d-005cfc41e40a tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:06:48.809896 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-e19d8d34-93d6-40ec-b05b-fa8e233380ab tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:06:48.813709 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-e19d8d34-93d6-40ec-b05b-fa8e233380ab tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:06:48.814384 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-2bad4990-e401-473d-ac7d-005cfc41e40a tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:06:48.834890 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e19d8d34-93d6-40ec-b05b-fa8e233380ab tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:06:48.835236 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e19d8d34-93d6-40ec-b05b-fa8e233380ab tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:06:48.836024 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e19d8d34-93d6-40ec-b05b-fa8e233380ab tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:06:48.836487 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e19d8d34-93d6-40ec-b05b-fa8e233380ab tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:06:48.839905 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-2bad4990-e401-473d-ac7d-005cfc41e40a tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.271151 Nov 23 13:06:48.840532 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 480/901] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:06:48 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:06:48.909619 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-e19d8d34-93d6-40ec-b05b-fa8e233380ab tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.104255 Nov 23 13:06:48.910424 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 422/902] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:06:48 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:06:49.856632 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-858b8564-708a-428f-86df-d0553012b40c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:06:49.857281 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-858b8564-708a-428f-86df-d0553012b40c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:06:49.865232 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-858b8564-708a-428f-86df-d0553012b40c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:06:49.865822 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-858b8564-708a-428f-86df-d0553012b40c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:06:49.867707 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-858b8564-708a-428f-86df-d0553012b40c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:06:49.867707 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-858b8564-708a-428f-86df-d0553012b40c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:06:49.922739 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-648755be-7753-4b8b-bf4e-282a75bdea99 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:06:49.923759 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-648755be-7753-4b8b-bf4e-282a75bdea99 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:06:49.932056 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-648755be-7753-4b8b-bf4e-282a75bdea99 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:06:49.932541 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-648755be-7753-4b8b-bf4e-282a75bdea99 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:06:49.933400 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-648755be-7753-4b8b-bf4e-282a75bdea99 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:06:49.933831 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-648755be-7753-4b8b-bf4e-282a75bdea99 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:06:50.001974 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-648755be-7753-4b8b-bf4e-282a75bdea99 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.083252 Nov 23 13:06:50.003449 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 423/903] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:06:49 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:06:50.223577 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-858b8564-708a-428f-86df-d0553012b40c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:06:50.233650 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-858b8564-708a-428f-86df-d0553012b40c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.380565 Nov 23 13:06:50.234373 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 481/904] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:06:49 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:06:51.018012 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-17a84155-3675-4d1b-aaec-a7c8160dee25 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:06:51.019208 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-17a84155-3675-4d1b-aaec-a7c8160dee25 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:06:51.030281 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-17a84155-3675-4d1b-aaec-a7c8160dee25 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:06:51.030824 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-17a84155-3675-4d1b-aaec-a7c8160dee25 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:06:51.031725 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-17a84155-3675-4d1b-aaec-a7c8160dee25 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:06:51.032204 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-17a84155-3675-4d1b-aaec-a7c8160dee25 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:06:51.097612 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-17a84155-3675-4d1b-aaec-a7c8160dee25 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.086353 Nov 23 13:06:51.098363 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 424/905] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:06:51 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:06:51.253959 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-a7cc2a19-2adb-49f2-83dd-61b26bf7da30 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:06:51.254817 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-a7cc2a19-2adb-49f2-83dd-61b26bf7da30 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:06:51.266698 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a7cc2a19-2adb-49f2-83dd-61b26bf7da30 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:06:51.267411 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a7cc2a19-2adb-49f2-83dd-61b26bf7da30 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:06:51.268648 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a7cc2a19-2adb-49f2-83dd-61b26bf7da30 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:06:51.269330 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a7cc2a19-2adb-49f2-83dd-61b26bf7da30 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:06:51.491286 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-a7cc2a19-2adb-49f2-83dd-61b26bf7da30 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:06:51.499789 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-a7cc2a19-2adb-49f2-83dd-61b26bf7da30 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.252133 Nov 23 13:06:51.500357 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 482/906] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:06:51 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:06:52.110868 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-bd260f17-94e3-49a6-af43-a6401ea8a78b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:06:52.112006 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-bd260f17-94e3-49a6-af43-a6401ea8a78b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:06:52.120689 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-bd260f17-94e3-49a6-af43-a6401ea8a78b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:06:52.121440 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-bd260f17-94e3-49a6-af43-a6401ea8a78b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:06:52.122296 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-bd260f17-94e3-49a6-af43-a6401ea8a78b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:06:52.122697 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-bd260f17-94e3-49a6-af43-a6401ea8a78b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:06:52.189444 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-bd260f17-94e3-49a6-af43-a6401ea8a78b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.083639 Nov 23 13:06:52.189981 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 425/907] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:06:52 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:06:52.521735 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-0559cb52-c3e6-43f5-a35d-807e32114279 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:06:52.522681 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-0559cb52-c3e6-43f5-a35d-807e32114279 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:06:52.535271 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0559cb52-c3e6-43f5-a35d-807e32114279 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:06:52.536016 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0559cb52-c3e6-43f5-a35d-807e32114279 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:06:52.537353 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0559cb52-c3e6-43f5-a35d-807e32114279 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:06:52.538158 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0559cb52-c3e6-43f5-a35d-807e32114279 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:06:52.753342 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-0559cb52-c3e6-43f5-a35d-807e32114279 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:06:52.766800 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-0559cb52-c3e6-43f5-a35d-807e32114279 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.251734 Nov 23 13:06:52.767536 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 483/908] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:06:52 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:06:53.205394 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-32a7434f-31f6-4471-85e1-a230156727bf tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:06:53.206755 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-32a7434f-31f6-4471-85e1-a230156727bf tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:06:53.218824 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-32a7434f-31f6-4471-85e1-a230156727bf tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:06:53.219571 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-32a7434f-31f6-4471-85e1-a230156727bf tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:06:53.220896 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-32a7434f-31f6-4471-85e1-a230156727bf tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:06:53.221614 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-32a7434f-31f6-4471-85e1-a230156727bf tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:06:53.287699 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-32a7434f-31f6-4471-85e1-a230156727bf tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.088560 Nov 23 13:06:53.288380 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 426/909] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:06:53 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:06:53.672434 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-aa7389f0-705d-457c-892e-7b3a1023d5a6 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:06:53.674040 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-aa7389f0-705d-457c-892e-7b3a1023d5a6 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:06:53.683268 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-aa7389f0-705d-457c-892e-7b3a1023d5a6 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:06:53.683738 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-aa7389f0-705d-457c-892e-7b3a1023d5a6 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:06:53.684573 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-aa7389f0-705d-457c-892e-7b3a1023d5a6 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:06:53.684999 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-aa7389f0-705d-457c-892e-7b3a1023d5a6 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:06:53.785668 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-d759b5af-e3ef-47b0-bd11-9b81a8599e27 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:06:53.786566 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-d759b5af-e3ef-47b0-bd11-9b81a8599e27 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:06:53.794253 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d759b5af-e3ef-47b0-bd11-9b81a8599e27 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:06:53.794702 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d759b5af-e3ef-47b0-bd11-9b81a8599e27 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:06:53.795475 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d759b5af-e3ef-47b0-bd11-9b81a8599e27 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:06:53.795904 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d759b5af-e3ef-47b0-bd11-9b81a8599e27 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:06:53.835987 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-aa7389f0-705d-457c-892e-7b3a1023d5a6 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "POST /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76/action" status: 202 len: 0 microversion: 2.1 time: 0.169570 Nov 23 13:06:53.837423 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 484/910] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:06:53 2021] POST /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76/action => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:06:53.845688 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-d2f79216-2e4b-4edc-b927-66bb9cade096 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:06:53.846511 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-d2f79216-2e4b-4edc-b927-66bb9cade096 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:06:53.855089 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d2f79216-2e4b-4edc-b927-66bb9cade096 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:06:53.855673 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d2f79216-2e4b-4edc-b927-66bb9cade096 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:06:53.857152 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d2f79216-2e4b-4edc-b927-66bb9cade096 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:06:53.857812 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d2f79216-2e4b-4edc-b927-66bb9cade096 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:06:54.074658 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-d759b5af-e3ef-47b0-bd11-9b81a8599e27 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:06:54.085033 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-d2f79216-2e4b-4edc-b927-66bb9cade096 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:06:54.086992 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-d759b5af-e3ef-47b0-bd11-9b81a8599e27 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.304949 Nov 23 13:06:54.087883 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 427/911] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:06:53 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:06:54.094649 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-d2f79216-2e4b-4edc-b927-66bb9cade096 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1749 microversion: 2.1 time: 0.252923 Nov 23 13:06:54.095404 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 485/912] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:06:53 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1749 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 13:06:54.299261 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-0a5ea361-525e-4cc8-9595-b57d679f70be tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:06:54.300330 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-0a5ea361-525e-4cc8-9595-b57d679f70be tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:06:54.308130 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0a5ea361-525e-4cc8-9595-b57d679f70be tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:06:54.309131 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0a5ea361-525e-4cc8-9595-b57d679f70be tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:06:54.309907 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0a5ea361-525e-4cc8-9595-b57d679f70be tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:06:54.311004 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0a5ea361-525e-4cc8-9595-b57d679f70be tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:06:54.375588 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-0a5ea361-525e-4cc8-9595-b57d679f70be tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.080174 Nov 23 13:06:54.379842 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 428/913] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:06:54 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:06:55.110712 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-4b82e073-6951-44d7-8645-cd8c5ad6c67d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:06:55.111351 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-4b82e073-6951-44d7-8645-cd8c5ad6c67d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:06:55.112799 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-b549c579-a86b-4d28-b0d5-c2f3005a815e tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:06:55.113444 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-b549c579-a86b-4d28-b0d5-c2f3005a815e tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:06:55.120327 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4b82e073-6951-44d7-8645-cd8c5ad6c67d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:06:55.120789 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4b82e073-6951-44d7-8645-cd8c5ad6c67d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:06:55.121883 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4b82e073-6951-44d7-8645-cd8c5ad6c67d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:06:55.122302 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4b82e073-6951-44d7-8645-cd8c5ad6c67d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:06:55.126024 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b549c579-a86b-4d28-b0d5-c2f3005a815e tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:06:55.126518 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b549c579-a86b-4d28-b0d5-c2f3005a815e tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:06:55.127299 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b549c579-a86b-4d28-b0d5-c2f3005a815e tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:06:55.127884 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b549c579-a86b-4d28-b0d5-c2f3005a815e tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:06:55.325018 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-4b82e073-6951-44d7-8645-cd8c5ad6c67d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:06:55.333343 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-4b82e073-6951-44d7-8645-cd8c5ad6c67d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.226655 Nov 23 13:06:55.333898 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 486/914] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:06:55 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:06:55.351637 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-b549c579-a86b-4d28-b0d5-c2f3005a815e tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:06:55.360650 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-b549c579-a86b-4d28-b0d5-c2f3005a815e tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1754 microversion: 2.1 time: 0.251495 Nov 23 13:06:55.361217 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 429/915] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:06:55 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1754 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:06:55.387199 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-76dd1f9a-0d8f-4d4a-8086-e3d5fb534a26 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:06:55.388182 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-76dd1f9a-0d8f-4d4a-8086-e3d5fb534a26 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:06:55.395650 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-76dd1f9a-0d8f-4d4a-8086-e3d5fb534a26 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:06:55.396086 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-76dd1f9a-0d8f-4d4a-8086-e3d5fb534a26 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:06:55.396936 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-76dd1f9a-0d8f-4d4a-8086-e3d5fb534a26 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:06:55.397403 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-76dd1f9a-0d8f-4d4a-8086-e3d5fb534a26 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:06:55.462162 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-76dd1f9a-0d8f-4d4a-8086-e3d5fb534a26 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.078886 Nov 23 13:06:55.462734 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 487/916] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:06:55 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:06:56.350526 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-28ab5816-078c-48fb-ad2b-86fe833aa2ac tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:06:56.351246 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-28ab5816-078c-48fb-ad2b-86fe833aa2ac tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:06:56.358784 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-28ab5816-078c-48fb-ad2b-86fe833aa2ac tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:06:56.359447 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-28ab5816-078c-48fb-ad2b-86fe833aa2ac tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:06:56.359972 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-28ab5816-078c-48fb-ad2b-86fe833aa2ac tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:06:56.360443 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-28ab5816-078c-48fb-ad2b-86fe833aa2ac tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:06:56.378633 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-d4eb77d9-d930-48fe-8fb4-f32a6916f8db tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:06:56.379609 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-d4eb77d9-d930-48fe-8fb4-f32a6916f8db tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:06:56.387956 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d4eb77d9-d930-48fe-8fb4-f32a6916f8db tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:06:56.388582 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d4eb77d9-d930-48fe-8fb4-f32a6916f8db tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:06:56.389493 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d4eb77d9-d930-48fe-8fb4-f32a6916f8db tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:06:56.390190 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d4eb77d9-d930-48fe-8fb4-f32a6916f8db tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:06:56.597275 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-d4eb77d9-d930-48fe-8fb4-f32a6916f8db tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:06:56.606382 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-d4eb77d9-d930-48fe-8fb4-f32a6916f8db tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1754 microversion: 2.1 time: 0.231818 Nov 23 13:06:56.607033 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 488/917] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:06:56 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1754 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:06:56.611539 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-d9e86c03-1815-4800-ad86-dc4ac9579d57 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:06:56.612554 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-d9e86c03-1815-4800-ad86-dc4ac9579d57 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:06:56.619739 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d9e86c03-1815-4800-ad86-dc4ac9579d57 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:06:56.620261 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d9e86c03-1815-4800-ad86-dc4ac9579d57 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:06:56.621443 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d9e86c03-1815-4800-ad86-dc4ac9579d57 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:06:56.621941 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d9e86c03-1815-4800-ad86-dc4ac9579d57 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:06:56.687633 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-d9e86c03-1815-4800-ad86-dc4ac9579d57 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.079343 Nov 23 13:06:56.688106 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 489/918] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:06:56 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:06:56.711167 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-28ab5816-078c-48fb-ad2b-86fe833aa2ac tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:06:56.719702 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-28ab5816-078c-48fb-ad2b-86fe833aa2ac tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.372888 Nov 23 13:06:56.720262 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 430/919] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:06:56 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:06:57.623592 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-5ec1c7b6-eaa9-44c6-b0a9-b112618db187 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:06:57.624229 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-5ec1c7b6-eaa9-44c6-b0a9-b112618db187 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:06:57.631959 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5ec1c7b6-eaa9-44c6-b0a9-b112618db187 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:06:57.632494 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5ec1c7b6-eaa9-44c6-b0a9-b112618db187 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:06:57.633299 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5ec1c7b6-eaa9-44c6-b0a9-b112618db187 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:06:57.633704 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5ec1c7b6-eaa9-44c6-b0a9-b112618db187 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:06:57.699293 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-ba34a361-def0-4db3-aaed-a28bc7795207 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:06:57.700333 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-ba34a361-def0-4db3-aaed-a28bc7795207 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:06:57.707821 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ba34a361-def0-4db3-aaed-a28bc7795207 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:06:57.708288 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ba34a361-def0-4db3-aaed-a28bc7795207 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:06:57.709085 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ba34a361-def0-4db3-aaed-a28bc7795207 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:06:57.709510 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ba34a361-def0-4db3-aaed-a28bc7795207 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:06:57.773496 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-ba34a361-def0-4db3-aaed-a28bc7795207 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.077871 Nov 23 13:06:57.774082 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 431/920] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:06:57 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 13:06:57.778431 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-58e093a0-ff39-4a72-9d39-30a601ac177d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:06:57.779027 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-58e093a0-ff39-4a72-9d39-30a601ac177d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:06:57.786245 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-58e093a0-ff39-4a72-9d39-30a601ac177d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:06:57.786690 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-58e093a0-ff39-4a72-9d39-30a601ac177d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:06:57.787425 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-58e093a0-ff39-4a72-9d39-30a601ac177d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:06:57.787853 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-58e093a0-ff39-4a72-9d39-30a601ac177d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:06:57.841149 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-5ec1c7b6-eaa9-44c6-b0a9-b112618db187 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:06:57.856030 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-5ec1c7b6-eaa9-44c6-b0a9-b112618db187 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1754 microversion: 2.1 time: 0.236448 Nov 23 13:06:57.856741 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 490/921] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:06:57 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1754 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:06:57.999252 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-58e093a0-ff39-4a72-9d39-30a601ac177d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:06:58.007723 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-58e093a0-ff39-4a72-9d39-30a601ac177d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.232663 Nov 23 13:06:58.008416 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 432/922] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:06:57 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:06:58.785171 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-d40613ed-4541-4f63-a5c4-b77c6c8d4cce tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:06:58.786071 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-d40613ed-4541-4f63-a5c4-b77c6c8d4cce tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:06:58.793649 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d40613ed-4541-4f63-a5c4-b77c6c8d4cce tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:06:58.794181 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d40613ed-4541-4f63-a5c4-b77c6c8d4cce tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:06:58.794944 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d40613ed-4541-4f63-a5c4-b77c6c8d4cce tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:06:58.795369 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d40613ed-4541-4f63-a5c4-b77c6c8d4cce tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:06:58.858708 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-d40613ed-4541-4f63-a5c4-b77c6c8d4cce tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.077286 Nov 23 13:06:58.859266 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 491/923] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:06:58 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:06:58.875736 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-0a9340b8-a5e8-4e4f-9505-22fc13596fa7 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:06:58.876391 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-0a9340b8-a5e8-4e4f-9505-22fc13596fa7 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:06:58.884432 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0a9340b8-a5e8-4e4f-9505-22fc13596fa7 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:06:58.884887 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0a9340b8-a5e8-4e4f-9505-22fc13596fa7 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:06:58.885655 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0a9340b8-a5e8-4e4f-9505-22fc13596fa7 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:06:58.886092 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0a9340b8-a5e8-4e4f-9505-22fc13596fa7 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:06:59.025537 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-d2e0dd7f-ec37-4f81-b8d9-bcf32ee49ff4 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:06:59.026066 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-d2e0dd7f-ec37-4f81-b8d9-bcf32ee49ff4 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:06:59.033649 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d2e0dd7f-ec37-4f81-b8d9-bcf32ee49ff4 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:06:59.034099 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d2e0dd7f-ec37-4f81-b8d9-bcf32ee49ff4 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:06:59.034870 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d2e0dd7f-ec37-4f81-b8d9-bcf32ee49ff4 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:06:59.035310 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d2e0dd7f-ec37-4f81-b8d9-bcf32ee49ff4 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:06:59.094037 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-0a9340b8-a5e8-4e4f-9505-22fc13596fa7 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:06:59.103556 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-0a9340b8-a5e8-4e4f-9505-22fc13596fa7 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1754 microversion: 2.1 time: 0.231426 Nov 23 13:06:59.104141 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 433/924] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:06:58 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1754 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:06:59.237460 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-d2e0dd7f-ec37-4f81-b8d9-bcf32ee49ff4 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:06:59.250531 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-d2e0dd7f-ec37-4f81-b8d9-bcf32ee49ff4 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.228945 Nov 23 13:06:59.251275 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 492/925] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:06:59 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:06:59.871484 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-7b2646e2-bcce-42fe-9f07-6b7e35807694 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:06:59.872524 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-7b2646e2-bcce-42fe-9f07-6b7e35807694 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:06:59.880497 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7b2646e2-bcce-42fe-9f07-6b7e35807694 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:06:59.881005 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7b2646e2-bcce-42fe-9f07-6b7e35807694 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:06:59.881689 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7b2646e2-bcce-42fe-9f07-6b7e35807694 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:06:59.882109 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7b2646e2-bcce-42fe-9f07-6b7e35807694 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:06:59.946699 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-7b2646e2-bcce-42fe-9f07-6b7e35807694 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.077712 Nov 23 13:06:59.946699 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 434/926] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:06:59 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:07:00.125210 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-2c97ef07-87a3-4aa6-ba94-2ea9395eddae tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:07:00.126066 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-2c97ef07-87a3-4aa6-ba94-2ea9395eddae tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:07:00.136556 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-2c97ef07-87a3-4aa6-ba94-2ea9395eddae tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:00.137001 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-2c97ef07-87a3-4aa6-ba94-2ea9395eddae tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:00.137756 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-2c97ef07-87a3-4aa6-ba94-2ea9395eddae tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:00.138173 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-2c97ef07-87a3-4aa6-ba94-2ea9395eddae tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:00.270359 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-bc5aa6af-f828-4029-822e-f6122e472551 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:07:00.271131 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-bc5aa6af-f828-4029-822e-f6122e472551 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:07:00.279698 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-bc5aa6af-f828-4029-822e-f6122e472551 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:00.280160 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-bc5aa6af-f828-4029-822e-f6122e472551 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:00.280961 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-bc5aa6af-f828-4029-822e-f6122e472551 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:00.281386 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-bc5aa6af-f828-4029-822e-f6122e472551 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:00.351045 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-2c97ef07-87a3-4aa6-ba94-2ea9395eddae tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:07:00.359865 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-2c97ef07-87a3-4aa6-ba94-2ea9395eddae tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1754 microversion: 2.1 time: 0.241418 Nov 23 13:07:00.360464 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 493/927] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:07:00 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1754 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:07:00.479268 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-bc5aa6af-f828-4029-822e-f6122e472551 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:07:00.487699 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-bc5aa6af-f828-4029-822e-f6122e472551 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.221591 Nov 23 13:07:00.488272 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 435/928] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:07:00 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:07:00.957456 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-83a0b498-2dc2-48e5-9f74-1dd3f767b3c1 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:07:00.958368 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-83a0b498-2dc2-48e5-9f74-1dd3f767b3c1 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:07:00.966026 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-83a0b498-2dc2-48e5-9f74-1dd3f767b3c1 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:00.966477 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-83a0b498-2dc2-48e5-9f74-1dd3f767b3c1 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:00.967376 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-83a0b498-2dc2-48e5-9f74-1dd3f767b3c1 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:00.967813 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-83a0b498-2dc2-48e5-9f74-1dd3f767b3c1 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:01.031192 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-83a0b498-2dc2-48e5-9f74-1dd3f767b3c1 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.077636 Nov 23 13:07:01.031780 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 494/929] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:07:00 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:07:01.376638 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-ea61d77e-2252-4435-bd35-c07d62a92f52 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:07:01.377279 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-ea61d77e-2252-4435-bd35-c07d62a92f52 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:07:01.385107 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ea61d77e-2252-4435-bd35-c07d62a92f52 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:01.385534 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ea61d77e-2252-4435-bd35-c07d62a92f52 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:01.386297 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ea61d77e-2252-4435-bd35-c07d62a92f52 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:01.386724 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ea61d77e-2252-4435-bd35-c07d62a92f52 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:01.505331 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-48b0aef5-0776-42fa-a30b-dd7514d2f5f4 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:07:01.505936 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-48b0aef5-0776-42fa-a30b-dd7514d2f5f4 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:07:01.513218 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-48b0aef5-0776-42fa-a30b-dd7514d2f5f4 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:01.513661 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-48b0aef5-0776-42fa-a30b-dd7514d2f5f4 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:01.514437 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-48b0aef5-0776-42fa-a30b-dd7514d2f5f4 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:01.514871 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-48b0aef5-0776-42fa-a30b-dd7514d2f5f4 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:01.590452 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-ea61d77e-2252-4435-bd35-c07d62a92f52 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:07:01.599776 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-ea61d77e-2252-4435-bd35-c07d62a92f52 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1754 microversion: 2.1 time: 0.226729 Nov 23 13:07:01.600286 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 436/930] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:07:01 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1754 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:07:01.718798 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-48b0aef5-0776-42fa-a30b-dd7514d2f5f4 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:07:01.727989 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-48b0aef5-0776-42fa-a30b-dd7514d2f5f4 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.226476 Nov 23 13:07:01.728591 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 495/931] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:07:01 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:07:02.045080 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-f4555b6f-9bad-4b7d-bf05-3dfd8a389ffb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:07:02.046270 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-f4555b6f-9bad-4b7d-bf05-3dfd8a389ffb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:07:02.056897 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f4555b6f-9bad-4b7d-bf05-3dfd8a389ffb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:02.057190 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f4555b6f-9bad-4b7d-bf05-3dfd8a389ffb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:02.057986 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f4555b6f-9bad-4b7d-bf05-3dfd8a389ffb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:02.058452 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f4555b6f-9bad-4b7d-bf05-3dfd8a389ffb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:02.122669 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-f4555b6f-9bad-4b7d-bf05-3dfd8a389ffb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.083344 Nov 23 13:07:02.123125 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 437/932] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:07:02 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:07:02.294681 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [req-5a99aa43-1303-4098-a878-a04ddeab12a0 req-b5df7369-141f-4e1b-ba52-d16083ac9849 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a3c40e3-d194-4953-be2a-355e3cd882d7", "name": "network-vif-unplugged", "status": "completed", "tag": "9334a9ef-7661-4c37-bee0-88d739f97311"}]} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:07:02.296111 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 13:07:02.296111 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: warnings.warn(msg) Nov 23 13:07:02.304847 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [req-5a99aa43-1303-4098-a878-a04ddeab12a0 req-b5df7369-141f-4e1b-ba52-d16083ac9849 service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:02.305419 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [req-5a99aa43-1303-4098-a878-a04ddeab12a0 req-b5df7369-141f-4e1b-ba52-d16083ac9849 service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:02.321639 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.compute.server_external_events [req-5a99aa43-1303-4098-a878-a04ddeab12a0 req-b5df7369-141f-4e1b-ba52-d16083ac9849 service nova] Creating event network-vif-unplugged:9334a9ef-7661-4c37-bee0-88d739f97311 for instance 5a3c40e3-d194-4953-be2a-355e3cd882d7 on hv-cinder-81888 Nov 23 13:07:02.326375 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [req-5a99aa43-1303-4098-a878-a04ddeab12a0 req-b5df7369-141f-4e1b-ba52-d16083ac9849 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036053 Nov 23 13:07:02.326965 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 496/933] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Nov 23 13:07:02 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 13:07:02.621616 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-2316b5fc-1011-4b85-95be-a75eb6145218 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:07:02.622622 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-2316b5fc-1011-4b85-95be-a75eb6145218 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:07:02.634990 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2316b5fc-1011-4b85-95be-a75eb6145218 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:02.635374 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2316b5fc-1011-4b85-95be-a75eb6145218 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:02.636132 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2316b5fc-1011-4b85-95be-a75eb6145218 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:02.636577 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2316b5fc-1011-4b85-95be-a75eb6145218 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:02.745492 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-aa79c9d1-2515-4aa2-b408-95b8cc11613f tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:07:02.746529 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-aa79c9d1-2515-4aa2-b408-95b8cc11613f tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:07:02.754134 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-aa79c9d1-2515-4aa2-b408-95b8cc11613f tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:02.754550 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-aa79c9d1-2515-4aa2-b408-95b8cc11613f tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:02.755311 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-aa79c9d1-2515-4aa2-b408-95b8cc11613f tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:02.755736 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-aa79c9d1-2515-4aa2-b408-95b8cc11613f tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:02.853512 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-2316b5fc-1011-4b85-95be-a75eb6145218 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:07:02.862472 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-2316b5fc-1011-4b85-95be-a75eb6145218 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1754 microversion: 2.1 time: 0.247736 Nov 23 13:07:02.863039 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 438/934] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:07:02 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1754 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:07:02.973507 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-aa79c9d1-2515-4aa2-b408-95b8cc11613f tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:07:02.992207 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-aa79c9d1-2515-4aa2-b408-95b8cc11613f tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.247748 Nov 23 13:07:02.993084 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 497/935] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:07:02 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 13:07:03.136275 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-6a622a1e-916e-4cee-a216-b73d1f404cda tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:07:03.137275 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-6a622a1e-916e-4cee-a216-b73d1f404cda tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:07:03.144911 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-6a622a1e-916e-4cee-a216-b73d1f404cda tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:03.145358 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-6a622a1e-916e-4cee-a216-b73d1f404cda tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:03.146113 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-6a622a1e-916e-4cee-a216-b73d1f404cda tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:03.146543 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-6a622a1e-916e-4cee-a216-b73d1f404cda tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:03.214044 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-6a622a1e-916e-4cee-a216-b73d1f404cda tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.081698 Nov 23 13:07:03.214602 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 439/936] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:07:03 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:07:03.881358 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-09fb59e8-6e5f-41ab-9a45-32c5c6fcafd1 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:07:03.882004 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-09fb59e8-6e5f-41ab-9a45-32c5c6fcafd1 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:07:03.890744 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-09fb59e8-6e5f-41ab-9a45-32c5c6fcafd1 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:03.891195 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-09fb59e8-6e5f-41ab-9a45-32c5c6fcafd1 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:03.891967 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-09fb59e8-6e5f-41ab-9a45-32c5c6fcafd1 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:03.892437 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-09fb59e8-6e5f-41ab-9a45-32c5c6fcafd1 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:04.012564 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-0d99818b-dd41-4026-b957-a405c3825e72 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:07:04.013192 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-0d99818b-dd41-4026-b957-a405c3825e72 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:07:04.022940 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0d99818b-dd41-4026-b957-a405c3825e72 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:04.023548 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0d99818b-dd41-4026-b957-a405c3825e72 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:04.024717 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0d99818b-dd41-4026-b957-a405c3825e72 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:04.025374 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0d99818b-dd41-4026-b957-a405c3825e72 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:04.195230 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-09fb59e8-6e5f-41ab-9a45-32c5c6fcafd1 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:07:04.205355 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-09fb59e8-6e5f-41ab-9a45-32c5c6fcafd1 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1754 microversion: 2.1 time: 0.327699 Nov 23 13:07:04.205907 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 498/937] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:07:03 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1754 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:07:04.225890 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-757e6088-22cd-443b-95fa-5a81f138cf7a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:07:04.226938 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-757e6088-22cd-443b-95fa-5a81f138cf7a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:07:04.234714 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-757e6088-22cd-443b-95fa-5a81f138cf7a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:04.235149 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-757e6088-22cd-443b-95fa-5a81f138cf7a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:04.235938 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-757e6088-22cd-443b-95fa-5a81f138cf7a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:04.236391 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-757e6088-22cd-443b-95fa-5a81f138cf7a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:04.238174 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-0d99818b-dd41-4026-b957-a405c3825e72 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:07:04.248758 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-0d99818b-dd41-4026-b957-a405c3825e72 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.240031 Nov 23 13:07:04.249463 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 440/938] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:07:04 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:07:04.312629 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-757e6088-22cd-443b-95fa-5a81f138cf7a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.090503 Nov 23 13:07:04.313173 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 499/939] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:07:04 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 13:07:05.226713 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-812b6e95-9d95-4c0b-9cdb-44216599475e tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:07:05.227853 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-812b6e95-9d95-4c0b-9cdb-44216599475e tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:07:05.240327 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-812b6e95-9d95-4c0b-9cdb-44216599475e tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:05.241071 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-812b6e95-9d95-4c0b-9cdb-44216599475e tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:05.242342 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-812b6e95-9d95-4c0b-9cdb-44216599475e tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:05.243044 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-812b6e95-9d95-4c0b-9cdb-44216599475e tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:05.265608 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-6df8faf5-7520-4255-81eb-2cc99e587ffb tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:07:05.266218 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-6df8faf5-7520-4255-81eb-2cc99e587ffb tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:07:05.274048 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6df8faf5-7520-4255-81eb-2cc99e587ffb tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:05.274516 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6df8faf5-7520-4255-81eb-2cc99e587ffb tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:05.275287 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6df8faf5-7520-4255-81eb-2cc99e587ffb tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:05.275932 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6df8faf5-7520-4255-81eb-2cc99e587ffb tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:05.447489 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-812b6e95-9d95-4c0b-9cdb-44216599475e tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:07:05.456326 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-812b6e95-9d95-4c0b-9cdb-44216599475e tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1754 microversion: 2.1 time: 0.236156 Nov 23 13:07:05.456967 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 441/940] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:07:05 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1754 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:07:05.461727 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-98646939-4b9e-432b-9913-8d255fb3c3b2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:07:05.462635 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-98646939-4b9e-432b-9913-8d255fb3c3b2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:07:05.469891 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-98646939-4b9e-432b-9913-8d255fb3c3b2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:05.470334 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-98646939-4b9e-432b-9913-8d255fb3c3b2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:05.471122 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-98646939-4b9e-432b-9913-8d255fb3c3b2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:05.471557 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-98646939-4b9e-432b-9913-8d255fb3c3b2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:05.479608 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-6df8faf5-7520-4255-81eb-2cc99e587ffb tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:07:05.488106 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-6df8faf5-7520-4255-81eb-2cc99e587ffb tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.226263 Nov 23 13:07:05.488692 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 500/941] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:07:05 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:07:05.540524 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-98646939-4b9e-432b-9913-8d255fb3c3b2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.082376 Nov 23 13:07:05.541097 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 442/942] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:07:05 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:07:06.474174 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-fd4d2e50-65c9-4785-959f-7be5fa81838d tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:07:06.474783 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-fd4d2e50-65c9-4785-959f-7be5fa81838d tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:07:06.482972 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-fd4d2e50-65c9-4785-959f-7be5fa81838d tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:06.483423 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-fd4d2e50-65c9-4785-959f-7be5fa81838d tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:06.484183 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-fd4d2e50-65c9-4785-959f-7be5fa81838d tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:06.484645 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-fd4d2e50-65c9-4785-959f-7be5fa81838d tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:06.619822 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-cc706915-29b0-4292-b86e-be6da4206a76 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:07:06.620467 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-cc706915-29b0-4292-b86e-be6da4206a76 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:07:06.628519 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-cc706915-29b0-4292-b86e-be6da4206a76 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:06.628966 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-cc706915-29b0-4292-b86e-be6da4206a76 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:06.629750 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-cc706915-29b0-4292-b86e-be6da4206a76 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:06.630178 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-cc706915-29b0-4292-b86e-be6da4206a76 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:06.684443 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-fd4d2e50-65c9-4785-959f-7be5fa81838d tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:07:06.693707 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-fd4d2e50-65c9-4785-959f-7be5fa81838d tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1757 microversion: 2.1 time: 0.223315 Nov 23 13:07:06.694275 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 501/943] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:07:06 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1757 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:07:06.698977 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-0a7d60f9-6f6f-467f-aa4d-c9c141703f92 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:07:06.700024 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-0a7d60f9-6f6f-467f-aa4d-c9c141703f92 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:07:06.707609 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0a7d60f9-6f6f-467f-aa4d-c9c141703f92 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:06.708076 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0a7d60f9-6f6f-467f-aa4d-c9c141703f92 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:06.708888 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0a7d60f9-6f6f-467f-aa4d-c9c141703f92 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:06.709309 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0a7d60f9-6f6f-467f-aa4d-c9c141703f92 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:06.772747 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-0a7d60f9-6f6f-467f-aa4d-c9c141703f92 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.077421 Nov 23 13:07:06.773304 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 502/944] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:07:06 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:07:06.828831 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-cc706915-29b0-4292-b86e-be6da4206a76 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:07:06.837277 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-cc706915-29b0-4292-b86e-be6da4206a76 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.335579 Nov 23 13:07:06.837827 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 443/945] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:07:06 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:07:07.785224 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-9c0a6866-bc89-4ab7-b999-a86d0e8b530f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:07:07.786136 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-9c0a6866-bc89-4ab7-b999-a86d0e8b530f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:07:07.794283 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-9c0a6866-bc89-4ab7-b999-a86d0e8b530f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:07.794848 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-9c0a6866-bc89-4ab7-b999-a86d0e8b530f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:07.795730 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-9c0a6866-bc89-4ab7-b999-a86d0e8b530f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:07.796301 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-9c0a6866-bc89-4ab7-b999-a86d0e8b530f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:07.854997 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-07f1750b-2667-4ec6-973f-5254822e681c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:07:07.855588 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-07f1750b-2667-4ec6-973f-5254822e681c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:07:07.862915 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-9c0a6866-bc89-4ab7-b999-a86d0e8b530f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.081621 Nov 23 13:07:07.863463 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-07f1750b-2667-4ec6-973f-5254822e681c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:07.863640 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 503/946] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:07:07 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:07:07.864294 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-07f1750b-2667-4ec6-973f-5254822e681c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:07.865412 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-07f1750b-2667-4ec6-973f-5254822e681c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:07.865853 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-07f1750b-2667-4ec6-973f-5254822e681c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:08.076303 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-07f1750b-2667-4ec6-973f-5254822e681c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:07:08.084699 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-07f1750b-2667-4ec6-973f-5254822e681c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.233693 Nov 23 13:07:08.085290 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 444/947] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:07:07 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:07:08.877855 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-e3a9cfc0-ef46-49fe-bd28-f09894e975c8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:07:08.879308 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-e3a9cfc0-ef46-49fe-bd28-f09894e975c8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:07:08.891620 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e3a9cfc0-ef46-49fe-bd28-f09894e975c8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:08.892403 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e3a9cfc0-ef46-49fe-bd28-f09894e975c8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:08.893749 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e3a9cfc0-ef46-49fe-bd28-f09894e975c8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:08.894441 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e3a9cfc0-ef46-49fe-bd28-f09894e975c8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:08.961229 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-e3a9cfc0-ef46-49fe-bd28-f09894e975c8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.090205 Nov 23 13:07:08.961952 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 504/948] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:07:08 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:07:09.106336 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-3121e193-c9c6-4f03-ab8c-170a6303d2b4 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:07:09.107175 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-3121e193-c9c6-4f03-ab8c-170a6303d2b4 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:07:09.119165 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3121e193-c9c6-4f03-ab8c-170a6303d2b4 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:09.119686 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3121e193-c9c6-4f03-ab8c-170a6303d2b4 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:09.120461 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3121e193-c9c6-4f03-ab8c-170a6303d2b4 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:09.120896 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3121e193-c9c6-4f03-ab8c-170a6303d2b4 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:09.326363 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-3121e193-c9c6-4f03-ab8c-170a6303d2b4 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:07:09.335376 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-3121e193-c9c6-4f03-ab8c-170a6303d2b4 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.235540 Nov 23 13:07:09.335969 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 445/949] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:07:09 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:07:09.978747 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-8644edde-50d7-47d7-b1fa-954e71281a51 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:07:09.979610 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-8644edde-50d7-47d7-b1fa-954e71281a51 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:07:09.987881 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8644edde-50d7-47d7-b1fa-954e71281a51 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:09.988343 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8644edde-50d7-47d7-b1fa-954e71281a51 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:09.989109 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8644edde-50d7-47d7-b1fa-954e71281a51 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:09.989529 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8644edde-50d7-47d7-b1fa-954e71281a51 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:10.052850 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-8644edde-50d7-47d7-b1fa-954e71281a51 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.080107 Nov 23 13:07:10.053436 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 505/950] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:07:09 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:07:10.281887 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 13:07:10.282716 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: Tue Nov 23 13:07:10 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 23 13:07:10.355014 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-8b1d1408-bba6-4d47-881b-0961f4e7dee0 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:07:10.355896 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-8b1d1408-bba6-4d47-881b-0961f4e7dee0 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:07:10.366718 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8b1d1408-bba6-4d47-881b-0961f4e7dee0 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:10.367356 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8b1d1408-bba6-4d47-881b-0961f4e7dee0 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:10.368362 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8b1d1408-bba6-4d47-881b-0961f4e7dee0 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:10.368790 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8b1d1408-bba6-4d47-881b-0961f4e7dee0 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:10.579176 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-8b1d1408-bba6-4d47-881b-0961f4e7dee0 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:07:10.588391 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-8b1d1408-bba6-4d47-881b-0961f4e7dee0 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.238740 Nov 23 13:07:10.588944 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 446/951] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:07:10 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:07:11.069190 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-c92ee133-9e46-492f-a943-43d47bdcd728 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:07:11.070679 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-c92ee133-9e46-492f-a943-43d47bdcd728 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:07:11.083476 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c92ee133-9e46-492f-a943-43d47bdcd728 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:11.084099 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c92ee133-9e46-492f-a943-43d47bdcd728 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:11.085423 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c92ee133-9e46-492f-a943-43d47bdcd728 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:11.086136 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c92ee133-9e46-492f-a943-43d47bdcd728 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:11.150203 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-c92ee133-9e46-492f-a943-43d47bdcd728 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.087613 Nov 23 13:07:11.150781 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 506/952] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:07:11 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:07:11.610158 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-c6b5bc9d-1903-40ca-b4ac-d56e499759c8 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:07:11.611121 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-c6b5bc9d-1903-40ca-b4ac-d56e499759c8 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:07:11.624139 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c6b5bc9d-1903-40ca-b4ac-d56e499759c8 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:11.624941 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c6b5bc9d-1903-40ca-b4ac-d56e499759c8 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:11.626219 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c6b5bc9d-1903-40ca-b4ac-d56e499759c8 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:11.626944 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c6b5bc9d-1903-40ca-b4ac-d56e499759c8 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:11.846082 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-c6b5bc9d-1903-40ca-b4ac-d56e499759c8 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:07:11.854693 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-c6b5bc9d-1903-40ca-b4ac-d56e499759c8 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.250833 Nov 23 13:07:11.855287 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 447/953] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:07:11 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:07:12.166681 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-4591a0b2-f28e-4c92-9227-16563f7c176b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:07:12.167835 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-4591a0b2-f28e-4c92-9227-16563f7c176b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:07:12.177077 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4591a0b2-f28e-4c92-9227-16563f7c176b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:12.177592 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4591a0b2-f28e-4c92-9227-16563f7c176b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:12.178481 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4591a0b2-f28e-4c92-9227-16563f7c176b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:12.178986 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4591a0b2-f28e-4c92-9227-16563f7c176b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:12.251718 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-4591a0b2-f28e-4c92-9227-16563f7c176b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.091416 Nov 23 13:07:12.252584 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 507/954] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:07:12 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:07:12.872619 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-ad53e9c2-f140-41f7-8f71-e8083f7d45b7 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:07:12.873615 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-ad53e9c2-f140-41f7-8f71-e8083f7d45b7 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:07:12.885184 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ad53e9c2-f140-41f7-8f71-e8083f7d45b7 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:12.885635 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ad53e9c2-f140-41f7-8f71-e8083f7d45b7 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:12.886389 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ad53e9c2-f140-41f7-8f71-e8083f7d45b7 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:12.886811 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ad53e9c2-f140-41f7-8f71-e8083f7d45b7 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:13.095488 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-ad53e9c2-f140-41f7-8f71-e8083f7d45b7 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:07:13.104458 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-ad53e9c2-f140-41f7-8f71-e8083f7d45b7 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.236263 Nov 23 13:07:13.105025 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 448/955] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:07:12 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:07:13.270302 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-dfa6f081-d90d-45d1-b1cf-b9dd1e7591b4 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:07:13.271798 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-dfa6f081-d90d-45d1-b1cf-b9dd1e7591b4 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:07:13.281476 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-dfa6f081-d90d-45d1-b1cf-b9dd1e7591b4 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:13.281923 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-dfa6f081-d90d-45d1-b1cf-b9dd1e7591b4 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:13.282687 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-dfa6f081-d90d-45d1-b1cf-b9dd1e7591b4 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:13.283118 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-dfa6f081-d90d-45d1-b1cf-b9dd1e7591b4 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:13.349839 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-dfa6f081-d90d-45d1-b1cf-b9dd1e7591b4 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.085527 Nov 23 13:07:13.350464 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 508/956] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:07:13 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:07:14.122216 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-f3764908-be34-40fb-ba18-49923f5e9551 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:07:14.122697 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-f3764908-be34-40fb-ba18-49923f5e9551 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:07:14.130535 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f3764908-be34-40fb-ba18-49923f5e9551 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:14.131020 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f3764908-be34-40fb-ba18-49923f5e9551 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:14.131795 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f3764908-be34-40fb-ba18-49923f5e9551 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:14.132269 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f3764908-be34-40fb-ba18-49923f5e9551 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:14.363943 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-d945791c-3524-456b-bd96-dfd1dbe159c3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:07:14.364918 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-d945791c-3524-456b-bd96-dfd1dbe159c3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:07:14.365197 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-f3764908-be34-40fb-ba18-49923f5e9551 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:07:14.373342 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d945791c-3524-456b-bd96-dfd1dbe159c3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:14.373732 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d945791c-3524-456b-bd96-dfd1dbe159c3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:14.374510 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d945791c-3524-456b-bd96-dfd1dbe159c3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:14.374846 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-f3764908-be34-40fb-ba18-49923f5e9551 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.257066 Nov 23 13:07:14.374973 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d945791c-3524-456b-bd96-dfd1dbe159c3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:14.375458 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 449/957] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:07:14 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:07:14.439190 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-d945791c-3524-456b-bd96-dfd1dbe159c3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.079114 Nov 23 13:07:14.439748 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 509/958] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:07:14 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:07:15.395397 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-3449c099-d097-4ed9-8441-516abf8b386b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:07:15.396452 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-3449c099-d097-4ed9-8441-516abf8b386b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:07:15.408741 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3449c099-d097-4ed9-8441-516abf8b386b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:15.409486 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3449c099-d097-4ed9-8441-516abf8b386b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:15.410742 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3449c099-d097-4ed9-8441-516abf8b386b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:15.411449 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3449c099-d097-4ed9-8441-516abf8b386b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:15.451779 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-1f819092-3d86-4fe9-8189-5c308d3d8445 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:07:15.452635 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-1f819092-3d86-4fe9-8189-5c308d3d8445 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:07:15.460324 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-1f819092-3d86-4fe9-8189-5c308d3d8445 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:15.460708 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-1f819092-3d86-4fe9-8189-5c308d3d8445 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:15.461454 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-1f819092-3d86-4fe9-8189-5c308d3d8445 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:15.461869 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-1f819092-3d86-4fe9-8189-5c308d3d8445 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:15.525144 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-1f819092-3d86-4fe9-8189-5c308d3d8445 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.077286 Nov 23 13:07:15.525775 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 510/959] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:07:15 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 13:07:15.621587 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-3449c099-d097-4ed9-8441-516abf8b386b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:07:15.630367 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-3449c099-d097-4ed9-8441-516abf8b386b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.241242 Nov 23 13:07:15.630937 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 450/960] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:07:15 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:07:16.541694 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-0ed4fbd4-0738-4344-8b26-c20e3ee2f1e6 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:07:16.543239 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-0ed4fbd4-0738-4344-8b26-c20e3ee2f1e6 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:07:16.556183 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0ed4fbd4-0738-4344-8b26-c20e3ee2f1e6 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:16.556986 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0ed4fbd4-0738-4344-8b26-c20e3ee2f1e6 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:16.558254 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0ed4fbd4-0738-4344-8b26-c20e3ee2f1e6 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:16.559010 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0ed4fbd4-0738-4344-8b26-c20e3ee2f1e6 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:16.635521 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-0ed4fbd4-0738-4344-8b26-c20e3ee2f1e6 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.100139 Nov 23 13:07:16.636484 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 511/961] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:07:16 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:07:16.649980 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-4d7b1c68-d57e-45d8-a9c2-292bdfac2ca8 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:07:16.650581 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-4d7b1c68-d57e-45d8-a9c2-292bdfac2ca8 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:07:16.661904 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-4d7b1c68-d57e-45d8-a9c2-292bdfac2ca8 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:16.662436 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-4d7b1c68-d57e-45d8-a9c2-292bdfac2ca8 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:16.663438 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-4d7b1c68-d57e-45d8-a9c2-292bdfac2ca8 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:16.663915 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-4d7b1c68-d57e-45d8-a9c2-292bdfac2ca8 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:16.936052 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-4d7b1c68-d57e-45d8-a9c2-292bdfac2ca8 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:07:16.944644 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-4d7b1c68-d57e-45d8-a9c2-292bdfac2ca8 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.300576 Nov 23 13:07:16.945182 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 451/962] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:07:16 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:07:17.648260 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-42c37350-6697-4228-8dea-a2479fb085a0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:07:17.649079 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-42c37350-6697-4228-8dea-a2479fb085a0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:07:17.657165 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-42c37350-6697-4228-8dea-a2479fb085a0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:17.657614 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-42c37350-6697-4228-8dea-a2479fb085a0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:17.658387 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-42c37350-6697-4228-8dea-a2479fb085a0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:17.658811 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-42c37350-6697-4228-8dea-a2479fb085a0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:17.734269 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-42c37350-6697-4228-8dea-a2479fb085a0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.090071 Nov 23 13:07:17.734830 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 512/963] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:07:17 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:07:17.963078 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-c5e5a26b-6a29-43a7-b99d-682b38422178 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:07:17.963668 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-c5e5a26b-6a29-43a7-b99d-682b38422178 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:07:17.971770 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c5e5a26b-6a29-43a7-b99d-682b38422178 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:17.972219 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c5e5a26b-6a29-43a7-b99d-682b38422178 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:17.973018 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c5e5a26b-6a29-43a7-b99d-682b38422178 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:17.973445 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c5e5a26b-6a29-43a7-b99d-682b38422178 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:18.175940 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-c5e5a26b-6a29-43a7-b99d-682b38422178 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:07:18.184343 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-c5e5a26b-6a29-43a7-b99d-682b38422178 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.225187 Nov 23 13:07:18.184976 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 452/964] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:07:17 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:07:18.750568 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-c68076d9-7452-4a99-bc71-16c5079505c0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:07:18.751534 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-c68076d9-7452-4a99-bc71-16c5079505c0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:07:18.761398 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c68076d9-7452-4a99-bc71-16c5079505c0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:18.761939 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c68076d9-7452-4a99-bc71-16c5079505c0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:18.762880 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c68076d9-7452-4a99-bc71-16c5079505c0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:18.763382 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c68076d9-7452-4a99-bc71-16c5079505c0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:18.830214 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-c68076d9-7452-4a99-bc71-16c5079505c0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.086213 Nov 23 13:07:18.830762 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 513/965] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:07:18 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:07:19.206449 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-ebe45190-b556-4ac7-aad4-21a6f94622bf tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:07:19.207441 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-ebe45190-b556-4ac7-aad4-21a6f94622bf tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:07:19.218670 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ebe45190-b556-4ac7-aad4-21a6f94622bf tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:19.219110 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ebe45190-b556-4ac7-aad4-21a6f94622bf tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:19.219876 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ebe45190-b556-4ac7-aad4-21a6f94622bf tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:19.220343 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ebe45190-b556-4ac7-aad4-21a6f94622bf tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:19.414943 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-ebe45190-b556-4ac7-aad4-21a6f94622bf tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:07:19.427717 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-ebe45190-b556-4ac7-aad4-21a6f94622bf tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.228037 Nov 23 13:07:19.428476 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 453/966] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:07:19 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:07:19.842437 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-be4499c7-7261-4b0f-a5a3-69783ed56658 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:07:19.843368 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-be4499c7-7261-4b0f-a5a3-69783ed56658 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:07:19.851226 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-be4499c7-7261-4b0f-a5a3-69783ed56658 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:19.851675 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-be4499c7-7261-4b0f-a5a3-69783ed56658 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:19.852463 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-be4499c7-7261-4b0f-a5a3-69783ed56658 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:19.853088 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-be4499c7-7261-4b0f-a5a3-69783ed56658 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:19.917473 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-be4499c7-7261-4b0f-a5a3-69783ed56658 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.078995 Nov 23 13:07:19.917958 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 514/967] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:07:19 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:07:20.447999 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-920a94de-a1c0-4fe0-90cc-cd7844afc5db tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:07:20.448607 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-920a94de-a1c0-4fe0-90cc-cd7844afc5db tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:07:20.456748 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-920a94de-a1c0-4fe0-90cc-cd7844afc5db tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:20.457205 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-920a94de-a1c0-4fe0-90cc-cd7844afc5db tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:20.457976 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-920a94de-a1c0-4fe0-90cc-cd7844afc5db tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:20.458406 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-920a94de-a1c0-4fe0-90cc-cd7844afc5db tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:20.675989 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-920a94de-a1c0-4fe0-90cc-cd7844afc5db tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:07:20.688440 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-920a94de-a1c0-4fe0-90cc-cd7844afc5db tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.244324 Nov 23 13:07:20.689191 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 454/968] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:07:20 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:07:20.929577 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-53784d28-1815-4d08-b7a9-e579cbf94fa3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:07:20.930475 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-53784d28-1815-4d08-b7a9-e579cbf94fa3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:07:20.938437 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-53784d28-1815-4d08-b7a9-e579cbf94fa3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:20.939142 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-53784d28-1815-4d08-b7a9-e579cbf94fa3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:20.939926 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-53784d28-1815-4d08-b7a9-e579cbf94fa3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:20.940394 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-53784d28-1815-4d08-b7a9-e579cbf94fa3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:21.008397 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-53784d28-1815-4d08-b7a9-e579cbf94fa3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.082793 Nov 23 13:07:21.008948 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 515/969] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:07:20 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:07:21.710040 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-aa276476-be1f-48ef-9b5f-cbee28275fe1 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:07:21.710978 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-aa276476-be1f-48ef-9b5f-cbee28275fe1 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:07:21.721243 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-aa276476-be1f-48ef-9b5f-cbee28275fe1 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:21.721698 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-aa276476-be1f-48ef-9b5f-cbee28275fe1 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:21.722465 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-aa276476-be1f-48ef-9b5f-cbee28275fe1 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:21.722898 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-aa276476-be1f-48ef-9b5f-cbee28275fe1 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:21.918833 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-aa276476-be1f-48ef-9b5f-cbee28275fe1 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:07:21.927335 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-aa276476-be1f-48ef-9b5f-cbee28275fe1 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.223861 Nov 23 13:07:21.927903 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 455/970] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:07:21 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:07:22.022603 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-284cd830-c3e4-435e-9179-40713bb5a556 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:07:22.023824 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-284cd830-c3e4-435e-9179-40713bb5a556 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:07:22.036146 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-284cd830-c3e4-435e-9179-40713bb5a556 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:22.036875 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-284cd830-c3e4-435e-9179-40713bb5a556 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:22.038086 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-284cd830-c3e4-435e-9179-40713bb5a556 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:22.038733 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-284cd830-c3e4-435e-9179-40713bb5a556 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:22.105380 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-284cd830-c3e4-435e-9179-40713bb5a556 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.089096 Nov 23 13:07:22.105927 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 516/971] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:07:22 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:07:22.948444 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-11c7638d-717e-4ec3-8029-236853b2f09f tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:07:22.949476 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-11c7638d-717e-4ec3-8029-236853b2f09f tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:07:22.961694 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-11c7638d-717e-4ec3-8029-236853b2f09f tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:22.962431 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-11c7638d-717e-4ec3-8029-236853b2f09f tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:22.963673 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-11c7638d-717e-4ec3-8029-236853b2f09f tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:22.964429 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-11c7638d-717e-4ec3-8029-236853b2f09f tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:23.126227 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-08fcd76e-97d8-4554-a91a-5ce219f61a6d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:07:23.127049 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-08fcd76e-97d8-4554-a91a-5ce219f61a6d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:07:23.134771 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-08fcd76e-97d8-4554-a91a-5ce219f61a6d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:23.135182 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-08fcd76e-97d8-4554-a91a-5ce219f61a6d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:23.135943 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-08fcd76e-97d8-4554-a91a-5ce219f61a6d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:23.136402 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-08fcd76e-97d8-4554-a91a-5ce219f61a6d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:23.184446 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-11c7638d-717e-4ec3-8029-236853b2f09f tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:07:23.193467 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-11c7638d-717e-4ec3-8029-236853b2f09f tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.251233 Nov 23 13:07:23.194047 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 456/972] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:07:22 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:07:23.199589 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-08fcd76e-97d8-4554-a91a-5ce219f61a6d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.077541 Nov 23 13:07:23.200135 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 517/973] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:07:23 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:07:24.210591 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-1edc169d-db1e-4477-98b0-79e79f265531 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:07:24.211156 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-8d6b27fb-9026-4a6a-b834-da4217ade1c7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:07:24.211531 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-1edc169d-db1e-4477-98b0-79e79f265531 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:07:24.211897 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-8d6b27fb-9026-4a6a-b834-da4217ade1c7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:07:24.218971 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1edc169d-db1e-4477-98b0-79e79f265531 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:24.219428 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1edc169d-db1e-4477-98b0-79e79f265531 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:24.219715 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8d6b27fb-9026-4a6a-b834-da4217ade1c7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:24.220171 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8d6b27fb-9026-4a6a-b834-da4217ade1c7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:24.220351 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1edc169d-db1e-4477-98b0-79e79f265531 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:24.220634 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1edc169d-db1e-4477-98b0-79e79f265531 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:24.221118 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8d6b27fb-9026-4a6a-b834-da4217ade1c7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:24.221550 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8d6b27fb-9026-4a6a-b834-da4217ade1c7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:24.286278 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-8d6b27fb-9026-4a6a-b834-da4217ade1c7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.079038 Nov 23 13:07:24.286868 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 518/974] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:07:24 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:07:24.423790 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-1edc169d-db1e-4477-98b0-79e79f265531 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:07:24.432561 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-1edc169d-db1e-4477-98b0-79e79f265531 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.225434 Nov 23 13:07:24.433103 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 457/975] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:07:24 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:07:25.299980 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-b209f403-ca91-4ab0-9865-6932291eaa4b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:07:25.301192 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-b209f403-ca91-4ab0-9865-6932291eaa4b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:07:25.310680 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b209f403-ca91-4ab0-9865-6932291eaa4b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:25.311237 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b209f403-ca91-4ab0-9865-6932291eaa4b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:25.312166 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b209f403-ca91-4ab0-9865-6932291eaa4b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:25.312750 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b209f403-ca91-4ab0-9865-6932291eaa4b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:25.380842 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-b209f403-ca91-4ab0-9865-6932291eaa4b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.085993 Nov 23 13:07:25.381389 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 519/976] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:07:25 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:07:25.453172 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-99884287-ca7c-4c7e-9506-59967a97a795 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:07:25.454120 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-99884287-ca7c-4c7e-9506-59967a97a795 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:07:25.462187 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-99884287-ca7c-4c7e-9506-59967a97a795 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:25.462634 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-99884287-ca7c-4c7e-9506-59967a97a795 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:25.463396 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-99884287-ca7c-4c7e-9506-59967a97a795 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:25.463821 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-99884287-ca7c-4c7e-9506-59967a97a795 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:25.669756 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-99884287-ca7c-4c7e-9506-59967a97a795 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:07:25.678898 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-99884287-ca7c-4c7e-9506-59967a97a795 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.232176 Nov 23 13:07:25.679480 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 458/977] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:07:25 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:07:26.396036 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-cfee8c28-f3c6-4bc6-b77a-32178c28caf2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:07:26.399426 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-cfee8c28-f3c6-4bc6-b77a-32178c28caf2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:07:26.407493 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-cfee8c28-f3c6-4bc6-b77a-32178c28caf2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:26.408079 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-cfee8c28-f3c6-4bc6-b77a-32178c28caf2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:26.409155 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-cfee8c28-f3c6-4bc6-b77a-32178c28caf2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:26.409713 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-cfee8c28-f3c6-4bc6-b77a-32178c28caf2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:26.477686 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-cfee8c28-f3c6-4bc6-b77a-32178c28caf2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.087427 Nov 23 13:07:26.478269 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 520/978] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:07:26 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:07:26.695538 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-672bea97-04c8-4028-928f-b3a0c33d0e65 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:07:26.696123 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-672bea97-04c8-4028-928f-b3a0c33d0e65 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:07:26.703630 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-672bea97-04c8-4028-928f-b3a0c33d0e65 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:26.704104 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-672bea97-04c8-4028-928f-b3a0c33d0e65 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:26.704914 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-672bea97-04c8-4028-928f-b3a0c33d0e65 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:26.705356 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-672bea97-04c8-4028-928f-b3a0c33d0e65 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:27.071278 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-672bea97-04c8-4028-928f-b3a0c33d0e65 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:07:27.080263 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-672bea97-04c8-4028-928f-b3a0c33d0e65 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.388542 Nov 23 13:07:27.080842 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 459/979] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:07:26 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:07:27.492273 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-67591a50-44f0-4320-b42d-bfcf89a6fae9 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:07:27.493166 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-67591a50-44f0-4320-b42d-bfcf89a6fae9 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:07:27.501914 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-67591a50-44f0-4320-b42d-bfcf89a6fae9 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:27.502359 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-67591a50-44f0-4320-b42d-bfcf89a6fae9 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:27.503131 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-67591a50-44f0-4320-b42d-bfcf89a6fae9 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:27.503564 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-67591a50-44f0-4320-b42d-bfcf89a6fae9 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:27.568793 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-67591a50-44f0-4320-b42d-bfcf89a6fae9 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.080434 Nov 23 13:07:27.569402 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 521/980] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:07:27 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:07:28.097824 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-306af102-25b4-4ee0-80e2-aa2e9f2e8ddb tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:07:28.098690 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-306af102-25b4-4ee0-80e2-aa2e9f2e8ddb tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:07:28.107317 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-306af102-25b4-4ee0-80e2-aa2e9f2e8ddb tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:28.107845 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-306af102-25b4-4ee0-80e2-aa2e9f2e8ddb tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:28.108723 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-306af102-25b4-4ee0-80e2-aa2e9f2e8ddb tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:28.109216 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-306af102-25b4-4ee0-80e2-aa2e9f2e8ddb tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:28.384302 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-306af102-25b4-4ee0-80e2-aa2e9f2e8ddb tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:07:28.397598 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-306af102-25b4-4ee0-80e2-aa2e9f2e8ddb tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.303447 Nov 23 13:07:28.398410 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 460/981] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:07:28 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:07:28.585016 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-2dff4903-82f1-4dde-bf8a-5acccc43d4a3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:07:28.586984 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-2dff4903-82f1-4dde-bf8a-5acccc43d4a3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:07:28.599655 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-2dff4903-82f1-4dde-bf8a-5acccc43d4a3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:28.600430 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-2dff4903-82f1-4dde-bf8a-5acccc43d4a3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:28.601721 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-2dff4903-82f1-4dde-bf8a-5acccc43d4a3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:28.602452 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-2dff4903-82f1-4dde-bf8a-5acccc43d4a3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:28.670841 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-2dff4903-82f1-4dde-bf8a-5acccc43d4a3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.092560 Nov 23 13:07:28.671367 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 522/982] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:07:28 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:07:29.422191 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-6ba5a5db-8314-4cd0-a607-8294b5222a5a tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:07:29.423113 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-6ba5a5db-8314-4cd0-a607-8294b5222a5a tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:07:29.431110 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-6ba5a5db-8314-4cd0-a607-8294b5222a5a tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:29.431563 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-6ba5a5db-8314-4cd0-a607-8294b5222a5a tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:29.432358 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-6ba5a5db-8314-4cd0-a607-8294b5222a5a tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:29.432789 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-6ba5a5db-8314-4cd0-a607-8294b5222a5a tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:29.643074 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-6ba5a5db-8314-4cd0-a607-8294b5222a5a tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:07:29.652078 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-6ba5a5db-8314-4cd0-a607-8294b5222a5a tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.236259 Nov 23 13:07:29.652688 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 461/983] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:07:29 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:07:29.683226 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-d294409c-3099-4a71-a3e4-10dba188deaa tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:07:29.684221 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-d294409c-3099-4a71-a3e4-10dba188deaa tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:07:29.691686 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d294409c-3099-4a71-a3e4-10dba188deaa tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:29.692127 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d294409c-3099-4a71-a3e4-10dba188deaa tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:29.692949 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d294409c-3099-4a71-a3e4-10dba188deaa tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:29.693377 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d294409c-3099-4a71-a3e4-10dba188deaa tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:29.762466 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-d294409c-3099-4a71-a3e4-10dba188deaa tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.083222 Nov 23 13:07:29.763230 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 523/984] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:07:29 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:07:30.673955 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-9ba118c4-8b09-4321-bb62-c960f62cdc70 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:07:30.674957 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-9ba118c4-8b09-4321-bb62-c960f62cdc70 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:07:30.687329 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-9ba118c4-8b09-4321-bb62-c960f62cdc70 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:30.688123 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-9ba118c4-8b09-4321-bb62-c960f62cdc70 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:30.689350 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-9ba118c4-8b09-4321-bb62-c960f62cdc70 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:30.689785 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-9ba118c4-8b09-4321-bb62-c960f62cdc70 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:30.774450 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-122d4ff5-628b-4154-8feb-197bfed4c793 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:07:30.775360 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-122d4ff5-628b-4154-8feb-197bfed4c793 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:07:30.783053 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-122d4ff5-628b-4154-8feb-197bfed4c793 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:30.783497 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-122d4ff5-628b-4154-8feb-197bfed4c793 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:30.784312 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-122d4ff5-628b-4154-8feb-197bfed4c793 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:30.784744 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-122d4ff5-628b-4154-8feb-197bfed4c793 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:30.848606 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-122d4ff5-628b-4154-8feb-197bfed4c793 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.078010 Nov 23 13:07:30.849375 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 524/985] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:07:30 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:07:30.892302 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-9ba118c4-8b09-4321-bb62-c960f62cdc70 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:07:30.900790 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-9ba118c4-8b09-4321-bb62-c960f62cdc70 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.233923 Nov 23 13:07:30.901359 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 462/986] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:07:30 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:07:31.860833 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-5214c5d3-d2ca-4efc-b6c0-4223c5997b51 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:07:31.861860 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-5214c5d3-d2ca-4efc-b6c0-4223c5997b51 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:07:31.869657 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5214c5d3-d2ca-4efc-b6c0-4223c5997b51 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:31.870100 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5214c5d3-d2ca-4efc-b6c0-4223c5997b51 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:31.871240 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5214c5d3-d2ca-4efc-b6c0-4223c5997b51 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:31.871678 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5214c5d3-d2ca-4efc-b6c0-4223c5997b51 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:31.917813 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-f4ed2f6f-79d3-4da1-b6e9-47261e6ad66d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:07:31.918369 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-f4ed2f6f-79d3-4da1-b6e9-47261e6ad66d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:07:31.926644 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f4ed2f6f-79d3-4da1-b6e9-47261e6ad66d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:31.927094 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f4ed2f6f-79d3-4da1-b6e9-47261e6ad66d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:31.927862 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f4ed2f6f-79d3-4da1-b6e9-47261e6ad66d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:31.928301 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f4ed2f6f-79d3-4da1-b6e9-47261e6ad66d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:31.938066 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-5214c5d3-d2ca-4efc-b6c0-4223c5997b51 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.080935 Nov 23 13:07:31.938566 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 525/987] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:07:31 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:07:32.147842 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-f4ed2f6f-79d3-4da1-b6e9-47261e6ad66d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:07:32.160051 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-f4ed2f6f-79d3-4da1-b6e9-47261e6ad66d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.245956 Nov 23 13:07:32.160649 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 463/988] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:07:31 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 13:07:32.950076 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-5ebba4fe-60a2-4e31-b24a-ba639a804e60 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:07:32.950989 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-5ebba4fe-60a2-4e31-b24a-ba639a804e60 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:07:32.959273 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5ebba4fe-60a2-4e31-b24a-ba639a804e60 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:32.959723 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5ebba4fe-60a2-4e31-b24a-ba639a804e60 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:32.960534 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5ebba4fe-60a2-4e31-b24a-ba639a804e60 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:32.960974 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5ebba4fe-60a2-4e31-b24a-ba639a804e60 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:33.026311 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-5ebba4fe-60a2-4e31-b24a-ba639a804e60 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.080111 Nov 23 13:07:33.026876 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 526/989] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:07:32 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:07:33.179504 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-531c0c8b-99f5-4f70-9bbc-f95618aab586 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:07:33.180274 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-531c0c8b-99f5-4f70-9bbc-f95618aab586 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:07:33.191687 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-531c0c8b-99f5-4f70-9bbc-f95618aab586 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:33.192338 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-531c0c8b-99f5-4f70-9bbc-f95618aab586 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:33.193469 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-531c0c8b-99f5-4f70-9bbc-f95618aab586 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:33.194077 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-531c0c8b-99f5-4f70-9bbc-f95618aab586 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:33.402542 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-531c0c8b-99f5-4f70-9bbc-f95618aab586 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:07:33.412802 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-531c0c8b-99f5-4f70-9bbc-f95618aab586 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.238834 Nov 23 13:07:33.413374 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 464/990] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:07:33 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:07:34.042614 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-ad48e264-3810-424e-b509-da7cf90cdf62 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:07:34.044095 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-ad48e264-3810-424e-b509-da7cf90cdf62 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:07:34.053854 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ad48e264-3810-424e-b509-da7cf90cdf62 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:34.054291 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ad48e264-3810-424e-b509-da7cf90cdf62 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:34.055067 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ad48e264-3810-424e-b509-da7cf90cdf62 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:34.055498 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ad48e264-3810-424e-b509-da7cf90cdf62 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:34.127814 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-ad48e264-3810-424e-b509-da7cf90cdf62 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.091831 Nov 23 13:07:34.128454 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 527/991] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:07:34 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:07:34.433339 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-cd775e15-3241-4cb5-ae55-4b7d6443eff9 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:07:34.434577 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-cd775e15-3241-4cb5-ae55-4b7d6443eff9 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:07:34.444440 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-cd775e15-3241-4cb5-ae55-4b7d6443eff9 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:34.445276 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-cd775e15-3241-4cb5-ae55-4b7d6443eff9 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:34.446327 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-cd775e15-3241-4cb5-ae55-4b7d6443eff9 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:34.446738 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-cd775e15-3241-4cb5-ae55-4b7d6443eff9 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:34.661411 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-cd775e15-3241-4cb5-ae55-4b7d6443eff9 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:07:34.669907 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-cd775e15-3241-4cb5-ae55-4b7d6443eff9 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.242886 Nov 23 13:07:34.670502 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 465/992] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:07:34 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:07:35.142377 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-4b78b40f-959f-4ff6-ae91-819e1bff1111 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:07:35.143347 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-4b78b40f-959f-4ff6-ae91-819e1bff1111 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:07:35.151670 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4b78b40f-959f-4ff6-ae91-819e1bff1111 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:35.152157 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4b78b40f-959f-4ff6-ae91-819e1bff1111 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:35.152978 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4b78b40f-959f-4ff6-ae91-819e1bff1111 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:35.153431 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4b78b40f-959f-4ff6-ae91-819e1bff1111 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:35.224962 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-4b78b40f-959f-4ff6-ae91-819e1bff1111 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.086635 Nov 23 13:07:35.225650 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 528/993] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:07:35 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:07:35.689795 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-19ce37d1-c69a-44d3-8c8d-620a16daa6cc tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:07:35.690497 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-19ce37d1-c69a-44d3-8c8d-620a16daa6cc tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:07:35.699543 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-19ce37d1-c69a-44d3-8c8d-620a16daa6cc tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:35.699979 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-19ce37d1-c69a-44d3-8c8d-620a16daa6cc tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:35.700816 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-19ce37d1-c69a-44d3-8c8d-620a16daa6cc tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:35.701256 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-19ce37d1-c69a-44d3-8c8d-620a16daa6cc tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:35.944288 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-19ce37d1-c69a-44d3-8c8d-620a16daa6cc tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:07:35.957825 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-19ce37d1-c69a-44d3-8c8d-620a16daa6cc tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.272576 Nov 23 13:07:35.958405 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 466/994] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:07:35 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:07:36.239489 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-b2bfd1d5-74d8-49a3-b18e-d3ef6b6d5b8a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:07:36.240354 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-b2bfd1d5-74d8-49a3-b18e-d3ef6b6d5b8a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:07:36.252712 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b2bfd1d5-74d8-49a3-b18e-d3ef6b6d5b8a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:36.253511 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b2bfd1d5-74d8-49a3-b18e-d3ef6b6d5b8a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:36.254819 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b2bfd1d5-74d8-49a3-b18e-d3ef6b6d5b8a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:36.255255 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b2bfd1d5-74d8-49a3-b18e-d3ef6b6d5b8a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:36.335069 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-b2bfd1d5-74d8-49a3-b18e-d3ef6b6d5b8a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.099877 Nov 23 13:07:36.335649 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 529/995] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:07:36 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 13:07:36.979959 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-c9927018-a973-41d9-822a-aa13f4b920a2 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:07:36.980807 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-c9927018-a973-41d9-822a-aa13f4b920a2 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:07:36.990526 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c9927018-a973-41d9-822a-aa13f4b920a2 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:36.990988 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c9927018-a973-41d9-822a-aa13f4b920a2 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:36.991752 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c9927018-a973-41d9-822a-aa13f4b920a2 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:36.992216 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c9927018-a973-41d9-822a-aa13f4b920a2 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:37.192974 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-c9927018-a973-41d9-822a-aa13f4b920a2 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:07:37.202077 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-c9927018-a973-41d9-822a-aa13f4b920a2 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.227505 Nov 23 13:07:37.202656 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 467/996] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:07:36 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:07:37.348629 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-ae4be2c5-f7ae-4751-8f23-e5b728016193 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:07:37.349543 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-ae4be2c5-f7ae-4751-8f23-e5b728016193 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:07:37.357430 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ae4be2c5-f7ae-4751-8f23-e5b728016193 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:37.357882 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ae4be2c5-f7ae-4751-8f23-e5b728016193 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:37.358651 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ae4be2c5-f7ae-4751-8f23-e5b728016193 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:37.359073 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ae4be2c5-f7ae-4751-8f23-e5b728016193 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:37.422151 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-ae4be2c5-f7ae-4751-8f23-e5b728016193 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.078328 Nov 23 13:07:37.422599 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 530/997] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:07:37 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:07:38.223442 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-31b0f5df-3913-4ec5-b0f3-8c31c1af9e9c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:07:38.224449 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-31b0f5df-3913-4ec5-b0f3-8c31c1af9e9c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:07:38.236624 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-31b0f5df-3913-4ec5-b0f3-8c31c1af9e9c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:38.237072 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-31b0f5df-3913-4ec5-b0f3-8c31c1af9e9c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:38.237842 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-31b0f5df-3913-4ec5-b0f3-8c31c1af9e9c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:38.238277 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-31b0f5df-3913-4ec5-b0f3-8c31c1af9e9c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:38.435231 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-66dcc9c5-2dca-4f16-a4fc-290635b5e117 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:07:38.436144 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-66dcc9c5-2dca-4f16-a4fc-290635b5e117 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:07:38.444078 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-66dcc9c5-2dca-4f16-a4fc-290635b5e117 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:38.444551 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-66dcc9c5-2dca-4f16-a4fc-290635b5e117 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:38.445368 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-66dcc9c5-2dca-4f16-a4fc-290635b5e117 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:38.445794 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-66dcc9c5-2dca-4f16-a4fc-290635b5e117 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:38.461007 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-31b0f5df-3913-4ec5-b0f3-8c31c1af9e9c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:07:38.469830 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-31b0f5df-3913-4ec5-b0f3-8c31c1af9e9c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.252689 Nov 23 13:07:38.470403 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 468/998] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:07:38 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:07:38.513958 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-66dcc9c5-2dca-4f16-a4fc-290635b5e117 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.082519 Nov 23 13:07:38.514478 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 531/999] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:07:38 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:07:39.491333 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-574bd10a-eade-47d9-8efc-43ade7817950 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:07:39.492205 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-574bd10a-eade-47d9-8efc-43ade7817950 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:07:39.503817 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-574bd10a-eade-47d9-8efc-43ade7817950 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:39.504280 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-574bd10a-eade-47d9-8efc-43ade7817950 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:39.505074 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-574bd10a-eade-47d9-8efc-43ade7817950 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:39.505504 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-574bd10a-eade-47d9-8efc-43ade7817950 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:39.526133 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-775b92c2-5667-4b49-ad48-707e3a2d3dcb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:07:39.527051 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-775b92c2-5667-4b49-ad48-707e3a2d3dcb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:07:39.534877 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-775b92c2-5667-4b49-ad48-707e3a2d3dcb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:39.535334 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-775b92c2-5667-4b49-ad48-707e3a2d3dcb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:39.536111 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-775b92c2-5667-4b49-ad48-707e3a2d3dcb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:39.536566 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-775b92c2-5667-4b49-ad48-707e3a2d3dcb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:39.608684 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-775b92c2-5667-4b49-ad48-707e3a2d3dcb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.086734 Nov 23 13:07:39.609227 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 532/1000] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:07:39 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:07:39.702275 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-574bd10a-eade-47d9-8efc-43ade7817950 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:07:39.710855 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-574bd10a-eade-47d9-8efc-43ade7817950 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.226169 Nov 23 13:07:39.711434 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 469/1001] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:07:39 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:07:40.625168 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-65767938-1b1f-4fff-a757-80ea1596f317 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:07:40.626613 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-65767938-1b1f-4fff-a757-80ea1596f317 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:07:40.639045 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-65767938-1b1f-4fff-a757-80ea1596f317 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:40.639772 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-65767938-1b1f-4fff-a757-80ea1596f317 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:40.641086 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-65767938-1b1f-4fff-a757-80ea1596f317 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:40.641822 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-65767938-1b1f-4fff-a757-80ea1596f317 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:40.705848 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-65767938-1b1f-4fff-a757-80ea1596f317 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.087500 Nov 23 13:07:40.706414 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 533/1002] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:07:40 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:07:40.731037 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-c4da82c4-b7a6-4dfa-adec-55e6c3ea5f15 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:07:40.731624 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-c4da82c4-b7a6-4dfa-adec-55e6c3ea5f15 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:07:40.739317 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c4da82c4-b7a6-4dfa-adec-55e6c3ea5f15 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:40.739764 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c4da82c4-b7a6-4dfa-adec-55e6c3ea5f15 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:40.740563 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c4da82c4-b7a6-4dfa-adec-55e6c3ea5f15 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:40.740996 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c4da82c4-b7a6-4dfa-adec-55e6c3ea5f15 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:40.950234 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-c4da82c4-b7a6-4dfa-adec-55e6c3ea5f15 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:07:40.958673 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-c4da82c4-b7a6-4dfa-adec-55e6c3ea5f15 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.231502 Nov 23 13:07:40.959225 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 470/1003] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:07:40 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:07:41.721841 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-e9fd76df-b3e0-48d5-b5d6-fc93597dba89 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:07:41.723014 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-e9fd76df-b3e0-48d5-b5d6-fc93597dba89 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:07:41.732536 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e9fd76df-b3e0-48d5-b5d6-fc93597dba89 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:41.733081 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e9fd76df-b3e0-48d5-b5d6-fc93597dba89 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:41.734026 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e9fd76df-b3e0-48d5-b5d6-fc93597dba89 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:41.734557 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e9fd76df-b3e0-48d5-b5d6-fc93597dba89 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:41.803535 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-e9fd76df-b3e0-48d5-b5d6-fc93597dba89 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.088002 Nov 23 13:07:41.804113 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 534/1004] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:07:41 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:07:41.979675 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-3e1178a6-db0b-42e0-9d4a-48d8b8266bd8 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:07:41.980827 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-3e1178a6-db0b-42e0-9d4a-48d8b8266bd8 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:07:41.991104 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3e1178a6-db0b-42e0-9d4a-48d8b8266bd8 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:41.991546 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3e1178a6-db0b-42e0-9d4a-48d8b8266bd8 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:41.992324 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3e1178a6-db0b-42e0-9d4a-48d8b8266bd8 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:41.992750 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3e1178a6-db0b-42e0-9d4a-48d8b8266bd8 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:42.200204 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-3e1178a6-db0b-42e0-9d4a-48d8b8266bd8 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:07:42.208923 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-3e1178a6-db0b-42e0-9d4a-48d8b8266bd8 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.235507 Nov 23 13:07:42.209515 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 471/1005] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:07:41 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:07:42.815951 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-19273b8c-cb96-4e24-863a-2db1b39cf864 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:07:42.816896 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-19273b8c-cb96-4e24-863a-2db1b39cf864 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:07:42.825473 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-19273b8c-cb96-4e24-863a-2db1b39cf864 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:42.825958 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-19273b8c-cb96-4e24-863a-2db1b39cf864 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:42.826890 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-19273b8c-cb96-4e24-863a-2db1b39cf864 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:42.827369 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-19273b8c-cb96-4e24-863a-2db1b39cf864 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:42.895872 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-19273b8c-cb96-4e24-863a-2db1b39cf864 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.083840 Nov 23 13:07:42.896475 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 535/1006] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:07:42 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:07:43.232974 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-b427a375-b7d9-4fed-8747-c882f09a3d96 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:07:43.234021 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-b427a375-b7d9-4fed-8747-c882f09a3d96 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:07:43.246835 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b427a375-b7d9-4fed-8747-c882f09a3d96 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:43.247575 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b427a375-b7d9-4fed-8747-c882f09a3d96 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:43.248968 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b427a375-b7d9-4fed-8747-c882f09a3d96 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:43.249676 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b427a375-b7d9-4fed-8747-c882f09a3d96 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:43.466674 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-b427a375-b7d9-4fed-8747-c882f09a3d96 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:07:43.475721 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-b427a375-b7d9-4fed-8747-c882f09a3d96 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.249048 Nov 23 13:07:43.476300 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 472/1007] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:07:43 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:07:43.907365 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-664b1604-d26c-4051-99da-f1843b7f97b0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:07:43.908350 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-664b1604-d26c-4051-99da-f1843b7f97b0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:07:43.916322 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-664b1604-d26c-4051-99da-f1843b7f97b0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:43.916766 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-664b1604-d26c-4051-99da-f1843b7f97b0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:43.917508 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-664b1604-d26c-4051-99da-f1843b7f97b0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:43.917997 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-664b1604-d26c-4051-99da-f1843b7f97b0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:43.981030 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-664b1604-d26c-4051-99da-f1843b7f97b0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.077564 Nov 23 13:07:43.981578 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 536/1008] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:07:43 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:07:44.497417 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-20b38c56-b23b-4568-b3bf-917eb5eb1ee1 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:07:44.498463 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-20b38c56-b23b-4568-b3bf-917eb5eb1ee1 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:07:44.508422 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-20b38c56-b23b-4568-b3bf-917eb5eb1ee1 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:44.508878 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-20b38c56-b23b-4568-b3bf-917eb5eb1ee1 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:44.509643 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-20b38c56-b23b-4568-b3bf-917eb5eb1ee1 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:44.510077 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-20b38c56-b23b-4568-b3bf-917eb5eb1ee1 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:44.724550 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-20b38c56-b23b-4568-b3bf-917eb5eb1ee1 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:07:44.733338 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-20b38c56-b23b-4568-b3bf-917eb5eb1ee1 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.242728 Nov 23 13:07:44.733907 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 473/1009] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:07:44 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:07:44.997528 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-7353d9be-8b92-43e0-adaa-2e1ef69f6ef7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:07:44.998723 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-7353d9be-8b92-43e0-adaa-2e1ef69f6ef7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:07:45.012144 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-7353d9be-8b92-43e0-adaa-2e1ef69f6ef7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:45.013209 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-7353d9be-8b92-43e0-adaa-2e1ef69f6ef7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:45.014537 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-7353d9be-8b92-43e0-adaa-2e1ef69f6ef7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:45.015251 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-7353d9be-8b92-43e0-adaa-2e1ef69f6ef7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:45.081090 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-7353d9be-8b92-43e0-adaa-2e1ef69f6ef7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.088951 Nov 23 13:07:45.081621 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 537/1010] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:07:44 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:07:45.755017 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-1c35c046-a899-47cf-b8ca-5fd9d09d3673 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:07:45.755948 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-1c35c046-a899-47cf-b8ca-5fd9d09d3673 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:07:45.768871 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1c35c046-a899-47cf-b8ca-5fd9d09d3673 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:45.769927 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1c35c046-a899-47cf-b8ca-5fd9d09d3673 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:45.771926 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1c35c046-a899-47cf-b8ca-5fd9d09d3673 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:45.771926 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1c35c046-a899-47cf-b8ca-5fd9d09d3673 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:45.971062 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-1c35c046-a899-47cf-b8ca-5fd9d09d3673 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:07:45.979822 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-1c35c046-a899-47cf-b8ca-5fd9d09d3673 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.231383 Nov 23 13:07:45.980428 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 474/1011] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:07:45 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:07:46.094065 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-59ab9f76-1e00-4049-838b-5308413f14be tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:07:46.095009 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-59ab9f76-1e00-4049-838b-5308413f14be tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:07:46.102976 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-59ab9f76-1e00-4049-838b-5308413f14be tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:46.103467 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-59ab9f76-1e00-4049-838b-5308413f14be tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:46.104228 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-59ab9f76-1e00-4049-838b-5308413f14be tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:46.104668 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-59ab9f76-1e00-4049-838b-5308413f14be tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:46.174642 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-59ab9f76-1e00-4049-838b-5308413f14be tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.084452 Nov 23 13:07:46.175164 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 538/1012] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:07:46 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:07:47.001042 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-c7df98b0-43ca-49fa-8281-9bbea7b47af3 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:07:47.002033 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-c7df98b0-43ca-49fa-8281-9bbea7b47af3 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:07:47.011585 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c7df98b0-43ca-49fa-8281-9bbea7b47af3 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:47.012031 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c7df98b0-43ca-49fa-8281-9bbea7b47af3 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:47.012907 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c7df98b0-43ca-49fa-8281-9bbea7b47af3 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:47.013327 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c7df98b0-43ca-49fa-8281-9bbea7b47af3 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:47.187017 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-a8660316-5b25-420c-9dbf-d06963b0ca47 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:07:47.187918 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-a8660316-5b25-420c-9dbf-d06963b0ca47 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:07:47.195552 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a8660316-5b25-420c-9dbf-d06963b0ca47 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:47.195999 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a8660316-5b25-420c-9dbf-d06963b0ca47 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:47.196799 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a8660316-5b25-420c-9dbf-d06963b0ca47 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:47.197226 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a8660316-5b25-420c-9dbf-d06963b0ca47 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:47.232435 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-c7df98b0-43ca-49fa-8281-9bbea7b47af3 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:07:47.240873 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-c7df98b0-43ca-49fa-8281-9bbea7b47af3 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.246531 Nov 23 13:07:47.241473 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 475/1013] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:07:46 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:07:47.264082 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-a8660316-5b25-420c-9dbf-d06963b0ca47 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.080976 Nov 23 13:07:47.264657 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 539/1014] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:07:47 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 13:07:48.262792 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-b32be631-5689-4762-9549-9b3d49fca933 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:07:48.263668 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-b32be631-5689-4762-9549-9b3d49fca933 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:07:48.276515 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b32be631-5689-4762-9549-9b3d49fca933 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:48.277266 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b32be631-5689-4762-9549-9b3d49fca933 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:48.278545 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b32be631-5689-4762-9549-9b3d49fca933 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:48.279263 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b32be631-5689-4762-9549-9b3d49fca933 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:48.279674 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-5b1d0331-df3e-4781-ba0b-3a5e76f274c7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:07:48.281158 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-5b1d0331-df3e-4781-ba0b-3a5e76f274c7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:07:48.291866 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5b1d0331-df3e-4781-ba0b-3a5e76f274c7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:48.292336 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5b1d0331-df3e-4781-ba0b-3a5e76f274c7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:48.293089 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5b1d0331-df3e-4781-ba0b-3a5e76f274c7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:48.293509 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5b1d0331-df3e-4781-ba0b-3a5e76f274c7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:48.356778 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-5b1d0331-df3e-4781-ba0b-3a5e76f274c7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.083416 Nov 23 13:07:48.357333 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 540/1015] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:07:48 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:07:48.495427 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-b32be631-5689-4762-9549-9b3d49fca933 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:07:48.504170 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-b32be631-5689-4762-9549-9b3d49fca933 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.247971 Nov 23 13:07:48.504768 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 476/1016] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:07:48 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:07:49.374401 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-7febfd97-9e9c-4df9-987e-d5bd45107369 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:07:49.375970 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-7febfd97-9e9c-4df9-987e-d5bd45107369 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:07:49.391137 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-7febfd97-9e9c-4df9-987e-d5bd45107369 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:49.391896 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-7febfd97-9e9c-4df9-987e-d5bd45107369 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:49.393200 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-7febfd97-9e9c-4df9-987e-d5bd45107369 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:49.393917 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-7febfd97-9e9c-4df9-987e-d5bd45107369 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:49.458039 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-7febfd97-9e9c-4df9-987e-d5bd45107369 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.090825 Nov 23 13:07:49.458600 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 541/1017] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:07:49 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:07:49.525115 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-283c7a97-a3a8-4f5e-b123-18e62a322255 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:07:49.525835 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-283c7a97-a3a8-4f5e-b123-18e62a322255 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:07:49.534827 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-283c7a97-a3a8-4f5e-b123-18e62a322255 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:49.535361 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-283c7a97-a3a8-4f5e-b123-18e62a322255 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:49.536277 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-283c7a97-a3a8-4f5e-b123-18e62a322255 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:49.536816 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-283c7a97-a3a8-4f5e-b123-18e62a322255 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:49.751084 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-283c7a97-a3a8-4f5e-b123-18e62a322255 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:07:49.760175 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-283c7a97-a3a8-4f5e-b123-18e62a322255 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.241481 Nov 23 13:07:49.760788 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 477/1018] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:07:49 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:07:50.472111 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-2e1f504d-6fd8-498d-af89-3c5d38a94b11 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:07:50.473256 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-2e1f504d-6fd8-498d-af89-3c5d38a94b11 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:07:50.481680 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-2e1f504d-6fd8-498d-af89-3c5d38a94b11 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:50.482124 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-2e1f504d-6fd8-498d-af89-3c5d38a94b11 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:50.482885 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-2e1f504d-6fd8-498d-af89-3c5d38a94b11 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:50.483312 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-2e1f504d-6fd8-498d-af89-3c5d38a94b11 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:50.549310 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-2e1f504d-6fd8-498d-af89-3c5d38a94b11 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.082095 Nov 23 13:07:50.549849 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 542/1019] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:07:50 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:07:50.779477 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-85135a1d-d4e2-429d-9b9f-db15b50c1b58 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:07:50.780173 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-85135a1d-d4e2-429d-9b9f-db15b50c1b58 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:07:50.789854 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-85135a1d-d4e2-429d-9b9f-db15b50c1b58 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:50.790413 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-85135a1d-d4e2-429d-9b9f-db15b50c1b58 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:50.791351 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-85135a1d-d4e2-429d-9b9f-db15b50c1b58 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:50.791880 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-85135a1d-d4e2-429d-9b9f-db15b50c1b58 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:51.057382 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-85135a1d-d4e2-429d-9b9f-db15b50c1b58 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:07:51.066463 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-85135a1d-d4e2-429d-9b9f-db15b50c1b58 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.291709 Nov 23 13:07:51.067037 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 478/1020] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:07:50 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:07:51.565540 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-f2a45fc1-ed59-4f15-b328-421e2bfaf107 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:07:51.567027 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-f2a45fc1-ed59-4f15-b328-421e2bfaf107 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:07:51.579470 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f2a45fc1-ed59-4f15-b328-421e2bfaf107 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:51.580196 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f2a45fc1-ed59-4f15-b328-421e2bfaf107 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:51.581487 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f2a45fc1-ed59-4f15-b328-421e2bfaf107 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:51.582240 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f2a45fc1-ed59-4f15-b328-421e2bfaf107 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:51.648036 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-f2a45fc1-ed59-4f15-b328-421e2bfaf107 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.089086 Nov 23 13:07:51.648680 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 543/1021] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:07:51 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:07:52.087135 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-7488aa57-031c-4e55-bd1f-1a86da526929 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:07:52.088273 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-7488aa57-031c-4e55-bd1f-1a86da526929 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:07:52.101222 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7488aa57-031c-4e55-bd1f-1a86da526929 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:52.101969 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7488aa57-031c-4e55-bd1f-1a86da526929 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:52.102739 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7488aa57-031c-4e55-bd1f-1a86da526929 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:52.103168 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7488aa57-031c-4e55-bd1f-1a86da526929 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:52.325390 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-7488aa57-031c-4e55-bd1f-1a86da526929 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:07:52.338239 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-7488aa57-031c-4e55-bd1f-1a86da526929 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.257651 Nov 23 13:07:52.338828 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 479/1022] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:07:52 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:07:52.662636 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-9d48cf6e-38f0-49ba-9332-9dc97a30293a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:07:52.663852 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-9d48cf6e-38f0-49ba-9332-9dc97a30293a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:07:52.671735 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-9d48cf6e-38f0-49ba-9332-9dc97a30293a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:52.672171 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-9d48cf6e-38f0-49ba-9332-9dc97a30293a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:52.672955 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-9d48cf6e-38f0-49ba-9332-9dc97a30293a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:52.673376 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-9d48cf6e-38f0-49ba-9332-9dc97a30293a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:52.737105 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-9d48cf6e-38f0-49ba-9332-9dc97a30293a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.079768 Nov 23 13:07:52.737668 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 544/1023] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:07:52 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:07:53.363895 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-fa88a81c-84a5-4804-9937-f05a487dc03d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:07:53.364896 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-fa88a81c-84a5-4804-9937-f05a487dc03d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:07:53.374525 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-fa88a81c-84a5-4804-9937-f05a487dc03d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:53.374977 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-fa88a81c-84a5-4804-9937-f05a487dc03d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:53.375747 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-fa88a81c-84a5-4804-9937-f05a487dc03d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:53.376175 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-fa88a81c-84a5-4804-9937-f05a487dc03d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:53.581035 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-fa88a81c-84a5-4804-9937-f05a487dc03d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:07:53.590586 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-fa88a81c-84a5-4804-9937-f05a487dc03d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.233047 Nov 23 13:07:53.591134 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 480/1024] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:07:53 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:07:53.752755 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-f9e16fd5-e355-4712-8b52-059fa7ffb746 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:07:53.754222 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-f9e16fd5-e355-4712-8b52-059fa7ffb746 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:07:53.763962 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f9e16fd5-e355-4712-8b52-059fa7ffb746 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:53.764462 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f9e16fd5-e355-4712-8b52-059fa7ffb746 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:53.765233 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f9e16fd5-e355-4712-8b52-059fa7ffb746 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:53.765662 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f9e16fd5-e355-4712-8b52-059fa7ffb746 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:53.828863 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-f9e16fd5-e355-4712-8b52-059fa7ffb746 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.082961 Nov 23 13:07:53.829359 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 545/1025] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:07:53 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:07:54.611492 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-150fbd83-9215-4790-bc39-0412e799adaa tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:07:54.612405 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-150fbd83-9215-4790-bc39-0412e799adaa tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:07:54.622755 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-150fbd83-9215-4790-bc39-0412e799adaa tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:54.623202 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-150fbd83-9215-4790-bc39-0412e799adaa tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:54.623973 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-150fbd83-9215-4790-bc39-0412e799adaa tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:54.624459 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-150fbd83-9215-4790-bc39-0412e799adaa tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:54.830082 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-150fbd83-9215-4790-bc39-0412e799adaa tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:07:54.838922 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-150fbd83-9215-4790-bc39-0412e799adaa tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.234019 Nov 23 13:07:54.839672 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 481/1026] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:07:54 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:07:54.840728 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-7e0c0812-4de8-4026-bfa8-d32921be12a9 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:07:54.841736 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-7e0c0812-4de8-4026-bfa8-d32921be12a9 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:07:54.849755 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-7e0c0812-4de8-4026-bfa8-d32921be12a9 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:54.850307 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-7e0c0812-4de8-4026-bfa8-d32921be12a9 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:54.851145 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-7e0c0812-4de8-4026-bfa8-d32921be12a9 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:54.851641 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-7e0c0812-4de8-4026-bfa8-d32921be12a9 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:54.917541 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-7e0c0812-4de8-4026-bfa8-d32921be12a9 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.081126 Nov 23 13:07:54.918086 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 546/1027] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:07:54 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 13:07:55.856563 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-634d6801-6064-494d-a94e-f97bdeb9b32b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:07:55.857179 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-634d6801-6064-494d-a94e-f97bdeb9b32b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:07:55.865209 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-634d6801-6064-494d-a94e-f97bdeb9b32b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:55.865652 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-634d6801-6064-494d-a94e-f97bdeb9b32b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:55.866403 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-634d6801-6064-494d-a94e-f97bdeb9b32b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:55.866832 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-634d6801-6064-494d-a94e-f97bdeb9b32b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:55.929549 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-b655a672-33c1-4066-b6d3-eaa348b31fcc tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:07:55.930533 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-b655a672-33c1-4066-b6d3-eaa348b31fcc tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:07:55.937923 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b655a672-33c1-4066-b6d3-eaa348b31fcc tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:55.938396 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b655a672-33c1-4066-b6d3-eaa348b31fcc tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:55.939176 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b655a672-33c1-4066-b6d3-eaa348b31fcc tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:55.939606 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b655a672-33c1-4066-b6d3-eaa348b31fcc tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:56.004323 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-b655a672-33c1-4066-b6d3-eaa348b31fcc tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.078561 Nov 23 13:07:56.004902 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 547/1028] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:07:55 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 13:07:56.072978 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-634d6801-6064-494d-a94e-f97bdeb9b32b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:07:56.081767 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-634d6801-6064-494d-a94e-f97bdeb9b32b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.229339 Nov 23 13:07:56.082343 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 482/1029] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:07:55 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:07:57.021592 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-352d4c0f-9401-43ac-9a56-fd8eca6af509 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:07:57.023115 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-352d4c0f-9401-43ac-9a56-fd8eca6af509 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:07:57.032774 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-352d4c0f-9401-43ac-9a56-fd8eca6af509 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:57.033215 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-352d4c0f-9401-43ac-9a56-fd8eca6af509 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:57.033976 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-352d4c0f-9401-43ac-9a56-fd8eca6af509 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:57.034400 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-352d4c0f-9401-43ac-9a56-fd8eca6af509 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:57.098743 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-352d4c0f-9401-43ac-9a56-fd8eca6af509 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.083642 Nov 23 13:07:57.099313 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 548/1030] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:07:57 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:07:57.099457 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-768994f4-ac10-4061-be56-2094fe3a6b58 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:07:57.100168 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-768994f4-ac10-4061-be56-2094fe3a6b58 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:07:57.108028 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-768994f4-ac10-4061-be56-2094fe3a6b58 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:57.108510 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-768994f4-ac10-4061-be56-2094fe3a6b58 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:57.109311 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-768994f4-ac10-4061-be56-2094fe3a6b58 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:57.109749 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-768994f4-ac10-4061-be56-2094fe3a6b58 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:57.314999 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-768994f4-ac10-4061-be56-2094fe3a6b58 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:07:57.323809 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-768994f4-ac10-4061-be56-2094fe3a6b58 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.228056 Nov 23 13:07:57.324587 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 483/1031] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:07:57 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:07:58.115080 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-664574d6-1c99-48a3-9267-3b9d7c98cedc tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:07:58.116574 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-664574d6-1c99-48a3-9267-3b9d7c98cedc tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:07:58.129417 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-664574d6-1c99-48a3-9267-3b9d7c98cedc tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:58.130039 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-664574d6-1c99-48a3-9267-3b9d7c98cedc tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:58.131297 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-664574d6-1c99-48a3-9267-3b9d7c98cedc tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:58.131990 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-664574d6-1c99-48a3-9267-3b9d7c98cedc tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:58.206079 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-664574d6-1c99-48a3-9267-3b9d7c98cedc tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.097539 Nov 23 13:07:58.206671 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 549/1032] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:07:58 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 13:07:58.353645 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-04b57903-ca23-45ac-b4af-2522f63cedca tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:07:58.354513 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-04b57903-ca23-45ac-b4af-2522f63cedca tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:07:58.366480 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-04b57903-ca23-45ac-b4af-2522f63cedca tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:58.367204 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-04b57903-ca23-45ac-b4af-2522f63cedca tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:58.368431 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-04b57903-ca23-45ac-b4af-2522f63cedca tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:58.369099 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-04b57903-ca23-45ac-b4af-2522f63cedca tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:58.577672 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-04b57903-ca23-45ac-b4af-2522f63cedca tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:07:58.586099 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-04b57903-ca23-45ac-b4af-2522f63cedca tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.238282 Nov 23 13:07:58.586781 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 484/1033] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:07:58 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:07:59.222929 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-f41f9c84-6c2f-40d2-8b55-1522eaeb4150 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:07:59.224412 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-f41f9c84-6c2f-40d2-8b55-1522eaeb4150 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:07:59.237437 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f41f9c84-6c2f-40d2-8b55-1522eaeb4150 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:59.238177 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f41f9c84-6c2f-40d2-8b55-1522eaeb4150 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:59.239426 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f41f9c84-6c2f-40d2-8b55-1522eaeb4150 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:59.240140 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f41f9c84-6c2f-40d2-8b55-1522eaeb4150 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:59.311236 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-f41f9c84-6c2f-40d2-8b55-1522eaeb4150 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.095410 Nov 23 13:07:59.311796 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 550/1034] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:07:59 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:07:59.613763 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-4435be38-f471-4b4c-abf7-d153bc4f34f8 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:07:59.614761 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-4435be38-f471-4b4c-abf7-d153bc4f34f8 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:07:59.628049 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-4435be38-f471-4b4c-abf7-d153bc4f34f8 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:59.628861 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-4435be38-f471-4b4c-abf7-d153bc4f34f8 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:59.630218 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-4435be38-f471-4b4c-abf7-d153bc4f34f8 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:07:59.630937 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-4435be38-f471-4b4c-abf7-d153bc4f34f8 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:07:59.840190 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-4435be38-f471-4b4c-abf7-d153bc4f34f8 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:07:59.849151 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-4435be38-f471-4b4c-abf7-d153bc4f34f8 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.242285 Nov 23 13:07:59.849715 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 485/1035] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:07:59 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:08:00.327132 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-93bfcdd2-e9da-4a4c-9b6a-6250c2f652f9 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:08:00.328176 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-93bfcdd2-e9da-4a4c-9b6a-6250c2f652f9 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:08:00.337333 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-93bfcdd2-e9da-4a4c-9b6a-6250c2f652f9 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:00.337859 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-93bfcdd2-e9da-4a4c-9b6a-6250c2f652f9 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:00.338768 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-93bfcdd2-e9da-4a4c-9b6a-6250c2f652f9 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:00.339276 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-93bfcdd2-e9da-4a4c-9b6a-6250c2f652f9 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:00.411440 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-93bfcdd2-e9da-4a4c-9b6a-6250c2f652f9 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.090123 Nov 23 13:08:00.412336 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 551/1036] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:08:00 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:08:00.866471 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-02eac545-cb71-4f47-81ab-bcd24b98b232 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:08:00.867161 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-02eac545-cb71-4f47-81ab-bcd24b98b232 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:08:00.876640 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-02eac545-cb71-4f47-81ab-bcd24b98b232 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:00.876640 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-02eac545-cb71-4f47-81ab-bcd24b98b232 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:00.877710 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-02eac545-cb71-4f47-81ab-bcd24b98b232 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:00.878437 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-02eac545-cb71-4f47-81ab-bcd24b98b232 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:01.104458 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-02eac545-cb71-4f47-81ab-bcd24b98b232 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:08:01.113456 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-02eac545-cb71-4f47-81ab-bcd24b98b232 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.250816 Nov 23 13:08:01.114003 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 486/1037] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:08:00 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:08:01.429889 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-cffa87c5-fea7-4683-ab37-8c93618255e0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:08:01.431194 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-cffa87c5-fea7-4683-ab37-8c93618255e0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:08:01.440487 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-cffa87c5-fea7-4683-ab37-8c93618255e0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:01.440941 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-cffa87c5-fea7-4683-ab37-8c93618255e0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:01.441738 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-cffa87c5-fea7-4683-ab37-8c93618255e0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:01.442169 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-cffa87c5-fea7-4683-ab37-8c93618255e0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:01.506969 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-cffa87c5-fea7-4683-ab37-8c93618255e0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.083796 Nov 23 13:08:01.507523 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 552/1038] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:08:01 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:08:02.135891 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-cf7c8087-2c68-4c5f-b615-34cf565c581c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:08:02.136854 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-cf7c8087-2c68-4c5f-b615-34cf565c581c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:08:02.149467 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-cf7c8087-2c68-4c5f-b615-34cf565c581c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:02.150217 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-cf7c8087-2c68-4c5f-b615-34cf565c581c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:02.151493 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-cf7c8087-2c68-4c5f-b615-34cf565c581c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:02.152221 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-cf7c8087-2c68-4c5f-b615-34cf565c581c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:02.384152 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-cf7c8087-2c68-4c5f-b615-34cf565c581c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:08:02.393179 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-cf7c8087-2c68-4c5f-b615-34cf565c581c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.263746 Nov 23 13:08:02.393670 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 487/1039] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:08:02 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:08:02.523336 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-8eac95b6-2d8f-4aee-9cad-8c21588c0800 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:08:02.524820 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-8eac95b6-2d8f-4aee-9cad-8c21588c0800 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:08:02.537545 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8eac95b6-2d8f-4aee-9cad-8c21588c0800 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:02.538294 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8eac95b6-2d8f-4aee-9cad-8c21588c0800 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:02.539554 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8eac95b6-2d8f-4aee-9cad-8c21588c0800 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:02.540230 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8eac95b6-2d8f-4aee-9cad-8c21588c0800 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:02.605223 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-8eac95b6-2d8f-4aee-9cad-8c21588c0800 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.088560 Nov 23 13:08:02.605797 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 553/1040] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:08:02 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:08:03.414785 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-75cfa670-d89f-4436-a669-5e5fc401475a tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:08:03.415630 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-75cfa670-d89f-4436-a669-5e5fc401475a tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:08:03.428555 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-75cfa670-d89f-4436-a669-5e5fc401475a tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:03.429304 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-75cfa670-d89f-4436-a669-5e5fc401475a tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:03.430624 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-75cfa670-d89f-4436-a669-5e5fc401475a tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:03.431336 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-75cfa670-d89f-4436-a669-5e5fc401475a tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:03.617331 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-daf60853-3bb7-4399-adf9-809265837631 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:08:03.618388 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-daf60853-3bb7-4399-adf9-809265837631 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:08:03.626582 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-daf60853-3bb7-4399-adf9-809265837631 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:03.627322 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-daf60853-3bb7-4399-adf9-809265837631 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:03.628442 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-daf60853-3bb7-4399-adf9-809265837631 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:03.628906 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-daf60853-3bb7-4399-adf9-809265837631 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:03.647042 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-75cfa670-d89f-4436-a669-5e5fc401475a tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:08:03.656047 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-75cfa670-d89f-4436-a669-5e5fc401475a tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.247745 Nov 23 13:08:03.656944 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 488/1041] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:08:03 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:08:03.697442 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-daf60853-3bb7-4399-adf9-809265837631 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.083830 Nov 23 13:08:03.697933 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 554/1042] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:08:03 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:08:04.677441 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-790ed00b-39af-4faf-9b82-3ba47ea56742 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:08:04.678368 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-790ed00b-39af-4faf-9b82-3ba47ea56742 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:08:04.691093 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-790ed00b-39af-4faf-9b82-3ba47ea56742 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:04.691805 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-790ed00b-39af-4faf-9b82-3ba47ea56742 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:04.693164 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-790ed00b-39af-4faf-9b82-3ba47ea56742 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:04.693877 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-790ed00b-39af-4faf-9b82-3ba47ea56742 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:04.709761 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-39b2044a-9761-4def-98e8-9856ca80a465 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:08:04.710682 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-39b2044a-9761-4def-98e8-9856ca80a465 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:08:04.718645 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-39b2044a-9761-4def-98e8-9856ca80a465 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:04.719064 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-39b2044a-9761-4def-98e8-9856ca80a465 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:04.719833 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-39b2044a-9761-4def-98e8-9856ca80a465 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:04.720261 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-39b2044a-9761-4def-98e8-9856ca80a465 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:04.784649 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-39b2044a-9761-4def-98e8-9856ca80a465 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.078781 Nov 23 13:08:04.785225 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 555/1043] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:08:04 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:08:04.901372 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-790ed00b-39af-4faf-9b82-3ba47ea56742 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:08:04.911493 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-790ed00b-39af-4faf-9b82-3ba47ea56742 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.240578 Nov 23 13:08:04.912082 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 489/1044] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:08:04 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:08:05.799525 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-ef0f8eb6-d81e-46b1-b107-11d54e0c18ac tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:08:05.800567 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-ef0f8eb6-d81e-46b1-b107-11d54e0c18ac tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:08:05.809012 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ef0f8eb6-d81e-46b1-b107-11d54e0c18ac tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:05.809496 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ef0f8eb6-d81e-46b1-b107-11d54e0c18ac tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:05.810329 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ef0f8eb6-d81e-46b1-b107-11d54e0c18ac tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:05.810796 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ef0f8eb6-d81e-46b1-b107-11d54e0c18ac tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:05.875865 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-ef0f8eb6-d81e-46b1-b107-11d54e0c18ac tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.080740 Nov 23 13:08:05.876466 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 556/1045] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:08:05 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:08:05.929281 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-1a9e1e78-f955-4af2-9b1d-334a723765d4 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:08:05.929901 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-1a9e1e78-f955-4af2-9b1d-334a723765d4 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:08:05.938563 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1a9e1e78-f955-4af2-9b1d-334a723765d4 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:05.939011 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1a9e1e78-f955-4af2-9b1d-334a723765d4 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:05.939773 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1a9e1e78-f955-4af2-9b1d-334a723765d4 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:05.940204 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1a9e1e78-f955-4af2-9b1d-334a723765d4 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:06.150700 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-1a9e1e78-f955-4af2-9b1d-334a723765d4 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:08:06.159628 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-1a9e1e78-f955-4af2-9b1d-334a723765d4 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.234489 Nov 23 13:08:06.160195 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 490/1046] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:08:05 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:08:06.891583 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-e7d73e1c-44be-4c37-837b-a8ffba9b62f2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:08:06.892525 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-e7d73e1c-44be-4c37-837b-a8ffba9b62f2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:08:06.900733 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e7d73e1c-44be-4c37-837b-a8ffba9b62f2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:06.901176 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e7d73e1c-44be-4c37-837b-a8ffba9b62f2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:06.901946 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e7d73e1c-44be-4c37-837b-a8ffba9b62f2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:06.902377 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e7d73e1c-44be-4c37-837b-a8ffba9b62f2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:06.966346 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-e7d73e1c-44be-4c37-837b-a8ffba9b62f2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.080813 Nov 23 13:08:06.966916 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 557/1047] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:08:06 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:08:07.177248 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-66d1e04f-2dc3-4c84-b15c-74b7cbe8e701 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:08:07.177854 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-66d1e04f-2dc3-4c84-b15c-74b7cbe8e701 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:08:07.185451 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-66d1e04f-2dc3-4c84-b15c-74b7cbe8e701 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:07.185892 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-66d1e04f-2dc3-4c84-b15c-74b7cbe8e701 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:07.186653 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-66d1e04f-2dc3-4c84-b15c-74b7cbe8e701 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:07.187116 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-66d1e04f-2dc3-4c84-b15c-74b7cbe8e701 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:07.396127 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-66d1e04f-2dc3-4c84-b15c-74b7cbe8e701 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:08:07.404587 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-66d1e04f-2dc3-4c84-b15c-74b7cbe8e701 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.231204 Nov 23 13:08:07.405154 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 491/1048] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:08:07 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:08:07.982688 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-90291117-80d5-477a-8722-b6f7b8b9282a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:08:07.984088 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-90291117-80d5-477a-8722-b6f7b8b9282a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:08:07.997079 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-90291117-80d5-477a-8722-b6f7b8b9282a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:07.997852 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-90291117-80d5-477a-8722-b6f7b8b9282a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:07.999111 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-90291117-80d5-477a-8722-b6f7b8b9282a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:07.999979 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-90291117-80d5-477a-8722-b6f7b8b9282a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:08.068928 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-90291117-80d5-477a-8722-b6f7b8b9282a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.092658 Nov 23 13:08:08.069324 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 558/1049] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:08:07 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:08:08.429793 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-7b0c2d14-45ff-4cbc-a33f-6d44093b06cd tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:08:08.430586 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-7b0c2d14-45ff-4cbc-a33f-6d44093b06cd tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:08:08.440304 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7b0c2d14-45ff-4cbc-a33f-6d44093b06cd tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:08.440860 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7b0c2d14-45ff-4cbc-a33f-6d44093b06cd tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:08.441819 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7b0c2d14-45ff-4cbc-a33f-6d44093b06cd tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:08.442377 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7b0c2d14-45ff-4cbc-a33f-6d44093b06cd tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:08.648000 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-7b0c2d14-45ff-4cbc-a33f-6d44093b06cd tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:08:08.656483 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-7b0c2d14-45ff-4cbc-a33f-6d44093b06cd tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.236877 Nov 23 13:08:08.657056 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 492/1050] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:08:08 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:08:09.085746 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-996bb963-0f93-44bf-9f51-b58f87cb3752 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:08:09.087267 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-996bb963-0f93-44bf-9f51-b58f87cb3752 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:08:09.100498 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-996bb963-0f93-44bf-9f51-b58f87cb3752 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:09.101243 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-996bb963-0f93-44bf-9f51-b58f87cb3752 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:09.102498 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-996bb963-0f93-44bf-9f51-b58f87cb3752 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:09.103203 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-996bb963-0f93-44bf-9f51-b58f87cb3752 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:09.170008 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-996bb963-0f93-44bf-9f51-b58f87cb3752 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.090986 Nov 23 13:08:09.170571 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 559/1051] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:08:09 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:08:09.678132 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-9727fb6a-0d61-4669-af6f-4d4e6d41e916 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:08:09.679221 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-9727fb6a-0d61-4669-af6f-4d4e6d41e916 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:08:09.690109 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-9727fb6a-0d61-4669-af6f-4d4e6d41e916 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:09.690570 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-9727fb6a-0d61-4669-af6f-4d4e6d41e916 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:09.691333 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-9727fb6a-0d61-4669-af6f-4d4e6d41e916 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:09.691761 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-9727fb6a-0d61-4669-af6f-4d4e6d41e916 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:10.063197 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-9727fb6a-0d61-4669-af6f-4d4e6d41e916 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:08:10.072654 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-9727fb6a-0d61-4669-af6f-4d4e6d41e916 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.401095 Nov 23 13:08:10.073221 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 493/1052] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:08:09 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:08:10.184905 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-d19d7fd9-0936-4160-83c4-eddc2cfed908 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:08:10.185923 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-d19d7fd9-0936-4160-83c4-eddc2cfed908 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:08:10.194415 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d19d7fd9-0936-4160-83c4-eddc2cfed908 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:10.194859 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d19d7fd9-0936-4160-83c4-eddc2cfed908 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:10.195613 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d19d7fd9-0936-4160-83c4-eddc2cfed908 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:10.196051 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d19d7fd9-0936-4160-83c4-eddc2cfed908 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:10.263773 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-d19d7fd9-0936-4160-83c4-eddc2cfed908 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.084681 Nov 23 13:08:10.264549 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 560/1053] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:08:10 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:08:11.092423 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-ad7d81ab-ca40-47d2-a245-76327370b74c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:08:11.093078 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-ad7d81ab-ca40-47d2-a245-76327370b74c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:08:11.101441 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ad7d81ab-ca40-47d2-a245-76327370b74c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:11.101890 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ad7d81ab-ca40-47d2-a245-76327370b74c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:11.102671 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ad7d81ab-ca40-47d2-a245-76327370b74c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:11.103102 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ad7d81ab-ca40-47d2-a245-76327370b74c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:11.275268 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-0616aeeb-64c7-486b-95c0-8b7660f39153 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:08:11.276213 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-0616aeeb-64c7-486b-95c0-8b7660f39153 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:08:11.284127 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0616aeeb-64c7-486b-95c0-8b7660f39153 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:11.284602 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0616aeeb-64c7-486b-95c0-8b7660f39153 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:11.285368 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0616aeeb-64c7-486b-95c0-8b7660f39153 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:11.285794 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0616aeeb-64c7-486b-95c0-8b7660f39153 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:11.305789 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-ad7d81ab-ca40-47d2-a245-76327370b74c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:08:11.314450 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-ad7d81ab-ca40-47d2-a245-76327370b74c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.226300 Nov 23 13:08:11.315013 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 494/1054] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:08:11 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:08:11.350448 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-0616aeeb-64c7-486b-95c0-8b7660f39153 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.079186 Nov 23 13:08:11.351022 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 561/1055] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:08:11 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:08:12.335886 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-65d63888-86c1-4cd7-b6c1-f105e51b29f9 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:08:12.336914 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-65d63888-86c1-4cd7-b6c1-f105e51b29f9 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:08:12.346988 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-65d63888-86c1-4cd7-b6c1-f105e51b29f9 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:12.347424 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-65d63888-86c1-4cd7-b6c1-f105e51b29f9 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:12.348214 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-65d63888-86c1-4cd7-b6c1-f105e51b29f9 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:12.348678 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-65d63888-86c1-4cd7-b6c1-f105e51b29f9 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:12.362630 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-5ac8a518-20cd-45e8-8d83-3d9f8946e3c2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:08:12.363589 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-5ac8a518-20cd-45e8-8d83-3d9f8946e3c2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:08:12.371665 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5ac8a518-20cd-45e8-8d83-3d9f8946e3c2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:12.372107 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5ac8a518-20cd-45e8-8d83-3d9f8946e3c2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:12.372906 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5ac8a518-20cd-45e8-8d83-3d9f8946e3c2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:12.373339 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5ac8a518-20cd-45e8-8d83-3d9f8946e3c2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:12.441827 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-5ac8a518-20cd-45e8-8d83-3d9f8946e3c2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.083174 Nov 23 13:08:12.442639 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 562/1056] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:08:12 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 13:08:12.552061 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-65d63888-86c1-4cd7-b6c1-f105e51b29f9 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:08:12.560594 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-65d63888-86c1-4cd7-b6c1-f105e51b29f9 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.230787 Nov 23 13:08:12.561138 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 495/1057] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:08:12 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:08:13.458606 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-1d94b0e3-2d6b-49bb-ba98-ad48709dacf8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:08:13.460001 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-1d94b0e3-2d6b-49bb-ba98-ad48709dacf8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:08:13.472389 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-1d94b0e3-2d6b-49bb-ba98-ad48709dacf8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:13.473133 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-1d94b0e3-2d6b-49bb-ba98-ad48709dacf8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:13.474396 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-1d94b0e3-2d6b-49bb-ba98-ad48709dacf8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:13.475118 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-1d94b0e3-2d6b-49bb-ba98-ad48709dacf8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:13.543920 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-1d94b0e3-2d6b-49bb-ba98-ad48709dacf8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.092170 Nov 23 13:08:13.544510 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 563/1058] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:08:13 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:08:13.582111 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-f93800f5-6d73-4ceb-ad2a-1a87b494302c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:08:13.582745 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-f93800f5-6d73-4ceb-ad2a-1a87b494302c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:08:13.590724 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f93800f5-6d73-4ceb-ad2a-1a87b494302c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:13.591171 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f93800f5-6d73-4ceb-ad2a-1a87b494302c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:13.591938 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f93800f5-6d73-4ceb-ad2a-1a87b494302c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:13.592422 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f93800f5-6d73-4ceb-ad2a-1a87b494302c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:13.801099 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-f93800f5-6d73-4ceb-ad2a-1a87b494302c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:08:13.809765 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-f93800f5-6d73-4ceb-ad2a-1a87b494302c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.231503 Nov 23 13:08:13.810324 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 496/1059] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:08:13 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:08:14.561705 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-28d525ba-5218-4a92-8058-7d0a7e22a472 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:08:14.563159 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-28d525ba-5218-4a92-8058-7d0a7e22a472 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:08:14.571357 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-28d525ba-5218-4a92-8058-7d0a7e22a472 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:14.571794 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-28d525ba-5218-4a92-8058-7d0a7e22a472 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:14.572583 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-28d525ba-5218-4a92-8058-7d0a7e22a472 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:14.573004 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-28d525ba-5218-4a92-8058-7d0a7e22a472 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:14.637171 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-28d525ba-5218-4a92-8058-7d0a7e22a472 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.082264 Nov 23 13:08:14.637731 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 564/1060] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:08:14 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:08:14.827374 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-e5bdbfd9-3f08-40c2-a09f-4f0d7e441234 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:08:14.827957 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-e5bdbfd9-3f08-40c2-a09f-4f0d7e441234 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:08:14.835895 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e5bdbfd9-3f08-40c2-a09f-4f0d7e441234 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:14.836373 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e5bdbfd9-3f08-40c2-a09f-4f0d7e441234 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:14.837138 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e5bdbfd9-3f08-40c2-a09f-4f0d7e441234 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:14.837572 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e5bdbfd9-3f08-40c2-a09f-4f0d7e441234 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:15.103766 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-e5bdbfd9-3f08-40c2-a09f-4f0d7e441234 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:08:15.112922 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-e5bdbfd9-3f08-40c2-a09f-4f0d7e441234 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.289623 Nov 23 13:08:15.113481 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 497/1061] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:08:14 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:08:15.265947 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-352bf8f7-6d43-439d-aa3e-cab455419338 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-808218229"}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:08:15.267041 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-352bf8f7-6d43-439d-aa3e-cab455419338 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:08:15.275315 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-352bf8f7-6d43-439d-aa3e-cab455419338 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:15.275757 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-352bf8f7-6d43-439d-aa3e-cab455419338 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:15.276556 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-352bf8f7-6d43-439d-aa3e-cab455419338 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:15.276979 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-352bf8f7-6d43-439d-aa3e-cab455419338 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:15.478825 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.network.security_group_api [None req-352bf8f7-6d43-439d-aa3e-cab455419338 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Removing security group 92c6093d-188a-4e7e-92b1-c3497d5f8bb1 from port 2f280c1a-d79b-4581-bd2b-add5ec70ac56 Nov 23 13:08:15.651363 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-8204c5e3-7e2b-4557-8c21-abb0f850dcef tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:08:15.652303 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-8204c5e3-7e2b-4557-8c21-abb0f850dcef tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:08:15.659984 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8204c5e3-7e2b-4557-8c21-abb0f850dcef tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:15.660597 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8204c5e3-7e2b-4557-8c21-abb0f850dcef tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:15.661494 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8204c5e3-7e2b-4557-8c21-abb0f850dcef tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:15.661932 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8204c5e3-7e2b-4557-8c21-abb0f850dcef tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:15.726562 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-8204c5e3-7e2b-4557-8c21-abb0f850dcef tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.079269 Nov 23 13:08:15.727427 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 498/1062] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:08:15 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:08:15.969403 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-352bf8f7-6d43-439d-aa3e-cab455419338 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "POST /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76/action" status: 202 len: 0 microversion: 2.1 time: 0.709569 Nov 23 13:08:15.971051 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 565/1063] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:08:15 2021] POST /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76/action => generated 0 bytes in 713 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:08:15.977637 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [req-f1107542-ab76-47de-b02c-3f76cfae4129 req-754b41fd-c527-405a-b4d4-a0ddf990528c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74e06412-022d-4ece-920d-1cba08639d76", "tag": "2f280c1a-d79b-4581-bd2b-add5ec70ac56"}]} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:08:15.979775 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 13:08:15.979775 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: warnings.warn(msg) Nov 23 13:08:15.988925 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [req-f1107542-ab76-47de-b02c-3f76cfae4129 req-754b41fd-c527-405a-b4d4-a0ddf990528c service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:15.989731 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [req-f1107542-ab76-47de-b02c-3f76cfae4129 req-754b41fd-c527-405a-b4d4-a0ddf990528c service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:16.013851 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.compute.server_external_events [req-f1107542-ab76-47de-b02c-3f76cfae4129 req-754b41fd-c527-405a-b4d4-a0ddf990528c service nova] Creating event network-changed:2f280c1a-d79b-4581-bd2b-add5ec70ac56 for instance 74e06412-022d-4ece-920d-1cba08639d76 on hv-cinder-81888 Nov 23 13:08:16.020086 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [req-f1107542-ab76-47de-b02c-3f76cfae4129 req-754b41fd-c527-405a-b4d4-a0ddf990528c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046618 Nov 23 13:08:16.021368 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 499/1064] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Nov 23 13:08:15 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 13:08:16.130693 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-66aa6ac5-4c5a-4271-a854-8503b391aecb tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:08:16.131649 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-66aa6ac5-4c5a-4271-a854-8503b391aecb tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:08:16.143778 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-66aa6ac5-4c5a-4271-a854-8503b391aecb tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:16.144217 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-66aa6ac5-4c5a-4271-a854-8503b391aecb tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:16.145013 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-66aa6ac5-4c5a-4271-a854-8503b391aecb tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:16.145435 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-66aa6ac5-4c5a-4271-a854-8503b391aecb tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:16.371359 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-66aa6ac5-4c5a-4271-a854-8503b391aecb tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:08:16.381855 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-66aa6ac5-4c5a-4271-a854-8503b391aecb tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.254846 Nov 23 13:08:16.392924 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 566/1065] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:08:16 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 13:08:16.739381 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-fa960945-c8e4-445b-925a-b7844f244cac tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:08:16.740811 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-fa960945-c8e4-445b-925a-b7844f244cac tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:08:16.749707 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-fa960945-c8e4-445b-925a-b7844f244cac tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:16.750448 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-fa960945-c8e4-445b-925a-b7844f244cac tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:16.751462 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-fa960945-c8e4-445b-925a-b7844f244cac tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:16.751998 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-fa960945-c8e4-445b-925a-b7844f244cac tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:16.825214 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-fa960945-c8e4-445b-925a-b7844f244cac tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.090175 Nov 23 13:08:16.825716 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 500/1066] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:08:16 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:08:17.399334 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-0d9c360e-fa8a-42c3-b0a7-c522ec76016c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:08:17.400617 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-0d9c360e-fa8a-42c3-b0a7-c522ec76016c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:08:17.408659 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0d9c360e-fa8a-42c3-b0a7-c522ec76016c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:17.409130 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0d9c360e-fa8a-42c3-b0a7-c522ec76016c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:17.409894 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0d9c360e-fa8a-42c3-b0a7-c522ec76016c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:17.410353 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0d9c360e-fa8a-42c3-b0a7-c522ec76016c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:17.818036 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-0d9c360e-fa8a-42c3-b0a7-c522ec76016c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:08:17.827695 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-0d9c360e-fa8a-42c3-b0a7-c522ec76016c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.432045 Nov 23 13:08:17.828699 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 567/1067] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:08:17 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:08:17.837278 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-102f6248-c717-4648-99d2-9acc7392a170 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:08:17.838764 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-102f6248-c717-4648-99d2-9acc7392a170 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:08:17.846457 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-102f6248-c717-4648-99d2-9acc7392a170 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:17.846895 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-102f6248-c717-4648-99d2-9acc7392a170 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:17.847658 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-102f6248-c717-4648-99d2-9acc7392a170 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:17.848057 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-102f6248-c717-4648-99d2-9acc7392a170 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:17.913221 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-102f6248-c717-4648-99d2-9acc7392a170 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.079773 Nov 23 13:08:17.913809 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 501/1068] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:08:17 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:08:18.105931 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-10f2b9a0-001c-4815-9cd9-72109c66430b tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:08:18.106437 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-10f2b9a0-001c-4815-9cd9-72109c66430b tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:08:18.109336 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [req-42576ed4-1522-481e-b101-2f0d174e0121 req-38a187cc-bd27-411c-bfe1-fe3addb99cdd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74e06412-022d-4ece-920d-1cba08639d76", "tag": "2f280c1a-d79b-4581-bd2b-add5ec70ac56"}]} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:08:18.110989 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 13:08:18.110989 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: warnings.warn(msg) Nov 23 13:08:18.114777 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-10f2b9a0-001c-4815-9cd9-72109c66430b tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:18.115232 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-10f2b9a0-001c-4815-9cd9-72109c66430b tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:18.115991 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-10f2b9a0-001c-4815-9cd9-72109c66430b tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:18.116479 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-10f2b9a0-001c-4815-9cd9-72109c66430b tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:18.119513 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [req-42576ed4-1522-481e-b101-2f0d174e0121 req-38a187cc-bd27-411c-bfe1-fe3addb99cdd service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:18.119973 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [req-42576ed4-1522-481e-b101-2f0d174e0121 req-38a187cc-bd27-411c-bfe1-fe3addb99cdd service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:18.137507 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.compute.server_external_events [req-42576ed4-1522-481e-b101-2f0d174e0121 req-38a187cc-bd27-411c-bfe1-fe3addb99cdd service nova] Creating event network-changed:2f280c1a-d79b-4581-bd2b-add5ec70ac56 for instance 74e06412-022d-4ece-920d-1cba08639d76 on hv-cinder-81888 Nov 23 13:08:18.142945 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [req-42576ed4-1522-481e-b101-2f0d174e0121 req-38a187cc-bd27-411c-bfe1-fe3addb99cdd service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037281 Nov 23 13:08:18.143885 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 502/1069] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Nov 23 13:08:18 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 13:08:18.845292 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-e96fdd83-e6f3-4214-b97f-83eddb39b39d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:08:18.846717 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-e96fdd83-e6f3-4214-b97f-83eddb39b39d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:08:18.854754 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e96fdd83-e6f3-4214-b97f-83eddb39b39d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:18.855418 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e96fdd83-e6f3-4214-b97f-83eddb39b39d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:18.856407 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e96fdd83-e6f3-4214-b97f-83eddb39b39d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:18.856988 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e96fdd83-e6f3-4214-b97f-83eddb39b39d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:19.116051 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-e96fdd83-e6f3-4214-b97f-83eddb39b39d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:08:19.124661 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-e96fdd83-e6f3-4214-b97f-83eddb39b39d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.283595 Nov 23 13:08:19.125601 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 503/1070] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:08:18 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 13:08:19.129877 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-b9845e9f-34e9-4d5e-bc29-59b0cc583124 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:08:19.131009 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-b9845e9f-34e9-4d5e-bc29-59b0cc583124 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:08:19.138172 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b9845e9f-34e9-4d5e-bc29-59b0cc583124 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:19.138623 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b9845e9f-34e9-4d5e-bc29-59b0cc583124 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:19.139407 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b9845e9f-34e9-4d5e-bc29-59b0cc583124 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:19.140160 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b9845e9f-34e9-4d5e-bc29-59b0cc583124 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:19.206708 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-b9845e9f-34e9-4d5e-bc29-59b0cc583124 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.080342 Nov 23 13:08:19.207328 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 504/1071] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:08:19 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:08:20.145493 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-0af9a466-88cf-4bf6-9597-9da1e6691cfd tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:08:20.146392 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-0af9a466-88cf-4bf6-9597-9da1e6691cfd tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:08:20.155775 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0af9a466-88cf-4bf6-9597-9da1e6691cfd tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:20.156384 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0af9a466-88cf-4bf6-9597-9da1e6691cfd tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:20.157341 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0af9a466-88cf-4bf6-9597-9da1e6691cfd tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:20.157881 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0af9a466-88cf-4bf6-9597-9da1e6691cfd tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:20.375598 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-0af9a466-88cf-4bf6-9597-9da1e6691cfd tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:08:20.385159 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-0af9a466-88cf-4bf6-9597-9da1e6691cfd tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.245571 Nov 23 13:08:20.385718 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 505/1072] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:08:20 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:08:20.390040 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-8a96be71-d91e-4fa7-83c1-eb68c6a5d8fc tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:08:20.390995 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-8a96be71-d91e-4fa7-83c1-eb68c6a5d8fc tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:08:20.399086 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8a96be71-d91e-4fa7-83c1-eb68c6a5d8fc tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:20.399465 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8a96be71-d91e-4fa7-83c1-eb68c6a5d8fc tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:20.400226 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8a96be71-d91e-4fa7-83c1-eb68c6a5d8fc tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:20.400688 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8a96be71-d91e-4fa7-83c1-eb68c6a5d8fc tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:20.466178 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-8a96be71-d91e-4fa7-83c1-eb68c6a5d8fc tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.077642 Nov 23 13:08:20.469707 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 506/1073] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:08:20 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:08:21.404991 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-5d64bd17-8cf1-4254-9bc1-cc428d312898 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:08:21.405787 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-5d64bd17-8cf1-4254-9bc1-cc428d312898 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:08:21.414152 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5d64bd17-8cf1-4254-9bc1-cc428d312898 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:21.414607 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5d64bd17-8cf1-4254-9bc1-cc428d312898 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:21.415383 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5d64bd17-8cf1-4254-9bc1-cc428d312898 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:21.415810 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5d64bd17-8cf1-4254-9bc1-cc428d312898 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:21.618460 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-5d64bd17-8cf1-4254-9bc1-cc428d312898 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:08:21.631831 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-5d64bd17-8cf1-4254-9bc1-cc428d312898 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.231452 Nov 23 13:08:21.632624 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 507/1074] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:08:21 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:08:21.637161 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-b51bc4ef-04e5-4a1f-8270-19a964febd01 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:08:21.638042 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-b51bc4ef-04e5-4a1f-8270-19a964febd01 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:08:21.645561 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b51bc4ef-04e5-4a1f-8270-19a964febd01 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:21.646028 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b51bc4ef-04e5-4a1f-8270-19a964febd01 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:21.646792 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b51bc4ef-04e5-4a1f-8270-19a964febd01 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:21.647217 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b51bc4ef-04e5-4a1f-8270-19a964febd01 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:21.723443 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-b51bc4ef-04e5-4a1f-8270-19a964febd01 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.089696 Nov 23 13:08:21.723922 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 508/1075] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:08:21 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:08:22.653447 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-317e0ad8-c2b1-4d26-8b7b-f1adcc548182 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:08:22.654594 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-317e0ad8-c2b1-4d26-8b7b-f1adcc548182 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:08:22.667125 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-317e0ad8-c2b1-4d26-8b7b-f1adcc548182 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:22.667875 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-317e0ad8-c2b1-4d26-8b7b-f1adcc548182 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:22.669219 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-317e0ad8-c2b1-4d26-8b7b-f1adcc548182 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:22.669932 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-317e0ad8-c2b1-4d26-8b7b-f1adcc548182 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:22.879356 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-317e0ad8-c2b1-4d26-8b7b-f1adcc548182 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:08:22.887770 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-317e0ad8-c2b1-4d26-8b7b-f1adcc548182 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.240735 Nov 23 13:08:22.888315 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 509/1076] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:08:22 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:08:22.892706 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-13f8be67-3d0a-47aa-b4b2-0c3b40e8204d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:08:22.893720 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-13f8be67-3d0a-47aa-b4b2-0c3b40e8204d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:08:22.900612 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-13f8be67-3d0a-47aa-b4b2-0c3b40e8204d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:22.901060 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-13f8be67-3d0a-47aa-b4b2-0c3b40e8204d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:22.901905 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-13f8be67-3d0a-47aa-b4b2-0c3b40e8204d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:22.902336 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-13f8be67-3d0a-47aa-b4b2-0c3b40e8204d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:22.965908 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-13f8be67-3d0a-47aa-b4b2-0c3b40e8204d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.076336 Nov 23 13:08:22.966386 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 510/1077] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:08:22 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:08:23.905071 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-daacf6fa-49f4-4d1d-9086-d817c101df8b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:08:23.905723 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-daacf6fa-49f4-4d1d-9086-d817c101df8b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:08:23.913406 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-daacf6fa-49f4-4d1d-9086-d817c101df8b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:23.913851 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-daacf6fa-49f4-4d1d-9086-d817c101df8b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:23.914615 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-daacf6fa-49f4-4d1d-9086-d817c101df8b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:23.915047 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-daacf6fa-49f4-4d1d-9086-d817c101df8b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:24.134545 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-daacf6fa-49f4-4d1d-9086-d817c101df8b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:08:24.146846 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-daacf6fa-49f4-4d1d-9086-d817c101df8b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.245591 Nov 23 13:08:24.147406 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 511/1078] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:08:23 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 13:08:24.151756 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-b8f704d1-bd5f-403f-9176-266ba13f774b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:08:24.152665 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-b8f704d1-bd5f-403f-9176-266ba13f774b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:08:24.159926 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b8f704d1-bd5f-403f-9176-266ba13f774b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:24.160399 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b8f704d1-bd5f-403f-9176-266ba13f774b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:24.161175 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b8f704d1-bd5f-403f-9176-266ba13f774b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:24.161605 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b8f704d1-bd5f-403f-9176-266ba13f774b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:24.234819 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-b8f704d1-bd5f-403f-9176-266ba13f774b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.086053 Nov 23 13:08:24.235712 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 512/1079] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:08:24 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:08:25.164869 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-9039a5b3-fb3e-4ca6-9cbf-9b50d4179afb tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:08:25.165445 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-9039a5b3-fb3e-4ca6-9cbf-9b50d4179afb tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:08:25.173160 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-9039a5b3-fb3e-4ca6-9cbf-9b50d4179afb tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:25.173602 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-9039a5b3-fb3e-4ca6-9cbf-9b50d4179afb tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:25.174365 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-9039a5b3-fb3e-4ca6-9cbf-9b50d4179afb tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:25.174794 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-9039a5b3-fb3e-4ca6-9cbf-9b50d4179afb tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:25.387401 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-9039a5b3-fb3e-4ca6-9cbf-9b50d4179afb tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:08:25.399326 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-9039a5b3-fb3e-4ca6-9cbf-9b50d4179afb tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.238077 Nov 23 13:08:25.399814 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 513/1080] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:08:25 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:08:25.404424 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-36f68ab3-251d-4da6-a496-815985cd5fc1 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:08:25.405447 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-36f68ab3-251d-4da6-a496-815985cd5fc1 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:08:25.412629 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-36f68ab3-251d-4da6-a496-815985cd5fc1 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:25.413077 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-36f68ab3-251d-4da6-a496-815985cd5fc1 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:25.414136 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-36f68ab3-251d-4da6-a496-815985cd5fc1 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:25.414595 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-36f68ab3-251d-4da6-a496-815985cd5fc1 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:25.479391 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-36f68ab3-251d-4da6-a496-815985cd5fc1 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.078456 Nov 23 13:08:25.479951 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 514/1081] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:08:25 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:08:26.416735 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-fe7f6d71-19e8-46be-ad16-bce3a2be3c78 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:08:26.417469 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-fe7f6d71-19e8-46be-ad16-bce3a2be3c78 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:08:26.425529 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-fe7f6d71-19e8-46be-ad16-bce3a2be3c78 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:26.426003 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-fe7f6d71-19e8-46be-ad16-bce3a2be3c78 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:26.426769 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-fe7f6d71-19e8-46be-ad16-bce3a2be3c78 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:26.427190 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-fe7f6d71-19e8-46be-ad16-bce3a2be3c78 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:26.638474 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-fe7f6d71-19e8-46be-ad16-bce3a2be3c78 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:08:26.651412 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-fe7f6d71-19e8-46be-ad16-bce3a2be3c78 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.238256 Nov 23 13:08:26.652189 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 515/1082] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:08:26 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:08:26.656569 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-928dc0de-a998-4e4a-ba7c-57f3db7790c8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:08:26.657465 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-928dc0de-a998-4e4a-ba7c-57f3db7790c8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:08:26.665463 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-928dc0de-a998-4e4a-ba7c-57f3db7790c8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:26.665934 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-928dc0de-a998-4e4a-ba7c-57f3db7790c8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:26.666711 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-928dc0de-a998-4e4a-ba7c-57f3db7790c8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:26.667213 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-928dc0de-a998-4e4a-ba7c-57f3db7790c8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:26.737275 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-928dc0de-a998-4e4a-ba7c-57f3db7790c8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.083973 Nov 23 13:08:26.737823 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 516/1083] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:08:26 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:08:27.669237 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-b33cc25e-1d25-4e17-aeee-078cedd9170a tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:08:27.670003 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-b33cc25e-1d25-4e17-aeee-078cedd9170a tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:08:27.677280 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b33cc25e-1d25-4e17-aeee-078cedd9170a tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:27.677723 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b33cc25e-1d25-4e17-aeee-078cedd9170a tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:27.678479 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b33cc25e-1d25-4e17-aeee-078cedd9170a tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:27.678904 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b33cc25e-1d25-4e17-aeee-078cedd9170a tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:27.978024 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-b33cc25e-1d25-4e17-aeee-078cedd9170a tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:08:27.986921 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-b33cc25e-1d25-4e17-aeee-078cedd9170a tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.321469 Nov 23 13:08:27.987485 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 517/1084] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:08:27 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 13:08:28.000873 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-5a8f1da9-eec8-4aa9-855b-c2308e584ebc tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:08:28.001833 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-5a8f1da9-eec8-4aa9-855b-c2308e584ebc tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:08:28.009395 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5a8f1da9-eec8-4aa9-855b-c2308e584ebc tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:28.009863 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5a8f1da9-eec8-4aa9-855b-c2308e584ebc tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:28.010641 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5a8f1da9-eec8-4aa9-855b-c2308e584ebc tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:28.011063 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5a8f1da9-eec8-4aa9-855b-c2308e584ebc tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:28.075334 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-5a8f1da9-eec8-4aa9-855b-c2308e584ebc tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.086789 Nov 23 13:08:28.076134 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 518/1085] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:08:27 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:08:29.005538 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-29a8dc39-211d-4c08-bfc7-8ad923975278 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:08:29.006372 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-29a8dc39-211d-4c08-bfc7-8ad923975278 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:08:29.014424 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-29a8dc39-211d-4c08-bfc7-8ad923975278 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:29.014867 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-29a8dc39-211d-4c08-bfc7-8ad923975278 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:29.015624 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-29a8dc39-211d-4c08-bfc7-8ad923975278 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:29.016050 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-29a8dc39-211d-4c08-bfc7-8ad923975278 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:29.223742 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-29a8dc39-211d-4c08-bfc7-8ad923975278 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:08:29.236807 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-29a8dc39-211d-4c08-bfc7-8ad923975278 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.235412 Nov 23 13:08:29.237358 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 519/1086] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:08:28 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:08:29.241731 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-785c0c1c-6402-47da-9838-b9932c60a56b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:08:29.242733 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-785c0c1c-6402-47da-9838-b9932c60a56b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:08:29.250164 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-785c0c1c-6402-47da-9838-b9932c60a56b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:29.250606 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-785c0c1c-6402-47da-9838-b9932c60a56b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:29.251363 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-785c0c1c-6402-47da-9838-b9932c60a56b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:29.251786 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-785c0c1c-6402-47da-9838-b9932c60a56b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:29.315117 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-785c0c1c-6402-47da-9838-b9932c60a56b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.076750 Nov 23 13:08:29.315660 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 520/1087] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:08:29 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:08:30.257658 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-a936a1a8-a13e-4a40-b1ad-f37276ece3be tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:08:30.258333 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-a936a1a8-a13e-4a40-b1ad-f37276ece3be tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:08:30.266632 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a936a1a8-a13e-4a40-b1ad-f37276ece3be tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:30.267081 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a936a1a8-a13e-4a40-b1ad-f37276ece3be tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:30.267895 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a936a1a8-a13e-4a40-b1ad-f37276ece3be tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:30.268363 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a936a1a8-a13e-4a40-b1ad-f37276ece3be tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:30.555788 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-a936a1a8-a13e-4a40-b1ad-f37276ece3be tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:08:30.567878 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-a936a1a8-a13e-4a40-b1ad-f37276ece3be tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.316092 Nov 23 13:08:30.568668 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 521/1088] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:08:30 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:08:30.573159 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-5e3fb655-da4c-4fe9-86a3-696440490865 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:08:30.574065 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-5e3fb655-da4c-4fe9-86a3-696440490865 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:08:30.581266 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5e3fb655-da4c-4fe9-86a3-696440490865 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:30.581713 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5e3fb655-da4c-4fe9-86a3-696440490865 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:30.582471 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5e3fb655-da4c-4fe9-86a3-696440490865 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:30.582901 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5e3fb655-da4c-4fe9-86a3-696440490865 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:30.651827 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-5e3fb655-da4c-4fe9-86a3-696440490865 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.082099 Nov 23 13:08:30.652403 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 522/1089] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:08:30 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:08:31.589580 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-e9ad45c8-b9be-40be-95ee-7c8c8e2e3c1e tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:08:31.590710 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-e9ad45c8-b9be-40be-95ee-7c8c8e2e3c1e tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:08:31.598357 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e9ad45c8-b9be-40be-95ee-7c8c8e2e3c1e tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:31.598807 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e9ad45c8-b9be-40be-95ee-7c8c8e2e3c1e tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:31.599580 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e9ad45c8-b9be-40be-95ee-7c8c8e2e3c1e tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:31.600011 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e9ad45c8-b9be-40be-95ee-7c8c8e2e3c1e tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:31.805492 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-e9ad45c8-b9be-40be-95ee-7c8c8e2e3c1e tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:08:31.814428 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-e9ad45c8-b9be-40be-95ee-7c8c8e2e3c1e tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.231324 Nov 23 13:08:31.814992 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 523/1090] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:08:31 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:08:31.819427 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-ffe70fea-b2ac-44e3-b4b5-e80d9758ec47 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:08:31.820518 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-ffe70fea-b2ac-44e3-b4b5-e80d9758ec47 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:08:31.827788 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ffe70fea-b2ac-44e3-b4b5-e80d9758ec47 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:31.828260 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ffe70fea-b2ac-44e3-b4b5-e80d9758ec47 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:31.829140 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ffe70fea-b2ac-44e3-b4b5-e80d9758ec47 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:31.829572 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ffe70fea-b2ac-44e3-b4b5-e80d9758ec47 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:31.893495 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-ffe70fea-b2ac-44e3-b4b5-e80d9758ec47 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.077436 Nov 23 13:08:31.894085 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 524/1091] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:08:31 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:08:32.832203 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-d9b18d77-cfad-439e-a10e-7b36294a9cfa tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:08:32.832924 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-d9b18d77-cfad-439e-a10e-7b36294a9cfa tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:08:32.840401 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d9b18d77-cfad-439e-a10e-7b36294a9cfa tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:32.840851 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d9b18d77-cfad-439e-a10e-7b36294a9cfa tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:32.841668 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d9b18d77-cfad-439e-a10e-7b36294a9cfa tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:32.842087 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d9b18d77-cfad-439e-a10e-7b36294a9cfa tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:33.053258 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-d9b18d77-cfad-439e-a10e-7b36294a9cfa tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:08:33.064866 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-d9b18d77-cfad-439e-a10e-7b36294a9cfa tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.236583 Nov 23 13:08:33.065445 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 525/1092] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:08:32 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:08:33.069912 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-7317be99-50ed-4b3d-8ae3-b0ab059a961a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:08:33.070804 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-7317be99-50ed-4b3d-8ae3-b0ab059a961a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:08:33.078026 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7317be99-50ed-4b3d-8ae3-b0ab059a961a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:33.078471 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7317be99-50ed-4b3d-8ae3-b0ab059a961a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:33.079228 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7317be99-50ed-4b3d-8ae3-b0ab059a961a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:33.079660 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7317be99-50ed-4b3d-8ae3-b0ab059a961a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:33.143315 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-7317be99-50ed-4b3d-8ae3-b0ab059a961a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.076762 Nov 23 13:08:33.143814 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 526/1093] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:08:33 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:08:34.083571 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-a2db4890-393c-41a0-b7c2-8d0b2c5048d9 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:08:34.084541 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-a2db4890-393c-41a0-b7c2-8d0b2c5048d9 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:08:34.095414 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a2db4890-393c-41a0-b7c2-8d0b2c5048d9 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:34.096059 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a2db4890-393c-41a0-b7c2-8d0b2c5048d9 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:34.097260 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a2db4890-393c-41a0-b7c2-8d0b2c5048d9 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:34.097883 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a2db4890-393c-41a0-b7c2-8d0b2c5048d9 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:34.304213 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-a2db4890-393c-41a0-b7c2-8d0b2c5048d9 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:08:34.315569 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-a2db4890-393c-41a0-b7c2-8d0b2c5048d9 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.237501 Nov 23 13:08:34.316182 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 527/1094] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:08:34 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:08:34.320638 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-73c0b26b-54f1-4832-ac35-23e91a4d6c96 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:08:34.321561 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-73c0b26b-54f1-4832-ac35-23e91a4d6c96 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:08:34.329021 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-73c0b26b-54f1-4832-ac35-23e91a4d6c96 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:34.329480 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-73c0b26b-54f1-4832-ac35-23e91a4d6c96 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:34.330228 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-73c0b26b-54f1-4832-ac35-23e91a4d6c96 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:34.330676 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-73c0b26b-54f1-4832-ac35-23e91a4d6c96 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:34.406363 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-73c0b26b-54f1-4832-ac35-23e91a4d6c96 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.089092 Nov 23 13:08:34.406890 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 528/1095] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:08:34 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:08:35.336739 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-f01db6c0-0252-4d7f-8cdd-689e05dc83e0 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:08:35.337813 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-f01db6c0-0252-4d7f-8cdd-689e05dc83e0 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:08:35.346942 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f01db6c0-0252-4d7f-8cdd-689e05dc83e0 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:35.347388 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f01db6c0-0252-4d7f-8cdd-689e05dc83e0 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:35.348168 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f01db6c0-0252-4d7f-8cdd-689e05dc83e0 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:35.348630 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f01db6c0-0252-4d7f-8cdd-689e05dc83e0 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:35.596122 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-f01db6c0-0252-4d7f-8cdd-689e05dc83e0 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:08:35.609987 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-f01db6c0-0252-4d7f-8cdd-689e05dc83e0 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.279417 Nov 23 13:08:35.610707 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 529/1096] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:08:35 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:08:35.617628 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-f323fda6-1c0b-4774-8d1c-33e90f29c5c4 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:08:35.619086 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-f323fda6-1c0b-4774-8d1c-33e90f29c5c4 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:08:35.631923 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f323fda6-1c0b-4774-8d1c-33e90f29c5c4 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:35.632420 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f323fda6-1c0b-4774-8d1c-33e90f29c5c4 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:35.633204 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f323fda6-1c0b-4774-8d1c-33e90f29c5c4 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:35.633628 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f323fda6-1c0b-4774-8d1c-33e90f29c5c4 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:35.721961 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-f323fda6-1c0b-4774-8d1c-33e90f29c5c4 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.109891 Nov 23 13:08:35.722629 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 530/1097] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:08:35 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:08:36.628930 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-b9646845-d38f-40fb-8c96-5a778618d9d2 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:08:36.629719 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-b9646845-d38f-40fb-8c96-5a778618d9d2 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:08:36.637723 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b9646845-d38f-40fb-8c96-5a778618d9d2 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:36.638169 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b9646845-d38f-40fb-8c96-5a778618d9d2 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:36.639013 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b9646845-d38f-40fb-8c96-5a778618d9d2 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:36.639618 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b9646845-d38f-40fb-8c96-5a778618d9d2 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:36.847136 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-b9646845-d38f-40fb-8c96-5a778618d9d2 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:08:36.855658 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-b9646845-d38f-40fb-8c96-5a778618d9d2 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.230837 Nov 23 13:08:36.856251 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 531/1098] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:08:36 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:08:36.860811 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-d9dc05e0-ca92-4375-a38b-4b9fe33632c8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:08:36.861711 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-d9dc05e0-ca92-4375-a38b-4b9fe33632c8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:08:36.869093 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d9dc05e0-ca92-4375-a38b-4b9fe33632c8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:36.869540 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d9dc05e0-ca92-4375-a38b-4b9fe33632c8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:36.870304 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d9dc05e0-ca92-4375-a38b-4b9fe33632c8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:36.871086 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d9dc05e0-ca92-4375-a38b-4b9fe33632c8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:36.934590 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-d9dc05e0-ca92-4375-a38b-4b9fe33632c8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.077166 Nov 23 13:08:36.935049 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 532/1099] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:08:36 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:08:37.873771 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-7229dd3e-9424-48f1-ae3b-03d32bb552a3 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:08:37.874484 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-7229dd3e-9424-48f1-ae3b-03d32bb552a3 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:08:37.884885 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7229dd3e-9424-48f1-ae3b-03d32bb552a3 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:37.885608 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7229dd3e-9424-48f1-ae3b-03d32bb552a3 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:37.886810 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7229dd3e-9424-48f1-ae3b-03d32bb552a3 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:37.887515 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7229dd3e-9424-48f1-ae3b-03d32bb552a3 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:38.100082 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-7229dd3e-9424-48f1-ae3b-03d32bb552a3 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:08:38.109100 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-7229dd3e-9424-48f1-ae3b-03d32bb552a3 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.239573 Nov 23 13:08:38.109678 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 533/1100] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:08:37 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:08:38.114108 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-054bdcac-4169-407c-a344-239f25bb9b3a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:08:38.115010 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-054bdcac-4169-407c-a344-239f25bb9b3a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:08:38.124678 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-054bdcac-4169-407c-a344-239f25bb9b3a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:38.125121 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-054bdcac-4169-407c-a344-239f25bb9b3a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:38.125882 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-054bdcac-4169-407c-a344-239f25bb9b3a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:38.126305 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-054bdcac-4169-407c-a344-239f25bb9b3a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:38.194276 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-054bdcac-4169-407c-a344-239f25bb9b3a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.083554 Nov 23 13:08:38.194831 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 534/1101] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:08:38 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:08:39.130801 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-54f02842-1d48-4850-8e0a-c484db4c328d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:08:39.131846 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-54f02842-1d48-4850-8e0a-c484db4c328d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:08:39.144299 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-54f02842-1d48-4850-8e0a-c484db4c328d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:39.145092 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-54f02842-1d48-4850-8e0a-c484db4c328d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:39.146355 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-54f02842-1d48-4850-8e0a-c484db4c328d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:39.147080 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-54f02842-1d48-4850-8e0a-c484db4c328d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:39.351226 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-54f02842-1d48-4850-8e0a-c484db4c328d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:08:39.359781 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-54f02842-1d48-4850-8e0a-c484db4c328d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.235942 Nov 23 13:08:39.360366 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 535/1102] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:08:39 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:08:39.364776 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-1287e54f-c5cc-48d9-b816-c86d6440743a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:08:39.365690 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-1287e54f-c5cc-48d9-b816-c86d6440743a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:08:39.373263 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1287e54f-c5cc-48d9-b816-c86d6440743a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:39.373814 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1287e54f-c5cc-48d9-b816-c86d6440743a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:39.374644 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1287e54f-c5cc-48d9-b816-c86d6440743a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:39.375071 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1287e54f-c5cc-48d9-b816-c86d6440743a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:39.441838 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-1287e54f-c5cc-48d9-b816-c86d6440743a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.080371 Nov 23 13:08:39.442312 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 536/1103] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:08:39 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:08:40.381493 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-ea3ab667-4472-4175-966d-798db3144f28 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:08:40.382545 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-ea3ab667-4472-4175-966d-798db3144f28 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:08:40.394822 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ea3ab667-4472-4175-966d-798db3144f28 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:40.395562 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ea3ab667-4472-4175-966d-798db3144f28 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:40.396861 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ea3ab667-4472-4175-966d-798db3144f28 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:40.397574 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ea3ab667-4472-4175-966d-798db3144f28 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:40.603532 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-ea3ab667-4472-4175-966d-798db3144f28 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:08:40.612762 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-ea3ab667-4472-4175-966d-798db3144f28 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.237548 Nov 23 13:08:40.613344 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 537/1104] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:08:40 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:08:40.617842 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-1fb3249f-fe2b-4024-97d6-e1d0cc80a78a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:08:40.618785 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-1fb3249f-fe2b-4024-97d6-e1d0cc80a78a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:08:40.626911 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1fb3249f-fe2b-4024-97d6-e1d0cc80a78a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:40.627359 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1fb3249f-fe2b-4024-97d6-e1d0cc80a78a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:40.628129 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1fb3249f-fe2b-4024-97d6-e1d0cc80a78a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:40.628588 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1fb3249f-fe2b-4024-97d6-e1d0cc80a78a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:40.691884 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-1fb3249f-fe2b-4024-97d6-e1d0cc80a78a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.077426 Nov 23 13:08:40.692389 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 538/1105] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:08:40 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:08:41.634298 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-51ae7321-2326-40cc-981a-e3d12d2400e5 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:08:41.635414 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-51ae7321-2326-40cc-981a-e3d12d2400e5 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:08:41.645410 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-51ae7321-2326-40cc-981a-e3d12d2400e5 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:41.645857 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-51ae7321-2326-40cc-981a-e3d12d2400e5 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:41.646630 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-51ae7321-2326-40cc-981a-e3d12d2400e5 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:41.647056 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-51ae7321-2326-40cc-981a-e3d12d2400e5 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:41.868411 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-51ae7321-2326-40cc-981a-e3d12d2400e5 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:08:41.878248 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-51ae7321-2326-40cc-981a-e3d12d2400e5 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.250401 Nov 23 13:08:41.878813 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 539/1106] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:08:41 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:08:41.883289 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-252d82ed-460f-4a33-a6fe-4adbaec56fc3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:08:41.884220 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-252d82ed-460f-4a33-a6fe-4adbaec56fc3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:08:41.891334 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-252d82ed-460f-4a33-a6fe-4adbaec56fc3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:41.891732 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-252d82ed-460f-4a33-a6fe-4adbaec56fc3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:41.892513 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-252d82ed-460f-4a33-a6fe-4adbaec56fc3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:41.892955 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-252d82ed-460f-4a33-a6fe-4adbaec56fc3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:41.956341 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-252d82ed-460f-4a33-a6fe-4adbaec56fc3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.076483 Nov 23 13:08:41.956916 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 540/1107] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:08:41 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:08:42.895460 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-6179878e-b3ae-47dd-91e7-8dcc5558b069 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:08:42.896054 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-6179878e-b3ae-47dd-91e7-8dcc5558b069 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:08:42.903732 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-6179878e-b3ae-47dd-91e7-8dcc5558b069 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:42.904201 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-6179878e-b3ae-47dd-91e7-8dcc5558b069 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:42.904990 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-6179878e-b3ae-47dd-91e7-8dcc5558b069 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:42.905422 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-6179878e-b3ae-47dd-91e7-8dcc5558b069 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:43.113204 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-6179878e-b3ae-47dd-91e7-8dcc5558b069 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:08:43.127252 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-6179878e-b3ae-47dd-91e7-8dcc5558b069 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.235328 Nov 23 13:08:43.127956 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 541/1108] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:08:42 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 13:08:43.132527 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-491fd932-00f5-4e06-b02e-412f8baa9464 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:08:43.133441 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-491fd932-00f5-4e06-b02e-412f8baa9464 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:08:43.142365 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-491fd932-00f5-4e06-b02e-412f8baa9464 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:43.142815 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-491fd932-00f5-4e06-b02e-412f8baa9464 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:43.143588 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-491fd932-00f5-4e06-b02e-412f8baa9464 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:43.144024 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-491fd932-00f5-4e06-b02e-412f8baa9464 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:43.206665 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-491fd932-00f5-4e06-b02e-412f8baa9464 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.077645 Nov 23 13:08:43.207219 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 542/1109] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:08:43 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:08:44.148380 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-e03af506-eba8-4953-b25b-378e629240f4 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:08:44.149489 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-e03af506-eba8-4953-b25b-378e629240f4 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:08:44.159848 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e03af506-eba8-4953-b25b-378e629240f4 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:44.160293 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e03af506-eba8-4953-b25b-378e629240f4 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:44.161095 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e03af506-eba8-4953-b25b-378e629240f4 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:44.161525 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e03af506-eba8-4953-b25b-378e629240f4 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:44.378562 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-e03af506-eba8-4953-b25b-378e629240f4 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:08:44.386946 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-e03af506-eba8-4953-b25b-378e629240f4 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.244997 Nov 23 13:08:44.387518 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 543/1110] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:08:44 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:08:44.392230 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-0ebf07c8-d909-40d9-a8fb-0f4e1ac4e8dc tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:08:44.393148 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-0ebf07c8-d909-40d9-a8fb-0f4e1ac4e8dc tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:08:44.400159 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0ebf07c8-d909-40d9-a8fb-0f4e1ac4e8dc tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:44.400590 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0ebf07c8-d909-40d9-a8fb-0f4e1ac4e8dc tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:44.401313 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0ebf07c8-d909-40d9-a8fb-0f4e1ac4e8dc tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:44.401778 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0ebf07c8-d909-40d9-a8fb-0f4e1ac4e8dc tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:44.466174 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-0ebf07c8-d909-40d9-a8fb-0f4e1ac4e8dc tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.077612 Nov 23 13:08:44.466730 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 544/1111] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:08:44 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:08:45.407816 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-002c1cdc-8043-47fc-9839-f000b551807b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:08:45.408774 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-002c1cdc-8043-47fc-9839-f000b551807b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:08:45.420579 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-002c1cdc-8043-47fc-9839-f000b551807b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:45.421354 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-002c1cdc-8043-47fc-9839-f000b551807b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:45.422550 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-002c1cdc-8043-47fc-9839-f000b551807b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:45.423016 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-002c1cdc-8043-47fc-9839-f000b551807b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:45.635543 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-002c1cdc-8043-47fc-9839-f000b551807b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:08:45.648436 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-002c1cdc-8043-47fc-9839-f000b551807b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.247018 Nov 23 13:08:45.649211 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 545/1112] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:08:45 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 13:08:45.653730 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-213b355d-3c35-4ef3-a285-a9679fdd72c0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:08:45.654642 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-213b355d-3c35-4ef3-a285-a9679fdd72c0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:08:45.661935 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-213b355d-3c35-4ef3-a285-a9679fdd72c0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:45.662305 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-213b355d-3c35-4ef3-a285-a9679fdd72c0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:45.663065 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-213b355d-3c35-4ef3-a285-a9679fdd72c0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:45.663498 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-213b355d-3c35-4ef3-a285-a9679fdd72c0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:45.727119 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-213b355d-3c35-4ef3-a285-a9679fdd72c0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.076842 Nov 23 13:08:45.727682 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 546/1113] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:08:45 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:08:46.669997 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-eceee762-8c98-47aa-9c2b-df7eb088e342 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:08:46.671113 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-eceee762-8c98-47aa-9c2b-df7eb088e342 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:08:46.679448 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-eceee762-8c98-47aa-9c2b-df7eb088e342 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:46.679901 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-eceee762-8c98-47aa-9c2b-df7eb088e342 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:46.680700 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-eceee762-8c98-47aa-9c2b-df7eb088e342 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:46.681133 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-eceee762-8c98-47aa-9c2b-df7eb088e342 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:46.896297 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-eceee762-8c98-47aa-9c2b-df7eb088e342 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:08:46.909612 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-eceee762-8c98-47aa-9c2b-df7eb088e342 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.245435 Nov 23 13:08:46.910394 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 547/1114] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:08:46 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:08:46.915098 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-881bfc35-57dc-4a05-90c1-4efb6d2a7984 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:08:46.916032 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-881bfc35-57dc-4a05-90c1-4efb6d2a7984 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:08:46.924267 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-881bfc35-57dc-4a05-90c1-4efb6d2a7984 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:46.924650 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-881bfc35-57dc-4a05-90c1-4efb6d2a7984 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:46.925424 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-881bfc35-57dc-4a05-90c1-4efb6d2a7984 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:46.925851 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-881bfc35-57dc-4a05-90c1-4efb6d2a7984 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:46.988952 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-881bfc35-57dc-4a05-90c1-4efb6d2a7984 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.077467 Nov 23 13:08:46.989500 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 548/1115] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:08:46 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:08:47.931402 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-58eb8357-f28d-47d0-abfe-c1094132cb2b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:08:47.932376 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-58eb8357-f28d-47d0-abfe-c1094132cb2b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:08:47.942380 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-58eb8357-f28d-47d0-abfe-c1094132cb2b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:47.942823 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-58eb8357-f28d-47d0-abfe-c1094132cb2b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:47.943587 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-58eb8357-f28d-47d0-abfe-c1094132cb2b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:47.944017 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-58eb8357-f28d-47d0-abfe-c1094132cb2b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:48.149544 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-58eb8357-f28d-47d0-abfe-c1094132cb2b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:08:48.158698 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-58eb8357-f28d-47d0-abfe-c1094132cb2b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.233827 Nov 23 13:08:48.159271 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 549/1116] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:08:47 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:08:48.163686 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-aaeab2e5-a774-4f72-9e10-65d274cc617c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:08:48.164595 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-aaeab2e5-a774-4f72-9e10-65d274cc617c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:08:48.173258 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-aaeab2e5-a774-4f72-9e10-65d274cc617c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:48.173702 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-aaeab2e5-a774-4f72-9e10-65d274cc617c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:48.174455 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-aaeab2e5-a774-4f72-9e10-65d274cc617c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:48.174878 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-aaeab2e5-a774-4f72-9e10-65d274cc617c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:48.241237 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-aaeab2e5-a774-4f72-9e10-65d274cc617c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.080905 Nov 23 13:08:48.241809 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 550/1117] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:08:48 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:08:49.177492 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-b40a8acf-5be1-4c50-9a61-9e33c06ccb5b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:08:49.178105 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-b40a8acf-5be1-4c50-9a61-9e33c06ccb5b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:08:49.186056 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b40a8acf-5be1-4c50-9a61-9e33c06ccb5b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:49.186514 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b40a8acf-5be1-4c50-9a61-9e33c06ccb5b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:49.187280 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b40a8acf-5be1-4c50-9a61-9e33c06ccb5b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:49.187710 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b40a8acf-5be1-4c50-9a61-9e33c06ccb5b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:49.387133 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-b40a8acf-5be1-4c50-9a61-9e33c06ccb5b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:08:49.395970 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-b40a8acf-5be1-4c50-9a61-9e33c06ccb5b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.222260 Nov 23 13:08:49.396602 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 551/1118] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:08:49 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:08:49.401228 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-d169a8f0-a533-4c57-a44c-32981c118e3d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:08:49.402096 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-d169a8f0-a533-4c57-a44c-32981c118e3d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:08:49.409340 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d169a8f0-a533-4c57-a44c-32981c118e3d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:49.409726 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d169a8f0-a533-4c57-a44c-32981c118e3d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:49.410491 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d169a8f0-a533-4c57-a44c-32981c118e3d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:49.410921 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d169a8f0-a533-4c57-a44c-32981c118e3d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:49.475413 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-d169a8f0-a533-4c57-a44c-32981c118e3d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.077766 Nov 23 13:08:49.476002 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 552/1119] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:08:49 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:08:50.416594 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-31a58ea7-d4c9-4542-a82e-0bd98c1e142d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:08:50.417627 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-31a58ea7-d4c9-4542-a82e-0bd98c1e142d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:08:50.427298 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-31a58ea7-d4c9-4542-a82e-0bd98c1e142d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:50.427744 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-31a58ea7-d4c9-4542-a82e-0bd98c1e142d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:50.428542 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-31a58ea7-d4c9-4542-a82e-0bd98c1e142d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:50.428980 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-31a58ea7-d4c9-4542-a82e-0bd98c1e142d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:50.642940 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-31a58ea7-d4c9-4542-a82e-0bd98c1e142d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:08:50.651332 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-31a58ea7-d4c9-4542-a82e-0bd98c1e142d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.240958 Nov 23 13:08:50.651893 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 553/1120] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:08:50 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:08:50.656262 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-02049020-fbc1-4ccf-a226-d0f541e8e35d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:08:50.657142 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-02049020-fbc1-4ccf-a226-d0f541e8e35d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:08:50.664222 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-02049020-fbc1-4ccf-a226-d0f541e8e35d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:50.664716 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-02049020-fbc1-4ccf-a226-d0f541e8e35d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:50.665450 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-02049020-fbc1-4ccf-a226-d0f541e8e35d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:50.665876 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-02049020-fbc1-4ccf-a226-d0f541e8e35d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:50.728828 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-02049020-fbc1-4ccf-a226-d0f541e8e35d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.075739 Nov 23 13:08:50.729305 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 554/1121] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:08:50 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:08:51.672309 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-cb6a5b96-e93a-4bea-a240-4d1c52764c40 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:08:51.673440 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-cb6a5b96-e93a-4bea-a240-4d1c52764c40 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:08:51.685775 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-cb6a5b96-e93a-4bea-a240-4d1c52764c40 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:51.686517 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-cb6a5b96-e93a-4bea-a240-4d1c52764c40 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:51.687956 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-cb6a5b96-e93a-4bea-a240-4d1c52764c40 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:51.688728 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-cb6a5b96-e93a-4bea-a240-4d1c52764c40 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:51.887701 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-cb6a5b96-e93a-4bea-a240-4d1c52764c40 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:08:51.896780 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-cb6a5b96-e93a-4bea-a240-4d1c52764c40 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.230775 Nov 23 13:08:51.897349 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 555/1122] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:08:51 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:08:51.901793 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-dca53961-83b1-4b64-8628-c8e72fa09246 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:08:51.902704 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-dca53961-83b1-4b64-8628-c8e72fa09246 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:08:51.909974 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-dca53961-83b1-4b64-8628-c8e72fa09246 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:51.910564 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-dca53961-83b1-4b64-8628-c8e72fa09246 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:51.911335 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-dca53961-83b1-4b64-8628-c8e72fa09246 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:51.911774 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-dca53961-83b1-4b64-8628-c8e72fa09246 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:51.975931 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-dca53961-83b1-4b64-8628-c8e72fa09246 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.077451 Nov 23 13:08:51.976413 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 556/1123] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:08:51 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:08:52.918002 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-8e6d4df1-5eb9-4370-a44c-21f5fc4116e2 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:08:52.919004 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-8e6d4df1-5eb9-4370-a44c-21f5fc4116e2 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:08:52.931152 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8e6d4df1-5eb9-4370-a44c-21f5fc4116e2 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:52.931891 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8e6d4df1-5eb9-4370-a44c-21f5fc4116e2 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:52.933214 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8e6d4df1-5eb9-4370-a44c-21f5fc4116e2 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:52.933919 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8e6d4df1-5eb9-4370-a44c-21f5fc4116e2 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:53.227565 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-8e6d4df1-5eb9-4370-a44c-21f5fc4116e2 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:08:53.240371 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-8e6d4df1-5eb9-4370-a44c-21f5fc4116e2 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.328404 Nov 23 13:08:53.241174 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 557/1124] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:08:52 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:08:53.248189 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-2b74e369-ec38-4b81-b41c-cac15158b5ca tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:08:53.249484 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-2b74e369-ec38-4b81-b41c-cac15158b5ca tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:08:53.258029 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2b74e369-ec38-4b81-b41c-cac15158b5ca tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:53.258477 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2b74e369-ec38-4b81-b41c-cac15158b5ca tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:53.259249 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2b74e369-ec38-4b81-b41c-cac15158b5ca tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:53.259679 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2b74e369-ec38-4b81-b41c-cac15158b5ca tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:53.331436 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-2b74e369-ec38-4b81-b41c-cac15158b5ca tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.088840 Nov 23 13:08:53.332287 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 558/1125] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:08:53 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:08:54.266389 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-94076fd2-df67-4f1e-861d-36d4c18bf2ac tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:08:54.267440 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-94076fd2-df67-4f1e-861d-36d4c18bf2ac tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:08:54.275894 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-94076fd2-df67-4f1e-861d-36d4c18bf2ac tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:54.276466 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-94076fd2-df67-4f1e-861d-36d4c18bf2ac tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:54.277150 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-94076fd2-df67-4f1e-861d-36d4c18bf2ac tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:54.277580 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-94076fd2-df67-4f1e-861d-36d4c18bf2ac tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:54.477493 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-94076fd2-df67-4f1e-861d-36d4c18bf2ac tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:08:54.485843 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-94076fd2-df67-4f1e-861d-36d4c18bf2ac tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.226082 Nov 23 13:08:54.486471 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 559/1126] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:08:54 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:08:54.494320 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-b2b0013f-26bc-4e35-9a0e-d057ef5ad567 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:08:54.494320 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-b2b0013f-26bc-4e35-9a0e-d057ef5ad567 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:08:54.499639 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b2b0013f-26bc-4e35-9a0e-d057ef5ad567 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:54.500108 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b2b0013f-26bc-4e35-9a0e-d057ef5ad567 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:54.500904 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b2b0013f-26bc-4e35-9a0e-d057ef5ad567 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:54.501334 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b2b0013f-26bc-4e35-9a0e-d057ef5ad567 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:54.569705 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-b2b0013f-26bc-4e35-9a0e-d057ef5ad567 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.082182 Nov 23 13:08:54.570248 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 560/1127] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:08:54 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:08:55.504220 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-f8473185-de71-4f5e-afff-1eefb6ee71b5 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:08:55.504930 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-f8473185-de71-4f5e-afff-1eefb6ee71b5 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:08:55.513818 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f8473185-de71-4f5e-afff-1eefb6ee71b5 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:55.514263 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f8473185-de71-4f5e-afff-1eefb6ee71b5 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:55.515064 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f8473185-de71-4f5e-afff-1eefb6ee71b5 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:55.515920 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f8473185-de71-4f5e-afff-1eefb6ee71b5 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:55.730285 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-f8473185-de71-4f5e-afff-1eefb6ee71b5 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:08:55.739678 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-f8473185-de71-4f5e-afff-1eefb6ee71b5 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.239383 Nov 23 13:08:55.740280 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 561/1128] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:08:55 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:08:55.744720 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-e890dc7e-3571-4ae0-9dde-3d3546ee2fce tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:08:55.745977 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-e890dc7e-3571-4ae0-9dde-3d3546ee2fce tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:08:55.753446 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e890dc7e-3571-4ae0-9dde-3d3546ee2fce tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:55.753889 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e890dc7e-3571-4ae0-9dde-3d3546ee2fce tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:55.754712 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e890dc7e-3571-4ae0-9dde-3d3546ee2fce tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:55.755113 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e890dc7e-3571-4ae0-9dde-3d3546ee2fce tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:55.818802 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-e890dc7e-3571-4ae0-9dde-3d3546ee2fce tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.077462 Nov 23 13:08:55.819364 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 562/1129] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:08:55 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:08:56.761361 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-14a1340e-ffa0-42b9-ac62-f0efbb0f2318 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:08:56.762522 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-14a1340e-ffa0-42b9-ac62-f0efbb0f2318 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:08:56.773539 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-14a1340e-ffa0-42b9-ac62-f0efbb0f2318 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:56.773992 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-14a1340e-ffa0-42b9-ac62-f0efbb0f2318 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:56.774772 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-14a1340e-ffa0-42b9-ac62-f0efbb0f2318 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:56.775204 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-14a1340e-ffa0-42b9-ac62-f0efbb0f2318 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:56.976648 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-14a1340e-ffa0-42b9-ac62-f0efbb0f2318 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:08:56.989030 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-14a1340e-ffa0-42b9-ac62-f0efbb0f2318 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.233675 Nov 23 13:08:56.989921 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 563/1130] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:08:56 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:08:56.994093 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-4d7f0b95-70aa-47e8-b471-0f7aae3565e3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:08:56.994975 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-4d7f0b95-70aa-47e8-b471-0f7aae3565e3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:08:57.002534 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-4d7f0b95-70aa-47e8-b471-0f7aae3565e3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:57.002981 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-4d7f0b95-70aa-47e8-b471-0f7aae3565e3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:57.003734 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-4d7f0b95-70aa-47e8-b471-0f7aae3565e3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:57.004436 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-4d7f0b95-70aa-47e8-b471-0f7aae3565e3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:57.071270 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-4d7f0b95-70aa-47e8-b471-0f7aae3565e3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.080620 Nov 23 13:08:57.071810 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 564/1131] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:08:56 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:08:58.010506 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-81e27078-37aa-4cc6-a77b-b23389d9ebaf tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:08:58.011532 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-81e27078-37aa-4cc6-a77b-b23389d9ebaf tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:08:58.024190 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-81e27078-37aa-4cc6-a77b-b23389d9ebaf tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:58.024919 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-81e27078-37aa-4cc6-a77b-b23389d9ebaf tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:58.026210 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-81e27078-37aa-4cc6-a77b-b23389d9ebaf tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:58.026914 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-81e27078-37aa-4cc6-a77b-b23389d9ebaf tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:58.230220 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-81e27078-37aa-4cc6-a77b-b23389d9ebaf tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:08:58.239732 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-81e27078-37aa-4cc6-a77b-b23389d9ebaf tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.235421 Nov 23 13:08:58.240305 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 565/1132] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:08:58 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:08:58.244733 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-113e4a65-cd7c-4be7-b818-9090d2f2abfe tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:08:58.246010 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-113e4a65-cd7c-4be7-b818-9090d2f2abfe tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:08:58.252983 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-113e4a65-cd7c-4be7-b818-9090d2f2abfe tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:58.253427 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-113e4a65-cd7c-4be7-b818-9090d2f2abfe tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:58.254200 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-113e4a65-cd7c-4be7-b818-9090d2f2abfe tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:58.254635 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-113e4a65-cd7c-4be7-b818-9090d2f2abfe tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:58.327986 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-113e4a65-cd7c-4be7-b818-9090d2f2abfe tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.086278 Nov 23 13:08:58.328844 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 566/1133] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:08:58 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:08:59.261288 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-42f161f7-8fd7-4c00-939d-575d60d1ae70 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:08:59.262306 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-42f161f7-8fd7-4c00-939d-575d60d1ae70 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:08:59.273056 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-42f161f7-8fd7-4c00-939d-575d60d1ae70 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:59.273497 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-42f161f7-8fd7-4c00-939d-575d60d1ae70 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:59.274323 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-42f161f7-8fd7-4c00-939d-575d60d1ae70 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:59.274686 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-42f161f7-8fd7-4c00-939d-575d60d1ae70 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:59.508053 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-42f161f7-8fd7-4c00-939d-575d60d1ae70 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:08:59.517144 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-42f161f7-8fd7-4c00-939d-575d60d1ae70 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.262342 Nov 23 13:08:59.517731 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 567/1134] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:08:59 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:08:59.522096 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-d371c2a2-cf49-4a4c-b71f-09f819a2fc08 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:08:59.523134 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-d371c2a2-cf49-4a4c-b71f-09f819a2fc08 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:08:59.530471 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d371c2a2-cf49-4a4c-b71f-09f819a2fc08 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:59.530917 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d371c2a2-cf49-4a4c-b71f-09f819a2fc08 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:59.531677 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d371c2a2-cf49-4a4c-b71f-09f819a2fc08 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:08:59.532107 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d371c2a2-cf49-4a4c-b71f-09f819a2fc08 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:08:59.594339 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-d371c2a2-cf49-4a4c-b71f-09f819a2fc08 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.075571 Nov 23 13:08:59.594904 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 568/1135] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:08:59 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:09:00.538643 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-226584be-8ff9-463c-99a7-e16dfe94cea3 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:09:00.539843 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-226584be-8ff9-463c-99a7-e16dfe94cea3 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:09:00.551839 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-226584be-8ff9-463c-99a7-e16dfe94cea3 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:00.552294 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-226584be-8ff9-463c-99a7-e16dfe94cea3 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:00.553086 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-226584be-8ff9-463c-99a7-e16dfe94cea3 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:00.553515 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-226584be-8ff9-463c-99a7-e16dfe94cea3 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:00.773770 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-226584be-8ff9-463c-99a7-e16dfe94cea3 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:09:00.785105 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-226584be-8ff9-463c-99a7-e16dfe94cea3 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.252487 Nov 23 13:09:00.785826 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 569/1136] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:09:00 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:09:00.790422 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-7af5afd6-dc80-4c53-b54e-4275569b931e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:09:00.791244 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-7af5afd6-dc80-4c53-b54e-4275569b931e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:09:00.798526 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7af5afd6-dc80-4c53-b54e-4275569b931e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:00.798967 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7af5afd6-dc80-4c53-b54e-4275569b931e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:00.799722 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7af5afd6-dc80-4c53-b54e-4275569b931e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:00.800176 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7af5afd6-dc80-4c53-b54e-4275569b931e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:00.863059 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-7af5afd6-dc80-4c53-b54e-4275569b931e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.076133 Nov 23 13:09:00.864010 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 570/1137] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:09:00 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:09:01.806204 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-1952e250-e7f6-4394-a1c4-9d2d2b3975e0 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:09:01.807273 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-1952e250-e7f6-4394-a1c4-9d2d2b3975e0 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:09:01.818628 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1952e250-e7f6-4394-a1c4-9d2d2b3975e0 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:01.819077 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1952e250-e7f6-4394-a1c4-9d2d2b3975e0 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:01.819840 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1952e250-e7f6-4394-a1c4-9d2d2b3975e0 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:01.820278 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1952e250-e7f6-4394-a1c4-9d2d2b3975e0 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:02.027744 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-1952e250-e7f6-4394-a1c4-9d2d2b3975e0 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:09:02.040848 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-1952e250-e7f6-4394-a1c4-9d2d2b3975e0 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.240763 Nov 23 13:09:02.041669 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 571/1138] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:09:01 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:09:02.048481 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-64f518fb-5a75-4501-8f43-a6358a0d7323 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:09:02.049880 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-64f518fb-5a75-4501-8f43-a6358a0d7323 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:09:02.057528 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-64f518fb-5a75-4501-8f43-a6358a0d7323 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:02.057902 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-64f518fb-5a75-4501-8f43-a6358a0d7323 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:02.058656 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-64f518fb-5a75-4501-8f43-a6358a0d7323 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:02.059081 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-64f518fb-5a75-4501-8f43-a6358a0d7323 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:02.122861 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-64f518fb-5a75-4501-8f43-a6358a0d7323 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.080003 Nov 23 13:09:02.123417 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 572/1139] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:09:02 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:09:03.065966 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-83b43d46-7f1e-465e-9308-21585ca65f74 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:09:03.067103 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-83b43d46-7f1e-465e-9308-21585ca65f74 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:09:03.075188 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-83b43d46-7f1e-465e-9308-21585ca65f74 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:03.075634 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-83b43d46-7f1e-465e-9308-21585ca65f74 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:03.076521 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-83b43d46-7f1e-465e-9308-21585ca65f74 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:03.076953 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-83b43d46-7f1e-465e-9308-21585ca65f74 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:03.292398 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-83b43d46-7f1e-465e-9308-21585ca65f74 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:09:03.306087 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-83b43d46-7f1e-465e-9308-21585ca65f74 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.246524 Nov 23 13:09:03.306877 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 573/1140] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:09:03 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:09:03.313669 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-f3dbd190-d324-4c6b-8155-d8c5f4769a34 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:09:03.315009 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-f3dbd190-d324-4c6b-8155-d8c5f4769a34 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:09:03.322983 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f3dbd190-d324-4c6b-8155-d8c5f4769a34 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:03.323423 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f3dbd190-d324-4c6b-8155-d8c5f4769a34 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:03.324170 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f3dbd190-d324-4c6b-8155-d8c5f4769a34 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:03.324636 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f3dbd190-d324-4c6b-8155-d8c5f4769a34 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:03.388169 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-f3dbd190-d324-4c6b-8155-d8c5f4769a34 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.080116 Nov 23 13:09:03.388759 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 574/1141] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:09:03 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:09:04.331286 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-2c33df1e-2bd4-4cc4-aa5d-b9af15ad541c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:09:04.332458 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-2c33df1e-2bd4-4cc4-aa5d-b9af15ad541c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:09:04.340746 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2c33df1e-2bd4-4cc4-aa5d-b9af15ad541c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:04.341227 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2c33df1e-2bd4-4cc4-aa5d-b9af15ad541c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:04.342056 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2c33df1e-2bd4-4cc4-aa5d-b9af15ad541c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:04.342494 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2c33df1e-2bd4-4cc4-aa5d-b9af15ad541c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:04.548425 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-2c33df1e-2bd4-4cc4-aa5d-b9af15ad541c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:09:04.557099 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-2c33df1e-2bd4-4cc4-aa5d-b9af15ad541c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.232080 Nov 23 13:09:04.557680 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 575/1142] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:09:04 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:09:04.562202 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-6ed186af-df06-406d-b190-9320e5aa7385 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:09:04.563076 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-6ed186af-df06-406d-b190-9320e5aa7385 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:09:04.570719 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-6ed186af-df06-406d-b190-9320e5aa7385 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:04.571159 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-6ed186af-df06-406d-b190-9320e5aa7385 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:04.571947 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-6ed186af-df06-406d-b190-9320e5aa7385 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:04.572416 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-6ed186af-df06-406d-b190-9320e5aa7385 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:04.637711 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-6ed186af-df06-406d-b190-9320e5aa7385 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.078914 Nov 23 13:09:04.638189 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 576/1143] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:09:04 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:09:05.578600 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-8910ca28-ac50-4454-965e-33fd63b5bb2f tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:09:05.579673 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-8910ca28-ac50-4454-965e-33fd63b5bb2f tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:09:05.591884 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8910ca28-ac50-4454-965e-33fd63b5bb2f tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:05.592650 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8910ca28-ac50-4454-965e-33fd63b5bb2f tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:05.593927 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8910ca28-ac50-4454-965e-33fd63b5bb2f tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:05.594643 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8910ca28-ac50-4454-965e-33fd63b5bb2f tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:05.806724 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-8910ca28-ac50-4454-965e-33fd63b5bb2f tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:09:05.815192 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-8910ca28-ac50-4454-965e-33fd63b5bb2f tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.242973 Nov 23 13:09:05.815731 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 577/1144] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:09:05 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:09:05.820289 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-b831fd77-df2e-4c2b-addb-ed75df0ee26e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:09:05.821219 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-b831fd77-df2e-4c2b-addb-ed75df0ee26e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:09:05.828592 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b831fd77-df2e-4c2b-addb-ed75df0ee26e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:05.829090 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b831fd77-df2e-4c2b-addb-ed75df0ee26e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:05.829786 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b831fd77-df2e-4c2b-addb-ed75df0ee26e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:05.830207 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b831fd77-df2e-4c2b-addb-ed75df0ee26e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:05.898084 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-b831fd77-df2e-4c2b-addb-ed75df0ee26e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.081224 Nov 23 13:09:05.898632 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 578/1145] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:09:05 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:09:06.833550 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-40568936-1638-49bb-a997-0a86170968fd tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:09:06.834350 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-40568936-1638-49bb-a997-0a86170968fd tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:09:06.841970 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-40568936-1638-49bb-a997-0a86170968fd tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:06.842408 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-40568936-1638-49bb-a997-0a86170968fd tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:06.843167 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-40568936-1638-49bb-a997-0a86170968fd tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:06.843615 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-40568936-1638-49bb-a997-0a86170968fd tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:07.053594 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-40568936-1638-49bb-a997-0a86170968fd tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:09:07.062326 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-40568936-1638-49bb-a997-0a86170968fd tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.233066 Nov 23 13:09:07.063111 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 579/1146] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:09:06 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:09:07.067235 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-1c072f5b-4c9c-4104-8d87-85d8f6ea8e2e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:09:07.068261 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-1c072f5b-4c9c-4104-8d87-85d8f6ea8e2e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:09:07.075468 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1c072f5b-4c9c-4104-8d87-85d8f6ea8e2e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:07.075907 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1c072f5b-4c9c-4104-8d87-85d8f6ea8e2e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:07.076715 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1c072f5b-4c9c-4104-8d87-85d8f6ea8e2e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:07.077133 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1c072f5b-4c9c-4104-8d87-85d8f6ea8e2e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:07.140963 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-1c072f5b-4c9c-4104-8d87-85d8f6ea8e2e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.076982 Nov 23 13:09:07.141420 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 580/1147] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:09:07 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:09:08.082973 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-957e7160-aa1f-436b-9167-8910695427a0 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:09:08.084072 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-957e7160-aa1f-436b-9167-8910695427a0 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:09:08.092449 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-957e7160-aa1f-436b-9167-8910695427a0 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:08.092892 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-957e7160-aa1f-436b-9167-8910695427a0 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:08.093653 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-957e7160-aa1f-436b-9167-8910695427a0 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:08.094080 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-957e7160-aa1f-436b-9167-8910695427a0 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:08.302284 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-957e7160-aa1f-436b-9167-8910695427a0 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:09:08.311629 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-957e7160-aa1f-436b-9167-8910695427a0 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.234989 Nov 23 13:09:08.312208 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 581/1148] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:09:08 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:09:08.316568 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-b575369c-73ec-489d-95a7-569e5fdd6194 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:09:08.317458 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-b575369c-73ec-489d-95a7-569e5fdd6194 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:09:08.325153 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b575369c-73ec-489d-95a7-569e5fdd6194 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:08.325598 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b575369c-73ec-489d-95a7-569e5fdd6194 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:08.326366 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b575369c-73ec-489d-95a7-569e5fdd6194 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:08.326827 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b575369c-73ec-489d-95a7-569e5fdd6194 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:08.401143 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-b575369c-73ec-489d-95a7-569e5fdd6194 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.087348 Nov 23 13:09:08.401736 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 582/1149] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:09:08 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:09:09.331716 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-64c3e601-3439-4424-a40e-ae32b99f12b3 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:09:09.332761 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-64c3e601-3439-4424-a40e-ae32b99f12b3 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:09:09.341890 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-64c3e601-3439-4424-a40e-ae32b99f12b3 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:09.342332 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-64c3e601-3439-4424-a40e-ae32b99f12b3 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:09.343093 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-64c3e601-3439-4424-a40e-ae32b99f12b3 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:09.343521 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-64c3e601-3439-4424-a40e-ae32b99f12b3 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:09.557610 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-64c3e601-3439-4424-a40e-ae32b99f12b3 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:09:09.567018 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-64c3e601-3439-4424-a40e-ae32b99f12b3 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.241560 Nov 23 13:09:09.567596 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 583/1150] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:09:09 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:09:09.572270 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-28e30d08-2f81-42f6-878d-493bef07df63 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:09:09.573246 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-28e30d08-2f81-42f6-878d-493bef07df63 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:09:09.581041 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-28e30d08-2f81-42f6-878d-493bef07df63 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:09.581526 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-28e30d08-2f81-42f6-878d-493bef07df63 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:09.582290 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-28e30d08-2f81-42f6-878d-493bef07df63 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:09.582739 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-28e30d08-2f81-42f6-878d-493bef07df63 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:09.648940 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-28e30d08-2f81-42f6-878d-493bef07df63 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.080305 Nov 23 13:09:09.649517 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 584/1151] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:09:09 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:09:10.588742 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-4188f0ab-79be-4ad7-b7b9-bf524afdeec5 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:09:10.589816 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-4188f0ab-79be-4ad7-b7b9-bf524afdeec5 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:09:10.602048 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-4188f0ab-79be-4ad7-b7b9-bf524afdeec5 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:10.602494 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-4188f0ab-79be-4ad7-b7b9-bf524afdeec5 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:10.603255 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-4188f0ab-79be-4ad7-b7b9-bf524afdeec5 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:10.603669 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-4188f0ab-79be-4ad7-b7b9-bf524afdeec5 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:10.819267 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-4188f0ab-79be-4ad7-b7b9-bf524afdeec5 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:09:10.828148 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-4188f0ab-79be-4ad7-b7b9-bf524afdeec5 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.245855 Nov 23 13:09:10.828719 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 585/1152] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:09:10 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:09:10.833287 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-53ee327d-37ec-4844-99e2-636f85a51243 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:09:10.834268 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-53ee327d-37ec-4844-99e2-636f85a51243 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:09:10.842372 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-53ee327d-37ec-4844-99e2-636f85a51243 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:10.842747 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-53ee327d-37ec-4844-99e2-636f85a51243 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:10.843501 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-53ee327d-37ec-4844-99e2-636f85a51243 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:10.843926 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-53ee327d-37ec-4844-99e2-636f85a51243 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:10.908422 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-53ee327d-37ec-4844-99e2-636f85a51243 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.078617 Nov 23 13:09:10.908975 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 586/1153] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:09:10 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:09:11.846078 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-3095e1fa-1ab1-4cbe-85da-a87cfd50ae79 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:09:11.846776 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-3095e1fa-1ab1-4cbe-85da-a87cfd50ae79 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:09:11.855112 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3095e1fa-1ab1-4cbe-85da-a87cfd50ae79 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:11.855553 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3095e1fa-1ab1-4cbe-85da-a87cfd50ae79 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:11.856378 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3095e1fa-1ab1-4cbe-85da-a87cfd50ae79 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:11.856809 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3095e1fa-1ab1-4cbe-85da-a87cfd50ae79 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:12.058914 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-3095e1fa-1ab1-4cbe-85da-a87cfd50ae79 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:09:12.068002 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-3095e1fa-1ab1-4cbe-85da-a87cfd50ae79 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.225790 Nov 23 13:09:12.068827 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 587/1154] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:09:11 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:09:12.073183 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-e4c9dfe9-0fe5-4db6-83b2-c947c5a989e7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:09:12.074112 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-e4c9dfe9-0fe5-4db6-83b2-c947c5a989e7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:09:12.081652 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e4c9dfe9-0fe5-4db6-83b2-c947c5a989e7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:12.082089 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e4c9dfe9-0fe5-4db6-83b2-c947c5a989e7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:12.082851 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e4c9dfe9-0fe5-4db6-83b2-c947c5a989e7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:12.083275 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e4c9dfe9-0fe5-4db6-83b2-c947c5a989e7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:12.146607 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-e4c9dfe9-0fe5-4db6-83b2-c947c5a989e7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.076882 Nov 23 13:09:12.147090 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 588/1155] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:09:12 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:09:13.089433 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-dff868f2-6296-43bc-9c34-09c553210a67 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:09:13.090068 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-dff868f2-6296-43bc-9c34-09c553210a67 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:09:13.097871 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-dff868f2-6296-43bc-9c34-09c553210a67 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:13.098317 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-dff868f2-6296-43bc-9c34-09c553210a67 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:13.099090 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-dff868f2-6296-43bc-9c34-09c553210a67 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:13.099511 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-dff868f2-6296-43bc-9c34-09c553210a67 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:13.304466 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-dff868f2-6296-43bc-9c34-09c553210a67 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:09:13.313573 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-dff868f2-6296-43bc-9c34-09c553210a67 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.230268 Nov 23 13:09:13.314146 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 589/1156] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:09:13 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:09:13.318589 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-0333b248-0040-4f84-b241-89a817eb95e7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:09:13.319477 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-0333b248-0040-4f84-b241-89a817eb95e7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:09:13.326530 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0333b248-0040-4f84-b241-89a817eb95e7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:13.326979 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0333b248-0040-4f84-b241-89a817eb95e7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:13.327734 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0333b248-0040-4f84-b241-89a817eb95e7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:13.328163 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0333b248-0040-4f84-b241-89a817eb95e7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:13.391856 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-0333b248-0040-4f84-b241-89a817eb95e7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.076701 Nov 23 13:09:13.392422 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 590/1157] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:09:13 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:09:14.334649 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-e6284052-8c47-4cca-8ee7-51ec4f1e5980 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:09:14.335809 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-e6284052-8c47-4cca-8ee7-51ec4f1e5980 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:09:14.348308 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e6284052-8c47-4cca-8ee7-51ec4f1e5980 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:14.349066 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e6284052-8c47-4cca-8ee7-51ec4f1e5980 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:14.350326 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e6284052-8c47-4cca-8ee7-51ec4f1e5980 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:14.351042 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e6284052-8c47-4cca-8ee7-51ec4f1e5980 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:14.559087 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-e6284052-8c47-4cca-8ee7-51ec4f1e5980 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:09:14.567978 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-e6284052-8c47-4cca-8ee7-51ec4f1e5980 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.239691 Nov 23 13:09:14.568597 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 591/1158] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:09:14 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:09:14.573043 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-02f4e8fb-c96c-41d3-b0d3-7784da4f7849 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:09:14.574231 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-02f4e8fb-c96c-41d3-b0d3-7784da4f7849 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:09:14.581413 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-02f4e8fb-c96c-41d3-b0d3-7784da4f7849 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:14.581867 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-02f4e8fb-c96c-41d3-b0d3-7784da4f7849 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:14.582624 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-02f4e8fb-c96c-41d3-b0d3-7784da4f7849 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:14.583053 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-02f4e8fb-c96c-41d3-b0d3-7784da4f7849 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:14.649121 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-02f4e8fb-c96c-41d3-b0d3-7784da4f7849 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.079365 Nov 23 13:09:14.649589 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 592/1159] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:09:14 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:09:15.589190 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-2c24d8fd-41f3-4217-af42-ff3ceb39d124 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:09:15.590257 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-2c24d8fd-41f3-4217-af42-ff3ceb39d124 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:09:15.602921 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2c24d8fd-41f3-4217-af42-ff3ceb39d124 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:15.603707 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2c24d8fd-41f3-4217-af42-ff3ceb39d124 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:15.605013 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2c24d8fd-41f3-4217-af42-ff3ceb39d124 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:15.605727 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2c24d8fd-41f3-4217-af42-ff3ceb39d124 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:15.835977 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-2c24d8fd-41f3-4217-af42-ff3ceb39d124 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:09:15.845002 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-2c24d8fd-41f3-4217-af42-ff3ceb39d124 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.262045 Nov 23 13:09:15.845473 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 593/1160] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:09:15 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:09:15.849871 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-a66b140d-1ff8-48f9-9e86-dffb7641c060 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:09:15.850792 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-a66b140d-1ff8-48f9-9e86-dffb7641c060 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:09:15.858125 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a66b140d-1ff8-48f9-9e86-dffb7641c060 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:15.858565 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a66b140d-1ff8-48f9-9e86-dffb7641c060 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:15.859329 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a66b140d-1ff8-48f9-9e86-dffb7641c060 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:15.859762 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a66b140d-1ff8-48f9-9e86-dffb7641c060 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:15.923594 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-a66b140d-1ff8-48f9-9e86-dffb7641c060 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.077074 Nov 23 13:09:15.924146 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 594/1161] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:09:15 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:09:16.862633 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-08914047-1c2c-4313-8a1f-69a30af1ebdb tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:09:16.863337 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-08914047-1c2c-4313-8a1f-69a30af1ebdb tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:09:16.872437 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-08914047-1c2c-4313-8a1f-69a30af1ebdb tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:16.872881 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-08914047-1c2c-4313-8a1f-69a30af1ebdb tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:16.873643 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-08914047-1c2c-4313-8a1f-69a30af1ebdb tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:16.874065 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-08914047-1c2c-4313-8a1f-69a30af1ebdb tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:17.144375 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-08914047-1c2c-4313-8a1f-69a30af1ebdb tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:09:17.157094 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-08914047-1c2c-4313-8a1f-69a30af1ebdb tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.298094 Nov 23 13:09:17.157828 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 595/1162] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:09:16 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:09:17.162265 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-3db631a2-c682-416d-81e9-0b0515f1592a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:09:17.163151 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-3db631a2-c682-416d-81e9-0b0515f1592a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:09:17.171566 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3db631a2-c682-416d-81e9-0b0515f1592a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:17.172013 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3db631a2-c682-416d-81e9-0b0515f1592a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:17.173530 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3db631a2-c682-416d-81e9-0b0515f1592a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:17.173985 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3db631a2-c682-416d-81e9-0b0515f1592a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:17.394945 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-3db631a2-c682-416d-81e9-0b0515f1592a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.235966 Nov 23 13:09:17.395369 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 596/1163] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:09:17 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:09:18.166061 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a7b7a666-a1ad-48b3-bbff-ac4178364592] AMQP server on 10.222.0.60:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 23 13:09:18.277593 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-b050a89e-cb97-4e3c-b483-bc7abcc13f33 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:09:18.278175 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-b050a89e-cb97-4e3c-b483-bc7abcc13f33 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:09:18.285972 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b050a89e-cb97-4e3c-b483-bc7abcc13f33 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:18.286420 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b050a89e-cb97-4e3c-b483-bc7abcc13f33 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:18.287176 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b050a89e-cb97-4e3c-b483-bc7abcc13f33 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:18.287605 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b050a89e-cb97-4e3c-b483-bc7abcc13f33 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:19.190727 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO oslo.messaging._drivers.impl_rabbit [-] [a7b7a666-a1ad-48b3-bbff-ac4178364592] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 47752. Nov 23 13:09:23.085782 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.objects.instance [None req-10f2b9a0-001c-4815-9cd9-72109c66430b tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lazy-loading 'services' on Instance uuid 74e06412-022d-4ece-920d-1cba08639d76 {{(pid=100973) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 23 13:09:23.157381 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.objects.instance [None req-b050a89e-cb97-4e3c-b483-bc7abcc13f33 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lazy-loading 'services' on Instance uuid 74e06412-022d-4ece-920d-1cba08639d76 {{(pid=100974) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 23 13:09:23.229536 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-10f2b9a0-001c-4815-9cd9-72109c66430b tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "DELETE /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76/os-volume_attachments/780ab5a6-5bff-4988-8b16-8e33cc762d8c" status: 202 len: 0 microversion: 2.1 time: 65.128310 Nov 23 13:09:23.230130 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 568/1164] 10.222.0.60 () {58 vars in 1415 bytes} [Tue Nov 23 13:08:18 2021] DELETE /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76/os-volume_attachments/780ab5a6-5bff-4988-8b16-8e33cc762d8c => generated 0 bytes in 65130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:09:23.235404 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-052a8cfa-07e1-4581-bbfb-ca89f3921f05 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:09:23.236103 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-052a8cfa-07e1-4581-bbfb-ca89f3921f05 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:09:23.244270 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-052a8cfa-07e1-4581-bbfb-ca89f3921f05 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:23.244751 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-052a8cfa-07e1-4581-bbfb-ca89f3921f05 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:23.245873 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-052a8cfa-07e1-4581-bbfb-ca89f3921f05 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:23.246380 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-052a8cfa-07e1-4581-bbfb-ca89f3921f05 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:23.289224 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.wsgi [None req-b050a89e-cb97-4e3c-b483-bc7abcc13f33 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6cf0e246-09d2-4b50-9ec0-3780242d6cc1) Nov 23 13:09:23.289863 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-b050a89e-cb97-4e3c-b483-bc7abcc13f33 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6cf0e246-09d2-4b50-9ec0-3780242d6cc1) {{(pid=100974) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Nov 23 13:09:23.290688 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-b050a89e-cb97-4e3c-b483-bc7abcc13f33 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "DELETE /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76/os-volume_attachments/780ab5a6-5bff-4988-8b16-8e33cc762d8c" status: 400 len: 269 microversion: 2.1 time: 5.127548 Nov 23 13:09:23.291219 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 597/1165] 10.222.0.60 () {58 vars in 1415 bytes} [Tue Nov 23 13:09:18 2021] DELETE /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76/os-volume_attachments/780ab5a6-5bff-4988-8b16-8e33cc762d8c => generated 269 bytes in 5129 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 23 13:09:23.296077 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-6029b7c1-53c4-4bb1-9bde-25548e8d667d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:09:23.297131 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-6029b7c1-53c4-4bb1-9bde-25548e8d667d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:09:23.304982 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-6029b7c1-53c4-4bb1-9bde-25548e8d667d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:23.305421 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-6029b7c1-53c4-4bb1-9bde-25548e8d667d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:23.306183 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-6029b7c1-53c4-4bb1-9bde-25548e8d667d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:23.306609 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-6029b7c1-53c4-4bb1-9bde-25548e8d667d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:23.372080 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-6029b7c1-53c4-4bb1-9bde-25548e8d667d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.079741 Nov 23 13:09:23.376021 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 598/1166] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:09:23 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:09:23.380034 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-63429f76-189b-4dd4-8169-67dac647ea0c tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:09:23.380540 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-63429f76-189b-4dd4-8169-67dac647ea0c tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:09:23.388478 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-63429f76-189b-4dd4-8169-67dac647ea0c tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:23.388939 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-63429f76-189b-4dd4-8169-67dac647ea0c tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:23.389736 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-63429f76-189b-4dd4-8169-67dac647ea0c tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:23.390164 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-63429f76-189b-4dd4-8169-67dac647ea0c tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:23.457930 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-052a8cfa-07e1-4581-bbfb-ca89f3921f05 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:09:23.466933 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-052a8cfa-07e1-4581-bbfb-ca89f3921f05 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.235063 Nov 23 13:09:23.467527 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 569/1167] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:09:23 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:09:23.555359 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.objects.instance [None req-63429f76-189b-4dd4-8169-67dac647ea0c tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lazy-loading 'services' on Instance uuid 74e06412-022d-4ece-920d-1cba08639d76 {{(pid=100974) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 23 13:09:23.679252 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.wsgi [None req-63429f76-189b-4dd4-8169-67dac647ea0c tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ce10fe75-7f9a-4cdc-9383-49c2e9e7c34f) Nov 23 13:09:23.679863 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-63429f76-189b-4dd4-8169-67dac647ea0c tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ce10fe75-7f9a-4cdc-9383-49c2e9e7c34f) {{(pid=100974) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Nov 23 13:09:23.680768 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-63429f76-189b-4dd4-8169-67dac647ea0c tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "DELETE /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76/os-volume_attachments/780ab5a6-5bff-4988-8b16-8e33cc762d8c" status: 400 len: 269 microversion: 2.1 time: 0.306693 Nov 23 13:09:23.681333 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 599/1168] 10.222.0.60 () {58 vars in 1415 bytes} [Tue Nov 23 13:09:23 2021] DELETE /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76/os-volume_attachments/780ab5a6-5bff-4988-8b16-8e33cc762d8c => generated 269 bytes in 308 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 23 13:09:24.388542 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-2e839e21-0539-4729-b15a-c5a5429908e1 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:09:24.390033 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-2e839e21-0539-4729-b15a-c5a5429908e1 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:09:24.402751 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-2e839e21-0539-4729-b15a-c5a5429908e1 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:24.403230 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-2e839e21-0539-4729-b15a-c5a5429908e1 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:24.404021 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-2e839e21-0539-4729-b15a-c5a5429908e1 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:24.404507 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-2e839e21-0539-4729-b15a-c5a5429908e1 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:24.471488 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-2e839e21-0539-4729-b15a-c5a5429908e1 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.089723 Nov 23 13:09:24.475455 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 570/1169] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:09:24 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:09:24.486114 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-016b56dd-002b-4ebb-b8b1-d2b168355f20 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:09:24.487579 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-016b56dd-002b-4ebb-b8b1-d2b168355f20 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:09:24.495828 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-016b56dd-002b-4ebb-b8b1-d2b168355f20 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:24.496265 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-016b56dd-002b-4ebb-b8b1-d2b168355f20 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:24.497351 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-016b56dd-002b-4ebb-b8b1-d2b168355f20 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:24.497783 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-016b56dd-002b-4ebb-b8b1-d2b168355f20 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:24.703398 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-016b56dd-002b-4ebb-b8b1-d2b168355f20 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:09:24.716519 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-016b56dd-002b-4ebb-b8b1-d2b168355f20 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.235250 Nov 23 13:09:24.717271 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 600/1170] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:09:24 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 13:09:24.955535 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 13:09:24.955856 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: Tue Nov 23 13:09:24 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 23 13:09:25.486572 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-4f2bd8c7-a21e-4ce6-a706-4c88e1fc05b5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:09:25.487644 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-4f2bd8c7-a21e-4ce6-a706-4c88e1fc05b5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:09:25.498454 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4f2bd8c7-a21e-4ce6-a706-4c88e1fc05b5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:25.499050 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4f2bd8c7-a21e-4ce6-a706-4c88e1fc05b5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:25.500094 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4f2bd8c7-a21e-4ce6-a706-4c88e1fc05b5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:25.500709 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4f2bd8c7-a21e-4ce6-a706-4c88e1fc05b5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:25.567475 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-4f2bd8c7-a21e-4ce6-a706-4c88e1fc05b5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.086515 Nov 23 13:09:25.567997 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 571/1171] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:09:25 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:09:25.742830 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-d392b9e4-c200-4b31-8c66-baa82edfa801 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:09:25.743666 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-d392b9e4-c200-4b31-8c66-baa82edfa801 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:09:25.753121 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d392b9e4-c200-4b31-8c66-baa82edfa801 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:25.753571 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d392b9e4-c200-4b31-8c66-baa82edfa801 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:25.754338 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d392b9e4-c200-4b31-8c66-baa82edfa801 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:25.754767 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d392b9e4-c200-4b31-8c66-baa82edfa801 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:25.954325 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-d392b9e4-c200-4b31-8c66-baa82edfa801 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:09:25.962885 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-d392b9e4-c200-4b31-8c66-baa82edfa801 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.226770 Nov 23 13:09:25.963457 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 601/1172] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:09:25 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:09:26.585100 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-509d49b6-6b4f-4028-9d4d-983c3bc24943 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:09:26.586601 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-509d49b6-6b4f-4028-9d4d-983c3bc24943 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:09:26.595919 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-509d49b6-6b4f-4028-9d4d-983c3bc24943 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:26.596411 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-509d49b6-6b4f-4028-9d4d-983c3bc24943 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:26.597179 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-509d49b6-6b4f-4028-9d4d-983c3bc24943 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:26.597611 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-509d49b6-6b4f-4028-9d4d-983c3bc24943 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:26.665736 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-509d49b6-6b4f-4028-9d4d-983c3bc24943 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.087093 Nov 23 13:09:26.666275 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 572/1173] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:09:26 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:09:26.984813 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-a2d134cb-18c4-4038-a3e7-9105b68013d4 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:09:26.985779 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-a2d134cb-18c4-4038-a3e7-9105b68013d4 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:09:26.998999 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a2d134cb-18c4-4038-a3e7-9105b68013d4 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:26.999732 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a2d134cb-18c4-4038-a3e7-9105b68013d4 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:27.001135 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a2d134cb-18c4-4038-a3e7-9105b68013d4 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:27.001877 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a2d134cb-18c4-4038-a3e7-9105b68013d4 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:27.208262 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-a2d134cb-18c4-4038-a3e7-9105b68013d4 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:09:27.222409 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-a2d134cb-18c4-4038-a3e7-9105b68013d4 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.244078 Nov 23 13:09:27.223180 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 602/1174] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:09:26 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:09:27.821146 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-b70712ad-b682-4e56-aa9d-9cfc047ec984 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:09:27.822867 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-b70712ad-b682-4e56-aa9d-9cfc047ec984 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:09:27.830694 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b70712ad-b682-4e56-aa9d-9cfc047ec984 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:27.831134 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b70712ad-b682-4e56-aa9d-9cfc047ec984 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:27.831932 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b70712ad-b682-4e56-aa9d-9cfc047ec984 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:27.832387 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b70712ad-b682-4e56-aa9d-9cfc047ec984 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:27.896417 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-b70712ad-b682-4e56-aa9d-9cfc047ec984 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.220949 Nov 23 13:09:27.897014 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 573/1175] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:09:27 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:09:28.239656 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-93092292-e77f-420c-af7e-f19f59cfec22 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:09:28.240194 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-93092292-e77f-420c-af7e-f19f59cfec22 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:09:28.248462 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-93092292-e77f-420c-af7e-f19f59cfec22 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:28.248913 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-93092292-e77f-420c-af7e-f19f59cfec22 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:28.249985 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-93092292-e77f-420c-af7e-f19f59cfec22 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:28.250103 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-93092292-e77f-420c-af7e-f19f59cfec22 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:28.537188 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-93092292-e77f-420c-af7e-f19f59cfec22 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:09:28.546158 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-93092292-e77f-420c-af7e-f19f59cfec22 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.310350 Nov 23 13:09:28.546671 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 603/1176] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:09:28 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:09:28.908127 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-1d928974-f686-4f5f-a8e6-73e409ea8286 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:09:28.909068 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-1d928974-f686-4f5f-a8e6-73e409ea8286 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:09:28.917235 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-1d928974-f686-4f5f-a8e6-73e409ea8286 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:28.917682 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-1d928974-f686-4f5f-a8e6-73e409ea8286 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:28.918446 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-1d928974-f686-4f5f-a8e6-73e409ea8286 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:28.918907 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-1d928974-f686-4f5f-a8e6-73e409ea8286 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:28.983209 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-1d928974-f686-4f5f-a8e6-73e409ea8286 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.079013 Nov 23 13:09:28.983975 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 574/1177] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:09:28 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:09:29.569381 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-8ac04a05-9d17-4dc3-9cc2-3b33a4475ba2 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:09:29.569995 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-8ac04a05-9d17-4dc3-9cc2-3b33a4475ba2 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:09:29.577664 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8ac04a05-9d17-4dc3-9cc2-3b33a4475ba2 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:29.578114 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8ac04a05-9d17-4dc3-9cc2-3b33a4475ba2 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:29.578889 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8ac04a05-9d17-4dc3-9cc2-3b33a4475ba2 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:29.579321 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8ac04a05-9d17-4dc3-9cc2-3b33a4475ba2 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:29.782984 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-8ac04a05-9d17-4dc3-9cc2-3b33a4475ba2 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:09:29.795526 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-8ac04a05-9d17-4dc3-9cc2-3b33a4475ba2 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.230856 Nov 23 13:09:29.796095 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 604/1178] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:09:29 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:09:30.000783 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-db82470a-13fe-4e16-aafe-25477ed869b5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:09:30.002066 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-db82470a-13fe-4e16-aafe-25477ed869b5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:09:30.014112 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-db82470a-13fe-4e16-aafe-25477ed869b5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:30.014651 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-db82470a-13fe-4e16-aafe-25477ed869b5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:30.015429 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-db82470a-13fe-4e16-aafe-25477ed869b5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:30.016027 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-db82470a-13fe-4e16-aafe-25477ed869b5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:30.082588 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-db82470a-13fe-4e16-aafe-25477ed869b5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.088710 Nov 23 13:09:30.083644 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 575/1179] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:09:29 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:09:30.815104 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-429aea80-aa66-40c9-9b00-153999f49481 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:09:30.815949 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-429aea80-aa66-40c9-9b00-153999f49481 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:09:30.825794 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-429aea80-aa66-40c9-9b00-153999f49481 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:30.826238 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-429aea80-aa66-40c9-9b00-153999f49481 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:30.826997 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-429aea80-aa66-40c9-9b00-153999f49481 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:30.827421 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-429aea80-aa66-40c9-9b00-153999f49481 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:31.045585 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-429aea80-aa66-40c9-9b00-153999f49481 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:09:31.054428 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-429aea80-aa66-40c9-9b00-153999f49481 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.244476 Nov 23 13:09:31.054988 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 605/1180] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:09:30 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:09:31.095477 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-50a87fd1-315b-41d9-9033-fe1ecd398ce8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:09:31.096447 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-50a87fd1-315b-41d9-9033-fe1ecd398ce8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:09:31.104230 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-50a87fd1-315b-41d9-9033-fe1ecd398ce8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:31.104791 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-50a87fd1-315b-41d9-9033-fe1ecd398ce8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:31.105578 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-50a87fd1-315b-41d9-9033-fe1ecd398ce8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:31.106013 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-50a87fd1-315b-41d9-9033-fe1ecd398ce8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:31.173160 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-50a87fd1-315b-41d9-9033-fe1ecd398ce8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.081503 Nov 23 13:09:31.173722 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 576/1181] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:09:31 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:09:32.075340 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-072d10de-4946-411d-9f10-14bd2ff8bf27 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:09:32.075903 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-072d10de-4946-411d-9f10-14bd2ff8bf27 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:09:32.083752 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-072d10de-4946-411d-9f10-14bd2ff8bf27 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:32.084195 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-072d10de-4946-411d-9f10-14bd2ff8bf27 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:32.084984 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-072d10de-4946-411d-9f10-14bd2ff8bf27 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:32.085411 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-072d10de-4946-411d-9f10-14bd2ff8bf27 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:32.185277 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-6dd8e8dd-14fc-4361-bdc2-08d8882363c4 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:09:32.186145 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-6dd8e8dd-14fc-4361-bdc2-08d8882363c4 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:09:32.189426 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8c3a1481-9693-4499-8478-a55e09a5b02f] AMQP server on 10.222.0.60:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 23 13:09:32.194704 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6dd8e8dd-14fc-4361-bdc2-08d8882363c4 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:32.195155 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6dd8e8dd-14fc-4361-bdc2-08d8882363c4 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:32.195921 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6dd8e8dd-14fc-4361-bdc2-08d8882363c4 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:32.196475 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6dd8e8dd-14fc-4361-bdc2-08d8882363c4 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:32.260588 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-6dd8e8dd-14fc-4361-bdc2-08d8882363c4 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.079171 Nov 23 13:09:32.261158 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 577/1182] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:09:32 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:09:32.288663 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-072d10de-4946-411d-9f10-14bd2ff8bf27 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:09:32.297294 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-072d10de-4946-411d-9f10-14bd2ff8bf27 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.228692 Nov 23 13:09:32.297852 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 606/1183] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:09:32 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:09:33.276745 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-479e36f8-e440-4d84-838f-192f61415230 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:09:33.278331 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-479e36f8-e440-4d84-838f-192f61415230 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:09:33.297871 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-479e36f8-e440-4d84-838f-192f61415230 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:33.298311 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-479e36f8-e440-4d84-838f-192f61415230 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:33.299072 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-479e36f8-e440-4d84-838f-192f61415230 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:33.299526 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-479e36f8-e440-4d84-838f-192f61415230 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:33.314558 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-81fe3787-cbf1-4d13-85cd-10048355889b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:09:33.315160 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-81fe3787-cbf1-4d13-85cd-10048355889b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:09:33.322987 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-81fe3787-cbf1-4d13-85cd-10048355889b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:33.323432 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-81fe3787-cbf1-4d13-85cd-10048355889b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:33.324200 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-81fe3787-cbf1-4d13-85cd-10048355889b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:33.324657 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-81fe3787-cbf1-4d13-85cd-10048355889b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:33.330735 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO oslo.messaging._drivers.impl_rabbit [-] [8c3a1481-9693-4499-8478-a55e09a5b02f] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 47870. Nov 23 13:09:33.365258 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-479e36f8-e440-4d84-838f-192f61415230 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.095083 Nov 23 13:09:33.365826 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 578/1184] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:09:33 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:09:33.603014 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-81fe3787-cbf1-4d13-85cd-10048355889b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:09:33.612266 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-81fe3787-cbf1-4d13-85cd-10048355889b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.301466 Nov 23 13:09:33.612873 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 607/1185] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:09:33 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:09:34.381693 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-7d688d4e-3c2b-434f-913e-dd3b8a027f6b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:09:34.383235 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-7d688d4e-3c2b-434f-913e-dd3b8a027f6b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:09:34.392744 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-7d688d4e-3c2b-434f-913e-dd3b8a027f6b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:34.393191 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-7d688d4e-3c2b-434f-913e-dd3b8a027f6b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:34.393958 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-7d688d4e-3c2b-434f-913e-dd3b8a027f6b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:34.394387 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-7d688d4e-3c2b-434f-913e-dd3b8a027f6b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:34.463325 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-7d688d4e-3c2b-434f-913e-dd3b8a027f6b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.088184 Nov 23 13:09:34.463861 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 579/1186] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:09:34 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 13:09:34.633846 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-1eeea700-5aaa-4790-b653-7158143edafb tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:09:34.634751 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-1eeea700-5aaa-4790-b653-7158143edafb tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:09:34.643676 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1eeea700-5aaa-4790-b653-7158143edafb tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:34.644127 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1eeea700-5aaa-4790-b653-7158143edafb tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:34.644922 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1eeea700-5aaa-4790-b653-7158143edafb tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:34.645337 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1eeea700-5aaa-4790-b653-7158143edafb tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:34.845990 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-1eeea700-5aaa-4790-b653-7158143edafb tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:09:34.854654 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-1eeea700-5aaa-4790-b653-7158143edafb tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.227350 Nov 23 13:09:34.855413 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 608/1187] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:09:34 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:09:35.478751 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-bfbf4f17-ade5-44d6-8840-72e45ff04111 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:09:35.479660 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-bfbf4f17-ade5-44d6-8840-72e45ff04111 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:09:35.489919 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-bfbf4f17-ade5-44d6-8840-72e45ff04111 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:35.490687 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-bfbf4f17-ade5-44d6-8840-72e45ff04111 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:35.491654 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-bfbf4f17-ade5-44d6-8840-72e45ff04111 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:35.492080 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-bfbf4f17-ade5-44d6-8840-72e45ff04111 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:35.562902 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-bfbf4f17-ade5-44d6-8840-72e45ff04111 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.088187 Nov 23 13:09:35.563458 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 580/1188] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:09:35 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:09:35.874447 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-c0192ee7-88e8-4710-8095-cb71518a308c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:09:35.875066 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-c0192ee7-88e8-4710-8095-cb71518a308c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:09:35.883786 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c0192ee7-88e8-4710-8095-cb71518a308c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:35.884275 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c0192ee7-88e8-4710-8095-cb71518a308c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:35.885122 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c0192ee7-88e8-4710-8095-cb71518a308c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:35.885477 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c0192ee7-88e8-4710-8095-cb71518a308c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:36.147207 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-c0192ee7-88e8-4710-8095-cb71518a308c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:09:36.157775 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-c0192ee7-88e8-4710-8095-cb71518a308c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.286992 Nov 23 13:09:36.160407 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 609/1189] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:09:35 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:09:36.575678 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-a07636f1-d0ef-4704-ae51-18cbad4bed70 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:09:36.576616 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-a07636f1-d0ef-4704-ae51-18cbad4bed70 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:09:36.584538 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a07636f1-d0ef-4704-ae51-18cbad4bed70 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:36.584979 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a07636f1-d0ef-4704-ae51-18cbad4bed70 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:36.585737 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a07636f1-d0ef-4704-ae51-18cbad4bed70 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:36.586161 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a07636f1-d0ef-4704-ae51-18cbad4bed70 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:36.650443 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-a07636f1-d0ef-4704-ae51-18cbad4bed70 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.078840 Nov 23 13:09:36.650984 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 581/1190] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:09:36 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:09:37.188154 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-81444659-5849-4370-9c0f-477fae10d780 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:09:37.188768 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-81444659-5849-4370-9c0f-477fae10d780 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:09:37.203687 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-81444659-5849-4370-9c0f-477fae10d780 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:37.204172 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-81444659-5849-4370-9c0f-477fae10d780 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:37.205154 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-81444659-5849-4370-9c0f-477fae10d780 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:37.205617 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-81444659-5849-4370-9c0f-477fae10d780 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:37.407294 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-81444659-5849-4370-9c0f-477fae10d780 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:09:37.416302 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-81444659-5849-4370-9c0f-477fae10d780 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.231985 Nov 23 13:09:37.416939 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 610/1191] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:09:37 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:09:37.666784 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-9aef79e2-b899-4332-9b31-11323107ebcc tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:09:37.668095 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-9aef79e2-b899-4332-9b31-11323107ebcc tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:09:37.676743 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-9aef79e2-b899-4332-9b31-11323107ebcc tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:37.677192 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-9aef79e2-b899-4332-9b31-11323107ebcc tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:37.677959 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-9aef79e2-b899-4332-9b31-11323107ebcc tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:37.678417 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-9aef79e2-b899-4332-9b31-11323107ebcc tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:37.746654 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-9aef79e2-b899-4332-9b31-11323107ebcc tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.086630 Nov 23 13:09:37.747212 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 582/1192] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:09:37 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:09:38.436968 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-7a8fc246-179b-4650-b658-2f051859e998 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:09:38.437516 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-7a8fc246-179b-4650-b658-2f051859e998 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:09:38.445337 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7a8fc246-179b-4650-b658-2f051859e998 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:38.445789 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7a8fc246-179b-4650-b658-2f051859e998 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:38.446553 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7a8fc246-179b-4650-b658-2f051859e998 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:38.446988 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7a8fc246-179b-4650-b658-2f051859e998 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:38.651094 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-7a8fc246-179b-4650-b658-2f051859e998 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:09:38.660105 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-7a8fc246-179b-4650-b658-2f051859e998 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.228890 Nov 23 13:09:38.660956 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 611/1193] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:09:38 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:09:38.764452 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-c4d2d25c-b43b-4c3c-8213-ad61d8f51012 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:09:38.765813 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-c4d2d25c-b43b-4c3c-8213-ad61d8f51012 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:09:38.778065 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c4d2d25c-b43b-4c3c-8213-ad61d8f51012 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:38.778994 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c4d2d25c-b43b-4c3c-8213-ad61d8f51012 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:38.780025 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c4d2d25c-b43b-4c3c-8213-ad61d8f51012 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:38.780487 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c4d2d25c-b43b-4c3c-8213-ad61d8f51012 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:38.847673 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-c4d2d25c-b43b-4c3c-8213-ad61d8f51012 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.090017 Nov 23 13:09:38.848261 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 583/1194] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:09:38 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:09:39.680156 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-53690c22-8af4-4e57-aaaf-7b37fb3750a4 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:09:39.681195 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-53690c22-8af4-4e57-aaaf-7b37fb3750a4 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:09:39.694031 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-53690c22-8af4-4e57-aaaf-7b37fb3750a4 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:39.694673 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-53690c22-8af4-4e57-aaaf-7b37fb3750a4 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:39.695981 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-53690c22-8af4-4e57-aaaf-7b37fb3750a4 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:39.696749 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-53690c22-8af4-4e57-aaaf-7b37fb3750a4 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:39.859211 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-046fcbfb-b856-4d73-bc1f-6afc1b0b4f37 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:09:39.860818 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-046fcbfb-b856-4d73-bc1f-6afc1b0b4f37 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:09:39.868567 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-046fcbfb-b856-4d73-bc1f-6afc1b0b4f37 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:39.869009 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-046fcbfb-b856-4d73-bc1f-6afc1b0b4f37 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:39.870149 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-046fcbfb-b856-4d73-bc1f-6afc1b0b4f37 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:39.870576 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-046fcbfb-b856-4d73-bc1f-6afc1b0b4f37 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:39.910945 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-53690c22-8af4-4e57-aaaf-7b37fb3750a4 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:09:39.919807 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-53690c22-8af4-4e57-aaaf-7b37fb3750a4 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.245878 Nov 23 13:09:39.920602 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 612/1195] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:09:39 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:09:39.937885 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-046fcbfb-b856-4d73-bc1f-6afc1b0b4f37 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.082649 Nov 23 13:09:39.938437 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 584/1196] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:09:39 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 13:09:40.937489 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-3b43bb01-2231-4aee-8cdf-be7066d4d441 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:09:40.938036 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-3b43bb01-2231-4aee-8cdf-be7066d4d441 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:09:40.946227 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3b43bb01-2231-4aee-8cdf-be7066d4d441 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:40.948648 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3b43bb01-2231-4aee-8cdf-be7066d4d441 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:40.949519 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3b43bb01-2231-4aee-8cdf-be7066d4d441 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:40.949954 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3b43bb01-2231-4aee-8cdf-be7066d4d441 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:40.950281 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-fbc55b1f-29f9-4223-8be8-4f6c30ff9f57 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:09:40.951299 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-fbc55b1f-29f9-4223-8be8-4f6c30ff9f57 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:09:40.959269 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-fbc55b1f-29f9-4223-8be8-4f6c30ff9f57 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:40.959867 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-fbc55b1f-29f9-4223-8be8-4f6c30ff9f57 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:40.960749 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-fbc55b1f-29f9-4223-8be8-4f6c30ff9f57 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:40.961181 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-fbc55b1f-29f9-4223-8be8-4f6c30ff9f57 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:41.025499 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-fbc55b1f-29f9-4223-8be8-4f6c30ff9f57 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.079458 Nov 23 13:09:41.026041 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 585/1197] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:09:40 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:09:41.156533 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-3b43bb01-2231-4aee-8cdf-be7066d4d441 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:09:41.165273 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-3b43bb01-2231-4aee-8cdf-be7066d4d441 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.231725 Nov 23 13:09:41.165842 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 613/1198] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:09:40 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:09:42.040024 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-99100949-fd9d-4b14-841d-04c7cc4bac00 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:09:42.041163 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-99100949-fd9d-4b14-841d-04c7cc4bac00 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:09:42.049512 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-99100949-fd9d-4b14-841d-04c7cc4bac00 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:42.049946 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-99100949-fd9d-4b14-841d-04c7cc4bac00 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:42.050698 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-99100949-fd9d-4b14-841d-04c7cc4bac00 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:42.051118 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-99100949-fd9d-4b14-841d-04c7cc4bac00 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:42.119383 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-99100949-fd9d-4b14-841d-04c7cc4bac00 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.083998 Nov 23 13:09:42.120558 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 586/1199] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:09:42 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:09:42.187014 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-ff36c64a-eb2e-4420-a666-48c07c5cfece tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:09:42.187543 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-ff36c64a-eb2e-4420-a666-48c07c5cfece tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:09:42.195309 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ff36c64a-eb2e-4420-a666-48c07c5cfece tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:42.195760 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ff36c64a-eb2e-4420-a666-48c07c5cfece tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:42.196552 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ff36c64a-eb2e-4420-a666-48c07c5cfece tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:42.196979 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ff36c64a-eb2e-4420-a666-48c07c5cfece tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:42.408911 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-ff36c64a-eb2e-4420-a666-48c07c5cfece tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:09:42.421554 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-ff36c64a-eb2e-4420-a666-48c07c5cfece tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.239841 Nov 23 13:09:42.422396 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 614/1200] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:09:42 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:09:43.135192 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-0358b537-c34a-43ab-b363-3abebae76dd2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:09:43.136706 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-0358b537-c34a-43ab-b363-3abebae76dd2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:09:43.149204 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0358b537-c34a-43ab-b363-3abebae76dd2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:43.149958 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0358b537-c34a-43ab-b363-3abebae76dd2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:43.151215 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0358b537-c34a-43ab-b363-3abebae76dd2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:43.151931 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0358b537-c34a-43ab-b363-3abebae76dd2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:43.220424 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-0358b537-c34a-43ab-b363-3abebae76dd2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.091849 Nov 23 13:09:43.220984 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 587/1201] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:09:43 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:09:43.441814 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-1e46fbfe-7268-4753-9399-c7957c2784b3 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:09:43.442494 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-1e46fbfe-7268-4753-9399-c7957c2784b3 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:09:43.452560 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1e46fbfe-7268-4753-9399-c7957c2784b3 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:43.453000 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1e46fbfe-7268-4753-9399-c7957c2784b3 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:43.453752 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1e46fbfe-7268-4753-9399-c7957c2784b3 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:43.454175 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1e46fbfe-7268-4753-9399-c7957c2784b3 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:43.677146 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-1e46fbfe-7268-4753-9399-c7957c2784b3 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:09:43.688489 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-1e46fbfe-7268-4753-9399-c7957c2784b3 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.252062 Nov 23 13:09:43.689055 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 615/1202] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:09:43 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:09:44.235011 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-631b6d3d-2aa6-4e02-af80-652b63d7ec14 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:09:44.235914 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-631b6d3d-2aa6-4e02-af80-652b63d7ec14 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:09:44.243601 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-631b6d3d-2aa6-4e02-af80-652b63d7ec14 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:44.244035 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-631b6d3d-2aa6-4e02-af80-652b63d7ec14 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:44.245161 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-631b6d3d-2aa6-4e02-af80-652b63d7ec14 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:44.245581 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-631b6d3d-2aa6-4e02-af80-652b63d7ec14 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:44.308028 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-631b6d3d-2aa6-4e02-af80-652b63d7ec14 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.078040 Nov 23 13:09:44.308650 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 588/1203] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:09:44 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:09:44.709518 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-8b815a9c-b2fa-42ae-b197-485056e171a1 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:09:44.710519 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-8b815a9c-b2fa-42ae-b197-485056e171a1 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:09:44.720633 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8b815a9c-b2fa-42ae-b197-485056e171a1 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:44.721077 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8b815a9c-b2fa-42ae-b197-485056e171a1 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:44.721840 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8b815a9c-b2fa-42ae-b197-485056e171a1 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:44.722265 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8b815a9c-b2fa-42ae-b197-485056e171a1 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:44.927066 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-8b815a9c-b2fa-42ae-b197-485056e171a1 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:09:44.936655 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-8b815a9c-b2fa-42ae-b197-485056e171a1 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.233371 Nov 23 13:09:44.937488 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 616/1204] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:09:44 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:09:45.324159 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-0200eff6-a646-48f1-bdac-bef0b438b99b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:09:45.325661 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-0200eff6-a646-48f1-bdac-bef0b438b99b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:09:45.338029 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0200eff6-a646-48f1-bdac-bef0b438b99b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:45.338771 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0200eff6-a646-48f1-bdac-bef0b438b99b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:45.340088 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0200eff6-a646-48f1-bdac-bef0b438b99b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:45.340845 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0200eff6-a646-48f1-bdac-bef0b438b99b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:45.405117 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-0200eff6-a646-48f1-bdac-bef0b438b99b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.087413 Nov 23 13:09:45.405677 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 589/1205] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:09:45 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:09:45.955213 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-9dac5c77-12d9-4af3-890b-6848f9566ae3 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:09:45.955825 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-9dac5c77-12d9-4af3-890b-6848f9566ae3 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:09:45.963693 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-9dac5c77-12d9-4af3-890b-6848f9566ae3 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:45.964549 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-9dac5c77-12d9-4af3-890b-6848f9566ae3 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:45.965315 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-9dac5c77-12d9-4af3-890b-6848f9566ae3 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:45.965981 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-9dac5c77-12d9-4af3-890b-6848f9566ae3 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:46.182835 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-9dac5c77-12d9-4af3-890b-6848f9566ae3 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:09:46.192503 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-9dac5c77-12d9-4af3-890b-6848f9566ae3 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.241410 Nov 23 13:09:46.193072 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 617/1206] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:09:45 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:09:46.421147 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-f1161b04-c39e-47d6-9203-db403bc8f79b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:09:46.422255 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-f1161b04-c39e-47d6-9203-db403bc8f79b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:09:46.431803 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f1161b04-c39e-47d6-9203-db403bc8f79b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:46.432295 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f1161b04-c39e-47d6-9203-db403bc8f79b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:46.433245 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f1161b04-c39e-47d6-9203-db403bc8f79b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:46.433774 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f1161b04-c39e-47d6-9203-db403bc8f79b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:46.500558 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-f1161b04-c39e-47d6-9203-db403bc8f79b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.085733 Nov 23 13:09:46.501094 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 590/1207] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:09:46 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:09:47.212439 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-695f743f-f018-4ddf-a903-5fb0097aee80 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:09:47.213074 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-695f743f-f018-4ddf-a903-5fb0097aee80 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:09:47.220958 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-695f743f-f018-4ddf-a903-5fb0097aee80 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:47.221411 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-695f743f-f018-4ddf-a903-5fb0097aee80 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:47.222174 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-695f743f-f018-4ddf-a903-5fb0097aee80 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:47.222705 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-695f743f-f018-4ddf-a903-5fb0097aee80 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:47.429191 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-695f743f-f018-4ddf-a903-5fb0097aee80 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:09:47.437980 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-695f743f-f018-4ddf-a903-5fb0097aee80 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.231819 Nov 23 13:09:47.438583 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 618/1208] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:09:47 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:09:47.515929 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-d64b22b4-18d4-4d22-9c67-1f8d78269eaf tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:09:47.517393 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-d64b22b4-18d4-4d22-9c67-1f8d78269eaf tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:09:47.529745 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d64b22b4-18d4-4d22-9c67-1f8d78269eaf tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:47.530559 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d64b22b4-18d4-4d22-9c67-1f8d78269eaf tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:47.531539 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d64b22b4-18d4-4d22-9c67-1f8d78269eaf tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:47.531966 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d64b22b4-18d4-4d22-9c67-1f8d78269eaf tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:47.599464 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-d64b22b4-18d4-4d22-9c67-1f8d78269eaf tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.089585 Nov 23 13:09:47.600062 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 591/1209] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:09:47 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:09:48.459511 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-db9544b2-39e0-4bd0-81df-c44224f349ce tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:09:48.460449 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-db9544b2-39e0-4bd0-81df-c44224f349ce tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:09:48.471374 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-db9544b2-39e0-4bd0-81df-c44224f349ce tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:48.471820 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-db9544b2-39e0-4bd0-81df-c44224f349ce tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:48.472631 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-db9544b2-39e0-4bd0-81df-c44224f349ce tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:48.473060 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-db9544b2-39e0-4bd0-81df-c44224f349ce tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:48.613517 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-b4cd375f-6793-4961-8735-eda66967cdd0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:09:48.614455 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-b4cd375f-6793-4961-8735-eda66967cdd0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:09:48.622821 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b4cd375f-6793-4961-8735-eda66967cdd0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:48.623461 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b4cd375f-6793-4961-8735-eda66967cdd0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:48.624371 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b4cd375f-6793-4961-8735-eda66967cdd0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:48.624814 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b4cd375f-6793-4961-8735-eda66967cdd0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:48.672858 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-db9544b2-39e0-4bd0-81df-c44224f349ce tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:09:48.681554 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-db9544b2-39e0-4bd0-81df-c44224f349ce tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.228642 Nov 23 13:09:48.682126 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 619/1210] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:09:48 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:09:48.689192 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-b4cd375f-6793-4961-8735-eda66967cdd0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.079814 Nov 23 13:09:48.692958 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 592/1211] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:09:48 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:09:49.703929 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-3057edf7-7427-4840-bb3e-698a296ae716 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:09:49.704913 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-e9b7eb9c-4204-418d-96b9-29a344e11246 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:09:49.705580 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-3057edf7-7427-4840-bb3e-698a296ae716 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:09:49.706167 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-e9b7eb9c-4204-418d-96b9-29a344e11246 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:09:49.717400 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3057edf7-7427-4840-bb3e-698a296ae716 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:49.718146 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3057edf7-7427-4840-bb3e-698a296ae716 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:49.718385 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e9b7eb9c-4204-418d-96b9-29a344e11246 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:49.718975 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e9b7eb9c-4204-418d-96b9-29a344e11246 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:49.719642 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3057edf7-7427-4840-bb3e-698a296ae716 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:49.719786 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e9b7eb9c-4204-418d-96b9-29a344e11246 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:49.720086 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3057edf7-7427-4840-bb3e-698a296ae716 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:49.720259 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e9b7eb9c-4204-418d-96b9-29a344e11246 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:49.783888 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-e9b7eb9c-4204-418d-96b9-29a344e11246 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.085631 Nov 23 13:09:49.784489 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 593/1212] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:09:49 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:09:49.925098 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-3057edf7-7427-4840-bb3e-698a296ae716 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:09:49.938464 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-3057edf7-7427-4840-bb3e-698a296ae716 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.241665 Nov 23 13:09:49.939052 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 620/1213] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:09:49 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:09:50.800088 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-5340bd94-19b3-4418-bfb6-d94ad06d7b5c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:09:50.801063 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-5340bd94-19b3-4418-bfb6-d94ad06d7b5c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:09:50.808858 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5340bd94-19b3-4418-bfb6-d94ad06d7b5c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:50.809314 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5340bd94-19b3-4418-bfb6-d94ad06d7b5c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:50.810088 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5340bd94-19b3-4418-bfb6-d94ad06d7b5c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:50.810521 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5340bd94-19b3-4418-bfb6-d94ad06d7b5c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:50.877128 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-5340bd94-19b3-4418-bfb6-d94ad06d7b5c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.082091 Nov 23 13:09:50.877725 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 594/1214] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:09:50 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:09:50.958119 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-3b2b6241-d58b-4d42-8782-d77e77785648 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:09:50.958954 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-3b2b6241-d58b-4d42-8782-d77e77785648 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:09:50.967741 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3b2b6241-d58b-4d42-8782-d77e77785648 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:50.968265 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3b2b6241-d58b-4d42-8782-d77e77785648 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:50.969162 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3b2b6241-d58b-4d42-8782-d77e77785648 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:50.969648 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3b2b6241-d58b-4d42-8782-d77e77785648 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:51.177253 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-3b2b6241-d58b-4d42-8782-d77e77785648 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:09:51.185556 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-3b2b6241-d58b-4d42-8782-d77e77785648 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.232342 Nov 23 13:09:51.186112 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 621/1215] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:09:50 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:09:51.893260 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-e62757ec-7b80-4910-bd12-59a0e3dc60d5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:09:51.894698 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-e62757ec-7b80-4910-bd12-59a0e3dc60d5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:09:51.906811 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e62757ec-7b80-4910-bd12-59a0e3dc60d5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:51.907259 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e62757ec-7b80-4910-bd12-59a0e3dc60d5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:51.908052 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e62757ec-7b80-4910-bd12-59a0e3dc60d5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:51.908542 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e62757ec-7b80-4910-bd12-59a0e3dc60d5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:51.978417 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-e62757ec-7b80-4910-bd12-59a0e3dc60d5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.091700 Nov 23 13:09:51.978953 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 595/1216] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:09:51 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:09:52.206664 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-2a8d6ccd-b115-4485-9048-527ef033f9f9 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:09:52.207565 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-2a8d6ccd-b115-4485-9048-527ef033f9f9 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:09:52.219746 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2a8d6ccd-b115-4485-9048-527ef033f9f9 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:52.220200 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2a8d6ccd-b115-4485-9048-527ef033f9f9 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:52.221049 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2a8d6ccd-b115-4485-9048-527ef033f9f9 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:52.221479 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2a8d6ccd-b115-4485-9048-527ef033f9f9 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:52.432684 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-2a8d6ccd-b115-4485-9048-527ef033f9f9 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:09:52.446637 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-2a8d6ccd-b115-4485-9048-527ef033f9f9 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.246104 Nov 23 13:09:52.447407 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 622/1217] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:09:52 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:09:52.991869 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-61b161c2-21e3-4732-a69e-521898a37700 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:09:52.992951 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-61b161c2-21e3-4732-a69e-521898a37700 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:09:53.001871 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-61b161c2-21e3-4732-a69e-521898a37700 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:53.002351 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-61b161c2-21e3-4732-a69e-521898a37700 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:53.003206 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-61b161c2-21e3-4732-a69e-521898a37700 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:53.003666 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-61b161c2-21e3-4732-a69e-521898a37700 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:53.068225 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-61b161c2-21e3-4732-a69e-521898a37700 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.081109 Nov 23 13:09:53.069011 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 596/1218] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:09:52 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:09:53.469560 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-4b846efa-05a3-4567-ac53-332c0ecd1a64 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:09:53.470154 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-4b846efa-05a3-4567-ac53-332c0ecd1a64 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:09:53.479005 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-4b846efa-05a3-4567-ac53-332c0ecd1a64 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:53.479494 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-4b846efa-05a3-4567-ac53-332c0ecd1a64 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:53.480403 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-4b846efa-05a3-4567-ac53-332c0ecd1a64 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:53.480870 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-4b846efa-05a3-4567-ac53-332c0ecd1a64 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:53.687335 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-4b846efa-05a3-4567-ac53-332c0ecd1a64 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:09:53.696017 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-4b846efa-05a3-4567-ac53-332c0ecd1a64 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.233054 Nov 23 13:09:53.696629 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 623/1219] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:09:53 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:09:54.082991 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-461cbfe5-1920-4045-9181-70eedd3cfa0a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:09:54.084077 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-461cbfe5-1920-4045-9181-70eedd3cfa0a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:09:54.093341 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-461cbfe5-1920-4045-9181-70eedd3cfa0a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:54.093887 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-461cbfe5-1920-4045-9181-70eedd3cfa0a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:54.094780 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-461cbfe5-1920-4045-9181-70eedd3cfa0a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:54.095208 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-461cbfe5-1920-4045-9181-70eedd3cfa0a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:54.159639 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-461cbfe5-1920-4045-9181-70eedd3cfa0a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.081776 Nov 23 13:09:54.160309 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 597/1220] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:09:54 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:09:54.717747 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-7dccdd7c-29e4-46bf-b99c-b11b6ec847fc tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:09:54.718707 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-7dccdd7c-29e4-46bf-b99c-b11b6ec847fc tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:09:54.731999 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7dccdd7c-29e4-46bf-b99c-b11b6ec847fc tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:54.732805 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7dccdd7c-29e4-46bf-b99c-b11b6ec847fc tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:54.734070 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7dccdd7c-29e4-46bf-b99c-b11b6ec847fc tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:54.734960 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7dccdd7c-29e4-46bf-b99c-b11b6ec847fc tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:54.946326 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-7dccdd7c-29e4-46bf-b99c-b11b6ec847fc tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:09:54.958878 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-7dccdd7c-29e4-46bf-b99c-b11b6ec847fc tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.247182 Nov 23 13:09:54.959706 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 624/1221] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:09:54 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:09:55.176226 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-df2fd8f0-9b64-4e90-b60d-12f90efc1883 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:09:55.177822 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-df2fd8f0-9b64-4e90-b60d-12f90efc1883 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:09:55.189343 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-df2fd8f0-9b64-4e90-b60d-12f90efc1883 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:55.189808 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-df2fd8f0-9b64-4e90-b60d-12f90efc1883 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:55.190562 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-df2fd8f0-9b64-4e90-b60d-12f90efc1883 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:55.190986 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-df2fd8f0-9b64-4e90-b60d-12f90efc1883 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:55.254658 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-df2fd8f0-9b64-4e90-b60d-12f90efc1883 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.085155 Nov 23 13:09:55.255203 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 598/1222] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:09:55 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:09:55.976555 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-2ae67f0e-74f2-41be-baf7-295c59edc5bb tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:09:55.977262 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-2ae67f0e-74f2-41be-baf7-295c59edc5bb tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:09:55.985704 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2ae67f0e-74f2-41be-baf7-295c59edc5bb tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:55.986211 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2ae67f0e-74f2-41be-baf7-295c59edc5bb tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:55.986982 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2ae67f0e-74f2-41be-baf7-295c59edc5bb tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:55.987417 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2ae67f0e-74f2-41be-baf7-295c59edc5bb tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:56.251186 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-2ae67f0e-74f2-41be-baf7-295c59edc5bb tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:09:56.264306 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-2ae67f0e-74f2-41be-baf7-295c59edc5bb tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.291236 Nov 23 13:09:56.265031 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 625/1223] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:09:55 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:09:56.267880 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-3a27fb08-8554-4ef6-97e6-141c073e0a0f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:09:56.268823 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-3a27fb08-8554-4ef6-97e6-141c073e0a0f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:09:56.276535 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-3a27fb08-8554-4ef6-97e6-141c073e0a0f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:56.276988 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-3a27fb08-8554-4ef6-97e6-141c073e0a0f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:56.277771 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-3a27fb08-8554-4ef6-97e6-141c073e0a0f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:56.278201 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-3a27fb08-8554-4ef6-97e6-141c073e0a0f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:56.345820 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-3a27fb08-8554-4ef6-97e6-141c073e0a0f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.082911 Nov 23 13:09:56.346371 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 599/1224] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:09:56 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:09:57.282490 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-d7064101-6b2b-4f9b-8eef-91752bf7034e tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:09:57.283080 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-d7064101-6b2b-4f9b-8eef-91752bf7034e tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:09:57.290785 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d7064101-6b2b-4f9b-8eef-91752bf7034e tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:57.291235 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d7064101-6b2b-4f9b-8eef-91752bf7034e tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:57.292011 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d7064101-6b2b-4f9b-8eef-91752bf7034e tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:57.292454 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d7064101-6b2b-4f9b-8eef-91752bf7034e tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:57.357765 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-a8cf7e27-6a01-46f1-9a5a-6dd84c14e7e8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:09:57.358701 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-a8cf7e27-6a01-46f1-9a5a-6dd84c14e7e8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:09:57.366675 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a8cf7e27-6a01-46f1-9a5a-6dd84c14e7e8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:57.367119 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a8cf7e27-6a01-46f1-9a5a-6dd84c14e7e8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:57.367898 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a8cf7e27-6a01-46f1-9a5a-6dd84c14e7e8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:57.368362 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a8cf7e27-6a01-46f1-9a5a-6dd84c14e7e8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:57.498019 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-d7064101-6b2b-4f9b-8eef-91752bf7034e tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:09:57.507183 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-d7064101-6b2b-4f9b-8eef-91752bf7034e tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.228633 Nov 23 13:09:57.507858 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 626/1225] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:09:57 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:09:57.582752 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-a8cf7e27-6a01-46f1-9a5a-6dd84c14e7e8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.228782 Nov 23 13:09:57.583294 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 600/1226] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:09:57 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:09:58.528823 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-59896975-4447-4b14-bacf-7c2c9b3e55dd tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:09:58.529775 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-59896975-4447-4b14-bacf-7c2c9b3e55dd tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:09:58.542865 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-59896975-4447-4b14-bacf-7c2c9b3e55dd tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:58.543621 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-59896975-4447-4b14-bacf-7c2c9b3e55dd tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:58.544939 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-59896975-4447-4b14-bacf-7c2c9b3e55dd tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:58.545657 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-59896975-4447-4b14-bacf-7c2c9b3e55dd tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:58.594989 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-ad37abc8-65ec-4f6a-aef4-d5d4f87ee780 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:09:58.595902 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-ad37abc8-65ec-4f6a-aef4-d5d4f87ee780 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:09:58.603771 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ad37abc8-65ec-4f6a-aef4-d5d4f87ee780 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:58.604441 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ad37abc8-65ec-4f6a-aef4-d5d4f87ee780 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:58.605201 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ad37abc8-65ec-4f6a-aef4-d5d4f87ee780 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:58.605640 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ad37abc8-65ec-4f6a-aef4-d5d4f87ee780 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:58.669128 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-ad37abc8-65ec-4f6a-aef4-d5d4f87ee780 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.078247 Nov 23 13:09:58.669707 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 601/1227] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:09:58 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:09:58.759408 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-59896975-4447-4b14-bacf-7c2c9b3e55dd tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:09:58.770625 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-59896975-4447-4b14-bacf-7c2c9b3e55dd tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.247914 Nov 23 13:09:58.771383 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 627/1228] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:09:58 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:09:59.684961 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-54116eaa-7b4b-4702-9436-d5bdc0d157e2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:09:59.686432 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-54116eaa-7b4b-4702-9436-d5bdc0d157e2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:09:59.694944 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-54116eaa-7b4b-4702-9436-d5bdc0d157e2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:59.695405 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-54116eaa-7b4b-4702-9436-d5bdc0d157e2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:59.696176 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-54116eaa-7b4b-4702-9436-d5bdc0d157e2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:59.696648 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-54116eaa-7b4b-4702-9436-d5bdc0d157e2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:59.762621 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-54116eaa-7b4b-4702-9436-d5bdc0d157e2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.084174 Nov 23 13:09:59.763170 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 602/1229] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:09:59 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:09:59.793116 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-cb8d7e78-ab1e-4c66-90b1-2e28f84b3362 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:09:59.793705 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-cb8d7e78-ab1e-4c66-90b1-2e28f84b3362 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:09:59.801851 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-cb8d7e78-ab1e-4c66-90b1-2e28f84b3362 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:59.802309 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-cb8d7e78-ab1e-4c66-90b1-2e28f84b3362 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:59.803075 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-cb8d7e78-ab1e-4c66-90b1-2e28f84b3362 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:09:59.803507 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-cb8d7e78-ab1e-4c66-90b1-2e28f84b3362 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:09:59.999223 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-cb8d7e78-ab1e-4c66-90b1-2e28f84b3362 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:10:00.008001 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-cb8d7e78-ab1e-4c66-90b1-2e28f84b3362 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.220551 Nov 23 13:10:00.008592 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 628/1230] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:09:59 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:10:00.780005 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-778886c7-76f5-4fe3-a0ca-c957231c5ce8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:10:00.781483 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-778886c7-76f5-4fe3-a0ca-c957231c5ce8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:10:00.793833 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-778886c7-76f5-4fe3-a0ca-c957231c5ce8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:00.794576 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-778886c7-76f5-4fe3-a0ca-c957231c5ce8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:00.795830 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-778886c7-76f5-4fe3-a0ca-c957231c5ce8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:00.796591 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-778886c7-76f5-4fe3-a0ca-c957231c5ce8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:00.860576 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-778886c7-76f5-4fe3-a0ca-c957231c5ce8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.086282 Nov 23 13:10:00.861284 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 603/1231] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:10:00 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:10:01.032093 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-04faac37-3548-4d70-ba84-a17d314d3889 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:10:01.032760 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-04faac37-3548-4d70-ba84-a17d314d3889 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:10:01.040642 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-04faac37-3548-4d70-ba84-a17d314d3889 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:01.041095 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-04faac37-3548-4d70-ba84-a17d314d3889 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:01.041878 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-04faac37-3548-4d70-ba84-a17d314d3889 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:01.042294 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-04faac37-3548-4d70-ba84-a17d314d3889 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:01.252784 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-04faac37-3548-4d70-ba84-a17d314d3889 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:10:01.261852 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-04faac37-3548-4d70-ba84-a17d314d3889 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.236232 Nov 23 13:10:01.262466 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 629/1232] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:10:01 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:10:01.871821 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-84ec4c89-3d79-489f-bd9f-96022efa43a2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:10:01.872861 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-84ec4c89-3d79-489f-bd9f-96022efa43a2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:10:01.881917 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-84ec4c89-3d79-489f-bd9f-96022efa43a2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:01.882369 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-84ec4c89-3d79-489f-bd9f-96022efa43a2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:01.883159 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-84ec4c89-3d79-489f-bd9f-96022efa43a2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:01.883594 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-84ec4c89-3d79-489f-bd9f-96022efa43a2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:01.947616 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-84ec4c89-3d79-489f-bd9f-96022efa43a2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.080139 Nov 23 13:10:01.948173 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 604/1233] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:10:01 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:10:02.284010 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-012fc3f4-3384-4f71-b0cd-ae070badec50 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:10:02.285029 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-012fc3f4-3384-4f71-b0cd-ae070badec50 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:10:02.297729 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-012fc3f4-3384-4f71-b0cd-ae070badec50 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:02.298177 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-012fc3f4-3384-4f71-b0cd-ae070badec50 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:02.298977 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-012fc3f4-3384-4f71-b0cd-ae070badec50 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:02.299411 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-012fc3f4-3384-4f71-b0cd-ae070badec50 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:02.510309 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-012fc3f4-3384-4f71-b0cd-ae070badec50 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:10:02.518665 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-012fc3f4-3384-4f71-b0cd-ae070badec50 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.241180 Nov 23 13:10:02.519232 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 630/1234] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:10:02 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:10:02.963353 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-58076190-809f-4bb8-84cc-96853943a281 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:10:02.965856 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-58076190-809f-4bb8-84cc-96853943a281 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:10:02.976077 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-58076190-809f-4bb8-84cc-96853943a281 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:02.977319 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-58076190-809f-4bb8-84cc-96853943a281 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:02.978788 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-58076190-809f-4bb8-84cc-96853943a281 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:02.979410 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-58076190-809f-4bb8-84cc-96853943a281 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:03.052830 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-58076190-809f-4bb8-84cc-96853943a281 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.095359 Nov 23 13:10:03.053397 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 605/1235] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:10:02 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:10:03.539815 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-0fc558ec-f723-481c-9f34-957a58575f95 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:10:03.540824 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-0fc558ec-f723-481c-9f34-957a58575f95 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:10:03.551108 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0fc558ec-f723-481c-9f34-957a58575f95 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:03.553116 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0fc558ec-f723-481c-9f34-957a58575f95 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:03.553116 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0fc558ec-f723-481c-9f34-957a58575f95 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:03.553116 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0fc558ec-f723-481c-9f34-957a58575f95 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:03.753778 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-0fc558ec-f723-481c-9f34-957a58575f95 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:10:03.762398 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-0fc558ec-f723-481c-9f34-957a58575f95 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.228945 Nov 23 13:10:03.763049 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 631/1236] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:10:03 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:10:04.065481 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-be837fac-7a79-4b60-9b7f-5de68ad8b64c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:10:04.066376 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-be837fac-7a79-4b60-9b7f-5de68ad8b64c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:10:04.075296 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-be837fac-7a79-4b60-9b7f-5de68ad8b64c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:04.075970 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-be837fac-7a79-4b60-9b7f-5de68ad8b64c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:04.077243 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-be837fac-7a79-4b60-9b7f-5de68ad8b64c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:04.077894 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-be837fac-7a79-4b60-9b7f-5de68ad8b64c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:04.151449 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-be837fac-7a79-4b60-9b7f-5de68ad8b64c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.090258 Nov 23 13:10:04.151936 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 606/1237] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:10:04 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:10:04.778759 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-601c80bf-95dd-4224-84e5-0a1115cf1ec3 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:10:04.779434 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-601c80bf-95dd-4224-84e5-0a1115cf1ec3 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:10:04.787397 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-601c80bf-95dd-4224-84e5-0a1115cf1ec3 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:04.787846 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-601c80bf-95dd-4224-84e5-0a1115cf1ec3 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:04.788659 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-601c80bf-95dd-4224-84e5-0a1115cf1ec3 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:04.789073 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-601c80bf-95dd-4224-84e5-0a1115cf1ec3 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:05.003006 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-601c80bf-95dd-4224-84e5-0a1115cf1ec3 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:10:05.015891 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-601c80bf-95dd-4224-84e5-0a1115cf1ec3 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.240610 Nov 23 13:10:05.016630 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 632/1238] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:10:04 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:10:05.167423 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-4a427f67-7ae3-443b-a2c5-9441a5f09622 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:10:05.168920 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-4a427f67-7ae3-443b-a2c5-9441a5f09622 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:10:05.178046 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4a427f67-7ae3-443b-a2c5-9441a5f09622 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:05.178498 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4a427f67-7ae3-443b-a2c5-9441a5f09622 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:05.179264 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4a427f67-7ae3-443b-a2c5-9441a5f09622 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:05.179700 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4a427f67-7ae3-443b-a2c5-9441a5f09622 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:05.242591 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-4a427f67-7ae3-443b-a2c5-9441a5f09622 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.081543 Nov 23 13:10:05.243127 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 607/1239] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:10:05 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:10:06.037399 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-2c7938c0-9a5d-4e26-9621-8b413b880668 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:10:06.038567 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-2c7938c0-9a5d-4e26-9621-8b413b880668 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:10:06.050072 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2c7938c0-9a5d-4e26-9621-8b413b880668 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:06.050542 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2c7938c0-9a5d-4e26-9621-8b413b880668 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:06.051316 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2c7938c0-9a5d-4e26-9621-8b413b880668 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:06.051749 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2c7938c0-9a5d-4e26-9621-8b413b880668 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:06.251186 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-2c7938c0-9a5d-4e26-9621-8b413b880668 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:10:06.256788 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-ad9ae5f3-7cdd-48db-adf6-04f03343f385 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:10:06.257697 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-ad9ae5f3-7cdd-48db-adf6-04f03343f385 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:10:06.259556 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-2c7938c0-9a5d-4e26-9621-8b413b880668 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.228659 Nov 23 13:10:06.260335 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 633/1240] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:10:06 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:10:06.265330 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ad9ae5f3-7cdd-48db-adf6-04f03343f385 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:06.265785 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ad9ae5f3-7cdd-48db-adf6-04f03343f385 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:06.266554 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ad9ae5f3-7cdd-48db-adf6-04f03343f385 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:06.266959 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ad9ae5f3-7cdd-48db-adf6-04f03343f385 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:06.335921 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-ad9ae5f3-7cdd-48db-adf6-04f03343f385 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.082823 Nov 23 13:10:06.336408 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 608/1241] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:10:06 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:10:07.277146 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-a1ace2ff-47d0-4075-aa1e-626deaf080cd tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:10:07.277747 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-a1ace2ff-47d0-4075-aa1e-626deaf080cd tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:10:07.286004 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a1ace2ff-47d0-4075-aa1e-626deaf080cd tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:07.286472 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a1ace2ff-47d0-4075-aa1e-626deaf080cd tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:07.287268 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a1ace2ff-47d0-4075-aa1e-626deaf080cd tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:07.287694 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a1ace2ff-47d0-4075-aa1e-626deaf080cd tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:07.348606 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-6e51f388-c0d9-4545-aff7-9b7baa2fa63a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:10:07.349523 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-6e51f388-c0d9-4545-aff7-9b7baa2fa63a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:10:07.357080 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6e51f388-c0d9-4545-aff7-9b7baa2fa63a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:07.357537 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6e51f388-c0d9-4545-aff7-9b7baa2fa63a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:07.358341 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6e51f388-c0d9-4545-aff7-9b7baa2fa63a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:07.358762 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6e51f388-c0d9-4545-aff7-9b7baa2fa63a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:07.423658 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-6e51f388-c0d9-4545-aff7-9b7baa2fa63a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.079963 Nov 23 13:10:07.424187 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 609/1242] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:10:07 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:10:07.496277 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-a1ace2ff-47d0-4075-aa1e-626deaf080cd tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:10:07.505373 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-a1ace2ff-47d0-4075-aa1e-626deaf080cd tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.232035 Nov 23 13:10:07.506034 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 634/1243] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:10:07 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:10:08.436390 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-73eb623e-4b3c-4661-81fc-2cda23c1dfdb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:10:08.437298 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-73eb623e-4b3c-4661-81fc-2cda23c1dfdb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:10:08.447662 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-73eb623e-4b3c-4661-81fc-2cda23c1dfdb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:08.448287 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-73eb623e-4b3c-4661-81fc-2cda23c1dfdb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:08.449439 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-73eb623e-4b3c-4661-81fc-2cda23c1dfdb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:08.450039 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-73eb623e-4b3c-4661-81fc-2cda23c1dfdb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:08.522730 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-ca0f32fa-bbfa-4d5a-9fb6-d0bb50c89f71 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:10:08.523513 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-ca0f32fa-bbfa-4d5a-9fb6-d0bb50c89f71 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:10:08.525869 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-73eb623e-4b3c-4661-81fc-2cda23c1dfdb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.093760 Nov 23 13:10:08.526481 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 610/1244] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:10:08 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:10:08.533580 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ca0f32fa-bbfa-4d5a-9fb6-d0bb50c89f71 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:08.534016 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ca0f32fa-bbfa-4d5a-9fb6-d0bb50c89f71 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:08.534780 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ca0f32fa-bbfa-4d5a-9fb6-d0bb50c89f71 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:08.535202 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ca0f32fa-bbfa-4d5a-9fb6-d0bb50c89f71 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:08.748566 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-ca0f32fa-bbfa-4d5a-9fb6-d0bb50c89f71 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:10:08.757367 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-ca0f32fa-bbfa-4d5a-9fb6-d0bb50c89f71 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.238702 Nov 23 13:10:08.757935 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 635/1245] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:10:08 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:10:09.544064 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-b3086744-2559-46ed-8aeb-b2568c58d4ea tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:10:09.545640 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-b3086744-2559-46ed-8aeb-b2568c58d4ea tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:10:09.554761 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b3086744-2559-46ed-8aeb-b2568c58d4ea tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:09.555212 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b3086744-2559-46ed-8aeb-b2568c58d4ea tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:09.555974 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b3086744-2559-46ed-8aeb-b2568c58d4ea tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:09.556451 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b3086744-2559-46ed-8aeb-b2568c58d4ea tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:09.620193 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-b3086744-2559-46ed-8aeb-b2568c58d4ea tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.082309 Nov 23 13:10:09.620786 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 611/1246] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:10:09 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:10:09.777471 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-639e1c7e-4661-4ce4-ae1f-4e97d1504ce7 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:10:09.778193 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-639e1c7e-4661-4ce4-ae1f-4e97d1504ce7 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:10:09.787748 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-639e1c7e-4661-4ce4-ae1f-4e97d1504ce7 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:09.788280 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-639e1c7e-4661-4ce4-ae1f-4e97d1504ce7 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:09.789191 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-639e1c7e-4661-4ce4-ae1f-4e97d1504ce7 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:09.789696 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-639e1c7e-4661-4ce4-ae1f-4e97d1504ce7 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:10.004811 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-639e1c7e-4661-4ce4-ae1f-4e97d1504ce7 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:10:10.013762 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-639e1c7e-4661-4ce4-ae1f-4e97d1504ce7 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.242214 Nov 23 13:10:10.014329 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 636/1247] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:10:09 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:10:10.636963 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-22358d2d-8554-4a51-af37-6763c5999fb4 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:10:10.638434 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-22358d2d-8554-4a51-af37-6763c5999fb4 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:10:10.650849 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-22358d2d-8554-4a51-af37-6763c5999fb4 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:10.651493 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-22358d2d-8554-4a51-af37-6763c5999fb4 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:10.652807 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-22358d2d-8554-4a51-af37-6763c5999fb4 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:10.653530 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-22358d2d-8554-4a51-af37-6763c5999fb4 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:10.718820 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-22358d2d-8554-4a51-af37-6763c5999fb4 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.088541 Nov 23 13:10:10.719370 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 612/1248] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:10:10 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:10:11.035412 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-8bb428c6-9a81-431d-bcc5-21c27f6c2393 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:10:11.036437 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-8bb428c6-9a81-431d-bcc5-21c27f6c2393 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:10:11.049014 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8bb428c6-9a81-431d-bcc5-21c27f6c2393 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:11.049714 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8bb428c6-9a81-431d-bcc5-21c27f6c2393 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:11.050928 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8bb428c6-9a81-431d-bcc5-21c27f6c2393 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:11.051365 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8bb428c6-9a81-431d-bcc5-21c27f6c2393 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:11.280544 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-8bb428c6-9a81-431d-bcc5-21c27f6c2393 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:10:11.289495 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-8bb428c6-9a81-431d-bcc5-21c27f6c2393 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.260485 Nov 23 13:10:11.290002 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 637/1249] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:10:11 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:10:11.735795 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-9d89c415-3442-42a7-8602-95f4c8752011 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:10:11.736974 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-9d89c415-3442-42a7-8602-95f4c8752011 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:10:11.745147 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-9d89c415-3442-42a7-8602-95f4c8752011 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:11.745590 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-9d89c415-3442-42a7-8602-95f4c8752011 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:11.746337 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-9d89c415-3442-42a7-8602-95f4c8752011 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:11.746763 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-9d89c415-3442-42a7-8602-95f4c8752011 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:11.810542 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-9d89c415-3442-42a7-8602-95f4c8752011 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.081366 Nov 23 13:10:11.811119 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 613/1250] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:10:11 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:10:12.309922 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-0aef6fa9-fbd4-4be0-a2bb-e8b17dfc63a4 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:10:12.310807 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-0aef6fa9-fbd4-4be0-a2bb-e8b17dfc63a4 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:10:12.319556 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0aef6fa9-fbd4-4be0-a2bb-e8b17dfc63a4 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:12.320002 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0aef6fa9-fbd4-4be0-a2bb-e8b17dfc63a4 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:12.320791 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0aef6fa9-fbd4-4be0-a2bb-e8b17dfc63a4 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:12.321213 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0aef6fa9-fbd4-4be0-a2bb-e8b17dfc63a4 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:12.524257 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-0aef6fa9-fbd4-4be0-a2bb-e8b17dfc63a4 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:10:12.533889 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-0aef6fa9-fbd4-4be0-a2bb-e8b17dfc63a4 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.229009 Nov 23 13:10:12.534789 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 638/1251] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:10:12 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:10:12.822434 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-57e0e84d-a7da-43c9-b557-426c52e8c5b1 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:10:12.823297 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-57e0e84d-a7da-43c9-b557-426c52e8c5b1 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:10:12.831144 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-57e0e84d-a7da-43c9-b557-426c52e8c5b1 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:12.831578 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-57e0e84d-a7da-43c9-b557-426c52e8c5b1 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:12.832355 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-57e0e84d-a7da-43c9-b557-426c52e8c5b1 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:12.832780 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-57e0e84d-a7da-43c9-b557-426c52e8c5b1 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:12.902410 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-57e0e84d-a7da-43c9-b557-426c52e8c5b1 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.083912 Nov 23 13:10:12.902980 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 614/1252] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:10:12 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:10:13.550679 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-7553d1a5-7332-441d-88c9-aa38dbc97489 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:10:13.551295 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-7553d1a5-7332-441d-88c9-aa38dbc97489 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:10:13.559109 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7553d1a5-7332-441d-88c9-aa38dbc97489 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:13.559538 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7553d1a5-7332-441d-88c9-aa38dbc97489 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:13.560361 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7553d1a5-7332-441d-88c9-aa38dbc97489 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:13.560790 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7553d1a5-7332-441d-88c9-aa38dbc97489 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:13.773879 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-7553d1a5-7332-441d-88c9-aa38dbc97489 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:10:13.782806 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-7553d1a5-7332-441d-88c9-aa38dbc97489 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.236277 Nov 23 13:10:13.783441 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 639/1253] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:10:13 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:10:13.919017 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-a080196a-4a9b-490e-a3e8-e4deb0220154 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:10:13.920584 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-a080196a-4a9b-490e-a3e8-e4deb0220154 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:10:13.929522 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a080196a-4a9b-490e-a3e8-e4deb0220154 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:13.929980 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a080196a-4a9b-490e-a3e8-e4deb0220154 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:13.930746 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a080196a-4a9b-490e-a3e8-e4deb0220154 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:13.931180 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a080196a-4a9b-490e-a3e8-e4deb0220154 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:13.995334 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-a080196a-4a9b-490e-a3e8-e4deb0220154 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.082963 Nov 23 13:10:13.995914 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 615/1254] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:10:13 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:10:14.800267 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-0986a55a-ffee-4c07-a23b-1ff0922fa2af tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:10:14.801526 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-0986a55a-ffee-4c07-a23b-1ff0922fa2af tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:10:14.809340 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0986a55a-ffee-4c07-a23b-1ff0922fa2af tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:14.809577 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0986a55a-ffee-4c07-a23b-1ff0922fa2af tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:14.810392 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0986a55a-ffee-4c07-a23b-1ff0922fa2af tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:14.810807 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0986a55a-ffee-4c07-a23b-1ff0922fa2af tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:15.007227 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-298b6ffb-203b-4a69-a1b5-deea5dac51d7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:10:15.008250 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-298b6ffb-203b-4a69-a1b5-deea5dac51d7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:10:15.009711 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-0986a55a-ffee-4c07-a23b-1ff0922fa2af tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:10:15.016168 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-298b6ffb-203b-4a69-a1b5-deea5dac51d7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:15.016664 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-298b6ffb-203b-4a69-a1b5-deea5dac51d7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:15.017549 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-298b6ffb-203b-4a69-a1b5-deea5dac51d7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:15.018017 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-298b6ffb-203b-4a69-a1b5-deea5dac51d7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:15.018495 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-0986a55a-ffee-4c07-a23b-1ff0922fa2af tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.222334 Nov 23 13:10:15.019077 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 640/1255] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:10:14 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:10:15.083103 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-298b6ffb-203b-4a69-a1b5-deea5dac51d7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.079655 Nov 23 13:10:15.083698 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 616/1256] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:10:15 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:10:16.039026 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-c200c010-4d5c-4b1d-ac14-87f97a48e397 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:10:16.040219 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-c200c010-4d5c-4b1d-ac14-87f97a48e397 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:10:16.053123 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c200c010-4d5c-4b1d-ac14-87f97a48e397 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:16.053870 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c200c010-4d5c-4b1d-ac14-87f97a48e397 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:16.055151 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c200c010-4d5c-4b1d-ac14-87f97a48e397 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:16.055850 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c200c010-4d5c-4b1d-ac14-87f97a48e397 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:16.101268 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-ed307b7c-9626-4674-a37b-e2285240f4e0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:10:16.102464 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-ed307b7c-9626-4674-a37b-e2285240f4e0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:10:16.110225 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ed307b7c-9626-4674-a37b-e2285240f4e0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:16.110749 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ed307b7c-9626-4674-a37b-e2285240f4e0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:16.111828 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ed307b7c-9626-4674-a37b-e2285240f4e0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:16.112286 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ed307b7c-9626-4674-a37b-e2285240f4e0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:16.177913 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-ed307b7c-9626-4674-a37b-e2285240f4e0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.082417 Nov 23 13:10:16.178465 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 617/1257] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:10:16 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 13:10:16.260976 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-c200c010-4d5c-4b1d-ac14-87f97a48e397 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:10:16.269709 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-c200c010-4d5c-4b1d-ac14-87f97a48e397 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.237106 Nov 23 13:10:16.270278 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 641/1258] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:10:16 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:10:17.194371 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-0bc79fb6-7b92-4cb4-a1ab-d512ddb46a7f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:10:17.195728 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-0bc79fb6-7b92-4cb4-a1ab-d512ddb46a7f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:10:17.207418 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0bc79fb6-7b92-4cb4-a1ab-d512ddb46a7f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:17.207865 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0bc79fb6-7b92-4cb4-a1ab-d512ddb46a7f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:17.208646 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0bc79fb6-7b92-4cb4-a1ab-d512ddb46a7f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:17.209013 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0bc79fb6-7b92-4cb4-a1ab-d512ddb46a7f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:17.276455 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-0bc79fb6-7b92-4cb4-a1ab-d512ddb46a7f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.089326 Nov 23 13:10:17.280417 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 618/1259] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:10:17 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:10:17.286821 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-3ddf81ca-2370-40e8-b256-b3d25bf8188d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:10:17.287407 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-3ddf81ca-2370-40e8-b256-b3d25bf8188d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:10:17.295596 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3ddf81ca-2370-40e8-b256-b3d25bf8188d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:17.296074 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3ddf81ca-2370-40e8-b256-b3d25bf8188d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:17.296874 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3ddf81ca-2370-40e8-b256-b3d25bf8188d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:17.297306 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3ddf81ca-2370-40e8-b256-b3d25bf8188d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:17.511786 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-3ddf81ca-2370-40e8-b256-b3d25bf8188d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:10:17.525294 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-3ddf81ca-2370-40e8-b256-b3d25bf8188d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.242336 Nov 23 13:10:17.526608 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 642/1260] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:10:17 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:10:18.295970 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-2ba094c5-2146-442a-a21a-1c1296b8e676 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:10:18.297501 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-2ba094c5-2146-442a-a21a-1c1296b8e676 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:10:18.310316 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-2ba094c5-2146-442a-a21a-1c1296b8e676 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:18.311066 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-2ba094c5-2146-442a-a21a-1c1296b8e676 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:18.312329 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-2ba094c5-2146-442a-a21a-1c1296b8e676 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:18.313101 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-2ba094c5-2146-442a-a21a-1c1296b8e676 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:18.378072 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-2ba094c5-2146-442a-a21a-1c1296b8e676 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.088645 Nov 23 13:10:18.378624 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 619/1261] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:10:18 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:10:18.548931 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-4a500040-17bf-428b-b752-d6ad9ebdb637 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:10:18.549699 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-4a500040-17bf-428b-b752-d6ad9ebdb637 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:10:18.557569 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-4a500040-17bf-428b-b752-d6ad9ebdb637 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:18.558026 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-4a500040-17bf-428b-b752-d6ad9ebdb637 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:18.558794 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-4a500040-17bf-428b-b752-d6ad9ebdb637 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:18.559220 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-4a500040-17bf-428b-b752-d6ad9ebdb637 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:18.768386 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-4a500040-17bf-428b-b752-d6ad9ebdb637 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:10:18.777121 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-4a500040-17bf-428b-b752-d6ad9ebdb637 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.234947 Nov 23 13:10:18.777700 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 643/1262] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:10:18 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:10:19.393738 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-f6322627-e124-4c9f-bfe0-557477503168 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:10:19.394780 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-f6322627-e124-4c9f-bfe0-557477503168 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:10:19.403764 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f6322627-e124-4c9f-bfe0-557477503168 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:19.404464 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f6322627-e124-4c9f-bfe0-557477503168 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:19.405355 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f6322627-e124-4c9f-bfe0-557477503168 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:19.405851 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f6322627-e124-4c9f-bfe0-557477503168 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:19.472472 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-f6322627-e124-4c9f-bfe0-557477503168 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.084888 Nov 23 13:10:19.472970 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 620/1263] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:10:19 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:10:19.799186 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-6065848f-c064-4283-8ef7-fb1edf257f9d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:10:19.800199 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-6065848f-c064-4283-8ef7-fb1edf257f9d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:10:19.812632 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-6065848f-c064-4283-8ef7-fb1edf257f9d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:19.813368 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-6065848f-c064-4283-8ef7-fb1edf257f9d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:19.814722 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-6065848f-c064-4283-8ef7-fb1edf257f9d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:19.815149 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-6065848f-c064-4283-8ef7-fb1edf257f9d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:20.087210 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-6065848f-c064-4283-8ef7-fb1edf257f9d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:10:20.096274 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-6065848f-c064-4283-8ef7-fb1edf257f9d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.303787 Nov 23 13:10:20.096875 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 644/1264] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:10:19 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:10:20.487749 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-7ff25f0e-b0b0-4df3-89c1-dd58167e3895 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:10:20.488724 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-7ff25f0e-b0b0-4df3-89c1-dd58167e3895 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:10:20.498123 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-7ff25f0e-b0b0-4df3-89c1-dd58167e3895 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:20.498642 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-7ff25f0e-b0b0-4df3-89c1-dd58167e3895 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:20.499517 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-7ff25f0e-b0b0-4df3-89c1-dd58167e3895 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:20.500014 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-7ff25f0e-b0b0-4df3-89c1-dd58167e3895 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:20.566350 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-7ff25f0e-b0b0-4df3-89c1-dd58167e3895 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.084659 Nov 23 13:10:20.566908 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 621/1265] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:10:20 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:10:21.117722 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-f5914d2b-b8f5-4c05-9d35-88d659d7dfa8 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:10:21.118782 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-f5914d2b-b8f5-4c05-9d35-88d659d7dfa8 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:10:21.132446 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f5914d2b-b8f5-4c05-9d35-88d659d7dfa8 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:21.133188 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f5914d2b-b8f5-4c05-9d35-88d659d7dfa8 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:21.134463 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f5914d2b-b8f5-4c05-9d35-88d659d7dfa8 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:21.135172 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f5914d2b-b8f5-4c05-9d35-88d659d7dfa8 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:21.345125 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-f5914d2b-b8f5-4c05-9d35-88d659d7dfa8 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:10:21.354144 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-f5914d2b-b8f5-4c05-9d35-88d659d7dfa8 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.242783 Nov 23 13:10:21.354949 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 645/1266] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:10:21 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:10:21.582562 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-29951756-1650-4264-a512-c2411fd8e53b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:10:21.584001 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-29951756-1650-4264-a512-c2411fd8e53b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:10:21.596282 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-29951756-1650-4264-a512-c2411fd8e53b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:21.596738 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-29951756-1650-4264-a512-c2411fd8e53b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:21.597494 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-29951756-1650-4264-a512-c2411fd8e53b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:21.597923 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-29951756-1650-4264-a512-c2411fd8e53b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:21.665841 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-29951756-1650-4264-a512-c2411fd8e53b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.089865 Nov 23 13:10:21.666312 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 622/1267] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:10:21 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:10:22.374639 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-7afc6d7a-6d66-4c25-b95e-6afe0bd46c51 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:10:22.375209 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-7afc6d7a-6d66-4c25-b95e-6afe0bd46c51 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:10:22.383281 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7afc6d7a-6d66-4c25-b95e-6afe0bd46c51 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:22.383727 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7afc6d7a-6d66-4c25-b95e-6afe0bd46c51 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:22.384536 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7afc6d7a-6d66-4c25-b95e-6afe0bd46c51 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:22.384963 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7afc6d7a-6d66-4c25-b95e-6afe0bd46c51 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:22.581264 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-7afc6d7a-6d66-4c25-b95e-6afe0bd46c51 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:10:22.589695 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-7afc6d7a-6d66-4c25-b95e-6afe0bd46c51 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.221574 Nov 23 13:10:22.590410 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 646/1268] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:10:22 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:10:22.681764 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-9583b7a6-a902-49af-aab9-d2f47b2d852f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:10:22.683231 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-9583b7a6-a902-49af-aab9-d2f47b2d852f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:10:22.693549 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-9583b7a6-a902-49af-aab9-d2f47b2d852f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:22.694009 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-9583b7a6-a902-49af-aab9-d2f47b2d852f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:22.694802 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-9583b7a6-a902-49af-aab9-d2f47b2d852f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:22.695286 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-9583b7a6-a902-49af-aab9-d2f47b2d852f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:22.760127 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-9583b7a6-a902-49af-aab9-d2f47b2d852f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.084853 Nov 23 13:10:22.760736 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 623/1269] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:10:22 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:10:23.606818 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-4dbc0f92-05b6-49e0-99fd-d9ea5f879749 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:10:23.607457 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-4dbc0f92-05b6-49e0-99fd-d9ea5f879749 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:10:23.615141 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-4dbc0f92-05b6-49e0-99fd-d9ea5f879749 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:23.615494 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-4dbc0f92-05b6-49e0-99fd-d9ea5f879749 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:23.616370 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-4dbc0f92-05b6-49e0-99fd-d9ea5f879749 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:23.616802 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-4dbc0f92-05b6-49e0-99fd-d9ea5f879749 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:23.773522 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-e103e62f-29be-4177-89f7-3b38db56de0c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:10:23.774436 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-e103e62f-29be-4177-89f7-3b38db56de0c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:10:23.782168 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e103e62f-29be-4177-89f7-3b38db56de0c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:23.782660 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e103e62f-29be-4177-89f7-3b38db56de0c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:23.783593 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e103e62f-29be-4177-89f7-3b38db56de0c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:23.784015 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e103e62f-29be-4177-89f7-3b38db56de0c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:23.831946 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-4dbc0f92-05b6-49e0-99fd-d9ea5f879749 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:10:23.843200 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-4dbc0f92-05b6-49e0-99fd-d9ea5f879749 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.240022 Nov 23 13:10:23.843772 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 647/1270] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:10:23 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:10:23.848866 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-e103e62f-29be-4177-89f7-3b38db56de0c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.079847 Nov 23 13:10:23.851261 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 624/1271] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:10:23 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:10:24.862847 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-8c1649a7-1ffe-4195-beb9-9ac25213917a tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:10:24.863529 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-8c1649a7-1ffe-4195-beb9-9ac25213917a tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:10:24.865016 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-96695d4d-92c1-4353-9312-0e10e16b43fd tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:10:24.866243 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-96695d4d-92c1-4353-9312-0e10e16b43fd tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:10:24.872853 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8c1649a7-1ffe-4195-beb9-9ac25213917a tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:24.873304 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8c1649a7-1ffe-4195-beb9-9ac25213917a tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:24.874068 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8c1649a7-1ffe-4195-beb9-9ac25213917a tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:24.874316 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-96695d4d-92c1-4353-9312-0e10e16b43fd tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:24.874509 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8c1649a7-1ffe-4195-beb9-9ac25213917a tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:24.874766 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-96695d4d-92c1-4353-9312-0e10e16b43fd tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:24.875545 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-96695d4d-92c1-4353-9312-0e10e16b43fd tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:24.875975 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-96695d4d-92c1-4353-9312-0e10e16b43fd tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:24.940013 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-96695d4d-92c1-4353-9312-0e10e16b43fd tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.082744 Nov 23 13:10:24.940658 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 625/1272] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:10:24 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:10:25.085273 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-8c1649a7-1ffe-4195-beb9-9ac25213917a tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:10:25.095086 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-8c1649a7-1ffe-4195-beb9-9ac25213917a tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.237703 Nov 23 13:10:25.095685 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 648/1273] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:10:24 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:10:25.953576 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-0c935972-4cbf-4900-b875-55b267b293e0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:10:25.954406 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-0c935972-4cbf-4900-b875-55b267b293e0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:10:25.962645 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0c935972-4cbf-4900-b875-55b267b293e0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:25.963091 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0c935972-4cbf-4900-b875-55b267b293e0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:25.963855 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0c935972-4cbf-4900-b875-55b267b293e0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:25.964273 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0c935972-4cbf-4900-b875-55b267b293e0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:26.031459 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-0c935972-4cbf-4900-b875-55b267b293e0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.081907 Nov 23 13:10:26.032023 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 626/1274] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:10:25 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:10:26.121863 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-7e4ac906-9ac4-4a14-9715-c957c050d29c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:10:26.122512 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-7e4ac906-9ac4-4a14-9715-c957c050d29c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:10:26.132391 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7e4ac906-9ac4-4a14-9715-c957c050d29c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:26.132846 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7e4ac906-9ac4-4a14-9715-c957c050d29c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:26.133601 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7e4ac906-9ac4-4a14-9715-c957c050d29c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:26.134034 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7e4ac906-9ac4-4a14-9715-c957c050d29c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:26.350208 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-7e4ac906-9ac4-4a14-9715-c957c050d29c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:10:26.363014 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-7e4ac906-9ac4-4a14-9715-c957c050d29c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.247281 Nov 23 13:10:26.363563 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 649/1275] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:10:26 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:10:27.047555 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-19d3ba4f-5fc0-484d-8373-8270d891504f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:10:27.049054 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-19d3ba4f-5fc0-484d-8373-8270d891504f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:10:27.061596 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-19d3ba4f-5fc0-484d-8373-8270d891504f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:27.062330 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-19d3ba4f-5fc0-484d-8373-8270d891504f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:27.063592 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-19d3ba4f-5fc0-484d-8373-8270d891504f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:27.064306 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-19d3ba4f-5fc0-484d-8373-8270d891504f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:27.129019 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-19d3ba4f-5fc0-484d-8373-8270d891504f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.087893 Nov 23 13:10:27.129560 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 627/1276] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:10:27 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:10:27.384828 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-1edfd90f-5d8d-4737-9902-760b93faa24e tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:10:27.385768 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-1edfd90f-5d8d-4737-9902-760b93faa24e tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:10:27.396637 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1edfd90f-5d8d-4737-9902-760b93faa24e tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:27.397076 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1edfd90f-5d8d-4737-9902-760b93faa24e tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:27.397829 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1edfd90f-5d8d-4737-9902-760b93faa24e tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:27.398249 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1edfd90f-5d8d-4737-9902-760b93faa24e tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:27.598292 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-1edfd90f-5d8d-4737-9902-760b93faa24e tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:10:27.610540 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-1edfd90f-5d8d-4737-9902-760b93faa24e tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.232133 Nov 23 13:10:27.611155 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 650/1277] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:10:27 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:10:28.147240 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-4d7bd707-b45e-408b-9d08-17bbc5bfa583 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:10:28.148861 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-4d7bd707-b45e-408b-9d08-17bbc5bfa583 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:10:28.161209 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4d7bd707-b45e-408b-9d08-17bbc5bfa583 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:28.161946 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4d7bd707-b45e-408b-9d08-17bbc5bfa583 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:28.163249 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4d7bd707-b45e-408b-9d08-17bbc5bfa583 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:28.163960 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4d7bd707-b45e-408b-9d08-17bbc5bfa583 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:28.233278 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-4d7bd707-b45e-408b-9d08-17bbc5bfa583 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.092885 Nov 23 13:10:28.233823 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 628/1278] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:10:28 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:10:28.632529 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-7cdd0f2e-ddf6-499a-9f48-325c3039728c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:10:28.633530 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-7cdd0f2e-ddf6-499a-9f48-325c3039728c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:10:28.645225 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7cdd0f2e-ddf6-499a-9f48-325c3039728c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:28.645668 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7cdd0f2e-ddf6-499a-9f48-325c3039728c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:28.646429 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7cdd0f2e-ddf6-499a-9f48-325c3039728c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:28.646836 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7cdd0f2e-ddf6-499a-9f48-325c3039728c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:28.867581 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-7cdd0f2e-ddf6-499a-9f48-325c3039728c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:10:28.881381 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-7cdd0f2e-ddf6-499a-9f48-325c3039728c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.255265 Nov 23 13:10:28.882214 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 651/1279] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:10:28 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:10:29.246880 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-24462855-4906-40bf-a767-26f28257e32a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:10:29.247972 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-24462855-4906-40bf-a767-26f28257e32a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:10:29.257181 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-24462855-4906-40bf-a767-26f28257e32a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:29.257643 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-24462855-4906-40bf-a767-26f28257e32a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:29.258404 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-24462855-4906-40bf-a767-26f28257e32a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:29.258836 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-24462855-4906-40bf-a767-26f28257e32a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:29.334277 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-24462855-4906-40bf-a767-26f28257e32a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.092367 Nov 23 13:10:29.334841 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 629/1280] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:10:29 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:10:29.899132 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-2dc68f18-bb70-487b-ab44-b5f2c250424d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:10:29.899728 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-2dc68f18-bb70-487b-ab44-b5f2c250424d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:10:29.907446 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2dc68f18-bb70-487b-ab44-b5f2c250424d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:29.907973 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2dc68f18-bb70-487b-ab44-b5f2c250424d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:29.908889 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2dc68f18-bb70-487b-ab44-b5f2c250424d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:29.909529 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2dc68f18-bb70-487b-ab44-b5f2c250424d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:30.258023 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-2dc68f18-bb70-487b-ab44-b5f2c250424d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:10:30.266663 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-2dc68f18-bb70-487b-ab44-b5f2c250424d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.371301 Nov 23 13:10:30.267257 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 652/1281] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:10:29 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:10:30.310356 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 13:10:30.310826 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: Tue Nov 23 13:10:30 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 23 13:10:30.346693 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-5a616331-d6c4-4d3b-a70c-7b8e4c4b71be tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:10:30.347878 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-5a616331-d6c4-4d3b-a70c-7b8e4c4b71be tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:10:30.355579 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5a616331-d6c4-4d3b-a70c-7b8e4c4b71be tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:30.356143 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5a616331-d6c4-4d3b-a70c-7b8e4c4b71be tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:30.357078 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5a616331-d6c4-4d3b-a70c-7b8e4c4b71be tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:30.357601 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5a616331-d6c4-4d3b-a70c-7b8e4c4b71be tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:30.426254 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-5a616331-d6c4-4d3b-a70c-7b8e4c4b71be tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.083677 Nov 23 13:10:30.426833 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 630/1282] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:10:30 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:10:31.284575 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-2e155344-bb39-4075-b7e5-c24000c55106 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:10:31.285226 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-2e155344-bb39-4075-b7e5-c24000c55106 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:10:31.293997 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2e155344-bb39-4075-b7e5-c24000c55106 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:31.294448 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2e155344-bb39-4075-b7e5-c24000c55106 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:31.295243 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2e155344-bb39-4075-b7e5-c24000c55106 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:31.295669 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2e155344-bb39-4075-b7e5-c24000c55106 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:31.438595 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-60fbc297-c94a-4ed8-ad34-a446b01d5190 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:10:31.439724 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-60fbc297-c94a-4ed8-ad34-a446b01d5190 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:10:31.450631 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-60fbc297-c94a-4ed8-ad34-a446b01d5190 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:31.450631 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-60fbc297-c94a-4ed8-ad34-a446b01d5190 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:31.450631 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-60fbc297-c94a-4ed8-ad34-a446b01d5190 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:31.450631 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-60fbc297-c94a-4ed8-ad34-a446b01d5190 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:31.517070 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-60fbc297-c94a-4ed8-ad34-a446b01d5190 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.082426 Nov 23 13:10:31.517621 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 631/1283] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:10:31 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:10:31.586208 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-2e155344-bb39-4075-b7e5-c24000c55106 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:10:31.594802 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-2e155344-bb39-4075-b7e5-c24000c55106 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.314342 Nov 23 13:10:31.595385 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 653/1284] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:10:31 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:10:32.529306 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-c22d4ac7-7b47-4fa7-ac70-8ee1c18ea3e0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:10:32.530246 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-c22d4ac7-7b47-4fa7-ac70-8ee1c18ea3e0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:10:32.537982 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c22d4ac7-7b47-4fa7-ac70-8ee1c18ea3e0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:32.538427 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c22d4ac7-7b47-4fa7-ac70-8ee1c18ea3e0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:32.539191 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c22d4ac7-7b47-4fa7-ac70-8ee1c18ea3e0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:32.539621 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c22d4ac7-7b47-4fa7-ac70-8ee1c18ea3e0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:32.603433 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-c22d4ac7-7b47-4fa7-ac70-8ee1c18ea3e0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.078155 Nov 23 13:10:32.603987 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 632/1285] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:10:32 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:10:32.610934 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-dc268823-fd46-429e-a331-e1985424329d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:10:32.611537 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-dc268823-fd46-429e-a331-e1985424329d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:10:32.619994 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-dc268823-fd46-429e-a331-e1985424329d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:32.620470 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-dc268823-fd46-429e-a331-e1985424329d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:32.621243 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-dc268823-fd46-429e-a331-e1985424329d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:32.621667 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-dc268823-fd46-429e-a331-e1985424329d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:32.838447 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-dc268823-fd46-429e-a331-e1985424329d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:10:32.847075 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-dc268823-fd46-429e-a331-e1985424329d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.239935 Nov 23 13:10:32.847742 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 654/1286] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:10:32 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:10:33.614467 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-80633fdd-aeeb-4d67-a163-dde6e92ce8fa tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:10:33.615397 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-80633fdd-aeeb-4d67-a163-dde6e92ce8fa tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:10:33.623314 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-80633fdd-aeeb-4d67-a163-dde6e92ce8fa tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:33.623759 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-80633fdd-aeeb-4d67-a163-dde6e92ce8fa tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:33.624534 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-80633fdd-aeeb-4d67-a163-dde6e92ce8fa tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:33.624958 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-80633fdd-aeeb-4d67-a163-dde6e92ce8fa tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:33.688171 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-80633fdd-aeeb-4d67-a163-dde6e92ce8fa tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.077576 Nov 23 13:10:33.688755 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 633/1287] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:10:33 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:10:33.864554 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-1df60a98-5118-4eee-b359-f27297a70480 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:10:33.865118 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-1df60a98-5118-4eee-b359-f27297a70480 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:10:33.873560 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1df60a98-5118-4eee-b359-f27297a70480 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:33.874000 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1df60a98-5118-4eee-b359-f27297a70480 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:33.874756 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1df60a98-5118-4eee-b359-f27297a70480 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:33.875198 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1df60a98-5118-4eee-b359-f27297a70480 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:34.078511 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-1df60a98-5118-4eee-b359-f27297a70480 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:10:34.087391 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-1df60a98-5118-4eee-b359-f27297a70480 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.226881 Nov 23 13:10:34.087985 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 655/1288] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:10:33 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:10:34.699252 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-73fd480e-4ff7-4437-9f25-ca104df45b8e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:10:34.700067 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-73fd480e-4ff7-4437-9f25-ca104df45b8e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:10:34.708131 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-73fd480e-4ff7-4437-9f25-ca104df45b8e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:34.708815 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-73fd480e-4ff7-4437-9f25-ca104df45b8e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:34.709608 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-73fd480e-4ff7-4437-9f25-ca104df45b8e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:34.710043 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-73fd480e-4ff7-4437-9f25-ca104df45b8e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:34.776873 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-73fd480e-4ff7-4437-9f25-ca104df45b8e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.081586 Nov 23 13:10:34.777416 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 634/1289] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:10:34 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:10:35.113983 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-6fe434e6-a063-47a5-a9bb-f29a2733b572 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:10:35.115259 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-6fe434e6-a063-47a5-a9bb-f29a2733b572 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:10:35.128171 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-6fe434e6-a063-47a5-a9bb-f29a2733b572 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:35.128970 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-6fe434e6-a063-47a5-a9bb-f29a2733b572 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:35.130196 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-6fe434e6-a063-47a5-a9bb-f29a2733b572 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:35.130624 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-6fe434e6-a063-47a5-a9bb-f29a2733b572 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:35.345580 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-6fe434e6-a063-47a5-a9bb-f29a2733b572 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:10:35.356918 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-6fe434e6-a063-47a5-a9bb-f29a2733b572 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.249074 Nov 23 13:10:35.357672 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 656/1290] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:10:35 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:10:35.789159 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-83cbc599-227e-4278-a2a5-b469cc6ed360 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:10:35.790479 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-83cbc599-227e-4278-a2a5-b469cc6ed360 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:10:35.803311 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-83cbc599-227e-4278-a2a5-b469cc6ed360 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:35.804068 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-83cbc599-227e-4278-a2a5-b469cc6ed360 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:35.805498 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-83cbc599-227e-4278-a2a5-b469cc6ed360 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:35.806282 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-83cbc599-227e-4278-a2a5-b469cc6ed360 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:35.918876 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-83cbc599-227e-4278-a2a5-b469cc6ed360 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.134168 Nov 23 13:10:35.919435 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 635/1291] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:10:35 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:10:36.376218 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-26d6c47f-0bf6-404d-8ce2-3b3c0f44a388 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:10:36.376861 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-26d6c47f-0bf6-404d-8ce2-3b3c0f44a388 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:10:36.387381 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-26d6c47f-0bf6-404d-8ce2-3b3c0f44a388 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:36.388113 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-26d6c47f-0bf6-404d-8ce2-3b3c0f44a388 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:36.389275 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-26d6c47f-0bf6-404d-8ce2-3b3c0f44a388 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:36.389989 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-26d6c47f-0bf6-404d-8ce2-3b3c0f44a388 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:36.595367 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-26d6c47f-0bf6-404d-8ce2-3b3c0f44a388 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:10:36.604659 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-26d6c47f-0bf6-404d-8ce2-3b3c0f44a388 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.232610 Nov 23 13:10:36.605285 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 657/1292] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:10:36 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:10:36.931379 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-948d9371-fadc-4af7-a8d4-9d3de038a290 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:10:36.932446 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-948d9371-fadc-4af7-a8d4-9d3de038a290 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:10:36.940494 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-948d9371-fadc-4af7-a8d4-9d3de038a290 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:36.941038 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-948d9371-fadc-4af7-a8d4-9d3de038a290 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:36.941827 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-948d9371-fadc-4af7-a8d4-9d3de038a290 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:36.942225 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-948d9371-fadc-4af7-a8d4-9d3de038a290 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:37.006290 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-948d9371-fadc-4af7-a8d4-9d3de038a290 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.078813 Nov 23 13:10:37.007057 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 636/1293] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:10:36 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:10:37.626959 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-fa23651d-b015-4648-9048-1ec2a77bac66 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:10:37.627949 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-fa23651d-b015-4648-9048-1ec2a77bac66 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:10:37.641099 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-fa23651d-b015-4648-9048-1ec2a77bac66 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:37.641850 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-fa23651d-b015-4648-9048-1ec2a77bac66 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:37.643122 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-fa23651d-b015-4648-9048-1ec2a77bac66 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:37.643838 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-fa23651d-b015-4648-9048-1ec2a77bac66 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:37.857593 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-fa23651d-b015-4648-9048-1ec2a77bac66 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:10:37.866383 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-fa23651d-b015-4648-9048-1ec2a77bac66 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.246008 Nov 23 13:10:37.867281 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 658/1294] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:10:37 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:10:38.018304 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-bb8ba976-8714-47c3-8d63-98274237598c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:10:38.019389 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-bb8ba976-8714-47c3-8d63-98274237598c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:10:38.028079 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-bb8ba976-8714-47c3-8d63-98274237598c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:38.028362 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-bb8ba976-8714-47c3-8d63-98274237598c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:38.029161 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-bb8ba976-8714-47c3-8d63-98274237598c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:38.029598 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-bb8ba976-8714-47c3-8d63-98274237598c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:38.099568 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-bb8ba976-8714-47c3-8d63-98274237598c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.085196 Nov 23 13:10:38.100228 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 637/1295] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:10:38 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:10:38.887946 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-4712ee31-b904-4065-afe8-019c4814404c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:10:38.888961 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-4712ee31-b904-4065-afe8-019c4814404c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:10:38.900667 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-4712ee31-b904-4065-afe8-019c4814404c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:38.901125 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-4712ee31-b904-4065-afe8-019c4814404c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:38.901971 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-4712ee31-b904-4065-afe8-019c4814404c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:38.902454 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-4712ee31-b904-4065-afe8-019c4814404c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:39.097653 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-4712ee31-b904-4065-afe8-019c4814404c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:10:39.105995 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-4712ee31-b904-4065-afe8-019c4814404c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.224623 Nov 23 13:10:39.115843 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 659/1296] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:10:38 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:10:39.116266 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-f6ac5e1d-5853-4943-bc0f-1379a8315e88 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:10:39.116266 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-f6ac5e1d-5853-4943-bc0f-1379a8315e88 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:10:39.120009 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f6ac5e1d-5853-4943-bc0f-1379a8315e88 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:39.120491 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f6ac5e1d-5853-4943-bc0f-1379a8315e88 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:39.121288 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f6ac5e1d-5853-4943-bc0f-1379a8315e88 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:39.121720 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f6ac5e1d-5853-4943-bc0f-1379a8315e88 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:39.188634 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-f6ac5e1d-5853-4943-bc0f-1379a8315e88 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.081319 Nov 23 13:10:39.189185 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 638/1297] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:10:39 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 13:10:40.123571 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-f6f36697-bd1c-4350-8f78-1fca2f44f46c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:10:40.124143 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-f6f36697-bd1c-4350-8f78-1fca2f44f46c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:10:40.131674 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f6f36697-bd1c-4350-8f78-1fca2f44f46c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:40.132129 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f6f36697-bd1c-4350-8f78-1fca2f44f46c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:40.132924 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f6f36697-bd1c-4350-8f78-1fca2f44f46c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:40.133345 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f6f36697-bd1c-4350-8f78-1fca2f44f46c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:40.199954 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-fe170517-a5e9-42e3-b45b-b58bfb4761fb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:10:40.201559 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-fe170517-a5e9-42e3-b45b-b58bfb4761fb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:10:40.208873 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-fe170517-a5e9-42e3-b45b-b58bfb4761fb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:40.209364 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-fe170517-a5e9-42e3-b45b-b58bfb4761fb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:40.210127 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-fe170517-a5e9-42e3-b45b-b58bfb4761fb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:40.210545 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-fe170517-a5e9-42e3-b45b-b58bfb4761fb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:40.279806 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-fe170517-a5e9-42e3-b45b-b58bfb4761fb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.083553 Nov 23 13:10:40.280396 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 639/1298] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:10:40 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:10:40.348616 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-f6f36697-bd1c-4350-8f78-1fca2f44f46c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:10:40.357720 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-f6f36697-bd1c-4350-8f78-1fca2f44f46c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.238280 Nov 23 13:10:40.358260 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 660/1299] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:10:40 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:10:41.291710 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-e0a2e9b2-6e36-4626-be1e-70dc7ef68b76 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:10:41.292891 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-e0a2e9b2-6e36-4626-be1e-70dc7ef68b76 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:10:41.300750 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e0a2e9b2-6e36-4626-be1e-70dc7ef68b76 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:41.301217 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e0a2e9b2-6e36-4626-be1e-70dc7ef68b76 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:41.302005 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e0a2e9b2-6e36-4626-be1e-70dc7ef68b76 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:41.302439 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e0a2e9b2-6e36-4626-be1e-70dc7ef68b76 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:41.365301 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-e0a2e9b2-6e36-4626-be1e-70dc7ef68b76 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.077718 Nov 23 13:10:41.365995 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 640/1300] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:10:41 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:10:41.377476 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-4e213ecd-370e-425a-be14-5308a2ea5253 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:10:41.378055 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-4e213ecd-370e-425a-be14-5308a2ea5253 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:10:41.385790 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-4e213ecd-370e-425a-be14-5308a2ea5253 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:41.386232 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-4e213ecd-370e-425a-be14-5308a2ea5253 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:41.386992 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-4e213ecd-370e-425a-be14-5308a2ea5253 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:41.387418 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-4e213ecd-370e-425a-be14-5308a2ea5253 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:41.604920 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-4e213ecd-370e-425a-be14-5308a2ea5253 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:10:41.613437 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-4e213ecd-370e-425a-be14-5308a2ea5253 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.239737 Nov 23 13:10:41.614004 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 661/1301] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:10:41 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:10:42.377618 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-6f0e6770-149a-45ae-b29b-ee1ca2699ee5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:10:42.378545 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-6f0e6770-149a-45ae-b29b-ee1ca2699ee5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:10:42.386276 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6f0e6770-149a-45ae-b29b-ee1ca2699ee5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:42.386714 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6f0e6770-149a-45ae-b29b-ee1ca2699ee5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:42.387472 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6f0e6770-149a-45ae-b29b-ee1ca2699ee5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:42.387885 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6f0e6770-149a-45ae-b29b-ee1ca2699ee5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:42.451226 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-6f0e6770-149a-45ae-b29b-ee1ca2699ee5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.077472 Nov 23 13:10:42.451978 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 641/1302] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:10:42 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:10:42.633133 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-b22e2023-4f00-4b45-999a-590ff25ac246 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:10:42.633695 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-b22e2023-4f00-4b45-999a-590ff25ac246 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:10:42.641717 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b22e2023-4f00-4b45-999a-590ff25ac246 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:42.642170 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b22e2023-4f00-4b45-999a-590ff25ac246 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:42.642960 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b22e2023-4f00-4b45-999a-590ff25ac246 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:42.643392 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b22e2023-4f00-4b45-999a-590ff25ac246 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:42.847721 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-b22e2023-4f00-4b45-999a-590ff25ac246 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:10:42.856441 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-b22e2023-4f00-4b45-999a-590ff25ac246 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.227186 Nov 23 13:10:42.857035 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 662/1303] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:10:42 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:10:43.463014 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-bc78e961-a768-4f01-9f43-46b2b358f33a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:10:43.463945 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-bc78e961-a768-4f01-9f43-46b2b358f33a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:10:43.471767 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-bc78e961-a768-4f01-9f43-46b2b358f33a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:43.472150 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-bc78e961-a768-4f01-9f43-46b2b358f33a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:43.472957 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-bc78e961-a768-4f01-9f43-46b2b358f33a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:43.473395 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-bc78e961-a768-4f01-9f43-46b2b358f33a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:43.542516 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-bc78e961-a768-4f01-9f43-46b2b358f33a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.083309 Nov 23 13:10:43.543094 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 642/1304] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:10:43 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:10:43.874427 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-228d833c-9606-4745-96f4-b2b614379a4e tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:10:43.875044 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-228d833c-9606-4745-96f4-b2b614379a4e tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:10:43.885466 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-228d833c-9606-4745-96f4-b2b614379a4e tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:43.885934 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-228d833c-9606-4745-96f4-b2b614379a4e tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:43.886685 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-228d833c-9606-4745-96f4-b2b614379a4e tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:43.887103 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-228d833c-9606-4745-96f4-b2b614379a4e tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:44.105090 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-228d833c-9606-4745-96f4-b2b614379a4e tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:10:44.114247 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-228d833c-9606-4745-96f4-b2b614379a4e tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.243633 Nov 23 13:10:44.114833 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 663/1305] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:10:43 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:10:44.554251 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-baf13137-c30c-454a-b030-989dc8185a65 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:10:44.555465 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-baf13137-c30c-454a-b030-989dc8185a65 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:10:44.563486 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-baf13137-c30c-454a-b030-989dc8185a65 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:44.563935 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-baf13137-c30c-454a-b030-989dc8185a65 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:44.564740 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-baf13137-c30c-454a-b030-989dc8185a65 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:44.565194 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-baf13137-c30c-454a-b030-989dc8185a65 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:44.634620 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-baf13137-c30c-454a-b030-989dc8185a65 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.084299 Nov 23 13:10:44.635196 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 643/1306] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:10:44 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:10:45.136437 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-f9cf91b1-3660-4155-9924-61cb7b171eac tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:10:45.137310 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-f9cf91b1-3660-4155-9924-61cb7b171eac tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:10:45.149451 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f9cf91b1-3660-4155-9924-61cb7b171eac tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:45.149899 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f9cf91b1-3660-4155-9924-61cb7b171eac tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:45.150667 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f9cf91b1-3660-4155-9924-61cb7b171eac tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:45.151094 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f9cf91b1-3660-4155-9924-61cb7b171eac tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:45.368272 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-f9cf91b1-3660-4155-9924-61cb7b171eac tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:10:45.377528 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-f9cf91b1-3660-4155-9924-61cb7b171eac tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.247969 Nov 23 13:10:45.378141 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 664/1307] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:10:45 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:10:45.646466 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-92ddf527-2914-4ecd-bf09-d42f55174aec tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:10:45.647387 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-92ddf527-2914-4ecd-bf09-d42f55174aec tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:10:45.655213 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-92ddf527-2914-4ecd-bf09-d42f55174aec tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:45.655660 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-92ddf527-2914-4ecd-bf09-d42f55174aec tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:45.656467 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-92ddf527-2914-4ecd-bf09-d42f55174aec tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:45.657063 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-92ddf527-2914-4ecd-bf09-d42f55174aec tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:45.722133 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-92ddf527-2914-4ecd-bf09-d42f55174aec tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.079539 Nov 23 13:10:45.722965 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 644/1308] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:10:45 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:10:46.400542 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-8c325d66-6682-4cb2-818b-179825ba5d77 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:10:46.401542 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-8c325d66-6682-4cb2-818b-179825ba5d77 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:10:46.414144 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8c325d66-6682-4cb2-818b-179825ba5d77 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:46.414759 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8c325d66-6682-4cb2-818b-179825ba5d77 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:46.415524 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8c325d66-6682-4cb2-818b-179825ba5d77 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:46.415958 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8c325d66-6682-4cb2-818b-179825ba5d77 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:46.619652 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-8c325d66-6682-4cb2-818b-179825ba5d77 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:10:46.628223 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-8c325d66-6682-4cb2-818b-179825ba5d77 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.234045 Nov 23 13:10:46.628821 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 665/1309] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:10:46 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:10:46.734468 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-18a3a84a-3cb0-4d14-99f1-07bd2f810f41 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:10:46.735671 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-18a3a84a-3cb0-4d14-99f1-07bd2f810f41 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:10:46.743188 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-18a3a84a-3cb0-4d14-99f1-07bd2f810f41 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:46.743724 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-18a3a84a-3cb0-4d14-99f1-07bd2f810f41 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:46.744922 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-18a3a84a-3cb0-4d14-99f1-07bd2f810f41 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:46.745349 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-18a3a84a-3cb0-4d14-99f1-07bd2f810f41 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:46.809055 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-18a3a84a-3cb0-4d14-99f1-07bd2f810f41 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.078846 Nov 23 13:10:46.809876 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 645/1310] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:10:46 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:10:47.649693 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-46b77fdd-09cb-45f6-8b69-65e5f78133e3 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:10:47.650670 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-46b77fdd-09cb-45f6-8b69-65e5f78133e3 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:10:47.663070 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-46b77fdd-09cb-45f6-8b69-65e5f78133e3 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:47.663804 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-46b77fdd-09cb-45f6-8b69-65e5f78133e3 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:47.664910 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-46b77fdd-09cb-45f6-8b69-65e5f78133e3 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:47.665334 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-46b77fdd-09cb-45f6-8b69-65e5f78133e3 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:47.823382 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-c4e3b020-b165-415c-9987-4ddf4074315e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:10:47.824716 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-c4e3b020-b165-415c-9987-4ddf4074315e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:10:47.835356 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c4e3b020-b165-415c-9987-4ddf4074315e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:47.836294 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c4e3b020-b165-415c-9987-4ddf4074315e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:47.837277 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c4e3b020-b165-415c-9987-4ddf4074315e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:47.838052 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c4e3b020-b165-415c-9987-4ddf4074315e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:47.884185 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-46b77fdd-09cb-45f6-8b69-65e5f78133e3 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:10:47.892621 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-46b77fdd-09cb-45f6-8b69-65e5f78133e3 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.249186 Nov 23 13:10:47.893188 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 666/1311] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:10:47 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:10:47.911855 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-c4e3b020-b165-415c-9987-4ddf4074315e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.094415 Nov 23 13:10:47.912424 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 646/1312] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:10:47 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:10:48.910153 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-4595bcd6-8af4-4acd-a7b7-fec39ef733ae tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:10:48.910710 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-4595bcd6-8af4-4acd-a7b7-fec39ef733ae tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:10:48.918206 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-4595bcd6-8af4-4acd-a7b7-fec39ef733ae tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:48.918652 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-4595bcd6-8af4-4acd-a7b7-fec39ef733ae tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:48.919390 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-4595bcd6-8af4-4acd-a7b7-fec39ef733ae tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:48.920037 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-4595bcd6-8af4-4acd-a7b7-fec39ef733ae tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:48.923008 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-fddac342-aac4-4f91-a918-f44e4bb01cc5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:10:48.923928 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-fddac342-aac4-4f91-a918-f44e4bb01cc5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:10:48.931689 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-fddac342-aac4-4f91-a918-f44e4bb01cc5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:48.932147 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-fddac342-aac4-4f91-a918-f44e4bb01cc5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:48.932934 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-fddac342-aac4-4f91-a918-f44e4bb01cc5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:48.933993 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-fddac342-aac4-4f91-a918-f44e4bb01cc5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:49.001464 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-fddac342-aac4-4f91-a918-f44e4bb01cc5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.082201 Nov 23 13:10:49.002221 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 647/1313] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:10:48 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:10:49.117433 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-4595bcd6-8af4-4acd-a7b7-fec39ef733ae tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:10:49.126418 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-4595bcd6-8af4-4acd-a7b7-fec39ef733ae tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.220026 Nov 23 13:10:49.127009 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 667/1314] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:10:48 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:10:50.013362 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-3c4b342e-2408-4864-9c4b-4caf1efb8ee5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:10:50.014272 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-3c4b342e-2408-4864-9c4b-4caf1efb8ee5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:10:50.022023 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-3c4b342e-2408-4864-9c4b-4caf1efb8ee5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:50.022451 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-3c4b342e-2408-4864-9c4b-4caf1efb8ee5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:50.023260 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-3c4b342e-2408-4864-9c4b-4caf1efb8ee5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:50.023849 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-3c4b342e-2408-4864-9c4b-4caf1efb8ee5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:50.086907 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-3c4b342e-2408-4864-9c4b-4caf1efb8ee5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.077816 Nov 23 13:10:50.087457 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 648/1315] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:10:50 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:10:50.143022 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-886f8cb1-69a8-4783-90ff-8b2dd62312c6 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:10:50.143629 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-886f8cb1-69a8-4783-90ff-8b2dd62312c6 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:10:50.151428 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-886f8cb1-69a8-4783-90ff-8b2dd62312c6 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:50.151877 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-886f8cb1-69a8-4783-90ff-8b2dd62312c6 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:50.152702 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-886f8cb1-69a8-4783-90ff-8b2dd62312c6 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:50.153135 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-886f8cb1-69a8-4783-90ff-8b2dd62312c6 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:50.363960 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-886f8cb1-69a8-4783-90ff-8b2dd62312c6 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:10:50.373363 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-886f8cb1-69a8-4783-90ff-8b2dd62312c6 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.234093 Nov 23 13:10:50.373968 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 668/1316] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:10:50 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:10:51.098847 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-8c925360-05a7-4a59-89ff-da6744790a0b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:10:51.099777 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-8c925360-05a7-4a59-89ff-da6744790a0b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:10:51.107633 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8c925360-05a7-4a59-89ff-da6744790a0b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:51.108078 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8c925360-05a7-4a59-89ff-da6744790a0b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:51.108883 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8c925360-05a7-4a59-89ff-da6744790a0b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:51.109348 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8c925360-05a7-4a59-89ff-da6744790a0b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:51.176480 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-8c925360-05a7-4a59-89ff-da6744790a0b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.081509 Nov 23 13:10:51.177047 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 649/1317] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:10:51 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:10:51.391825 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-2180a119-f88a-4edb-9c8c-3b3ebcfd4f39 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:10:51.392445 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-2180a119-f88a-4edb-9c8c-3b3ebcfd4f39 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:10:51.401359 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2180a119-f88a-4edb-9c8c-3b3ebcfd4f39 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:51.401921 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2180a119-f88a-4edb-9c8c-3b3ebcfd4f39 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:51.402799 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2180a119-f88a-4edb-9c8c-3b3ebcfd4f39 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:51.403296 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2180a119-f88a-4edb-9c8c-3b3ebcfd4f39 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:51.611607 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-2180a119-f88a-4edb-9c8c-3b3ebcfd4f39 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:10:51.624055 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-2180a119-f88a-4edb-9c8c-3b3ebcfd4f39 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.236674 Nov 23 13:10:51.624666 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 669/1318] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:10:51 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:10:52.192571 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-0b4db871-338f-4560-83ab-3aac7a57dde9 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:10:52.194070 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-0b4db871-338f-4560-83ab-3aac7a57dde9 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:10:52.205522 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0b4db871-338f-4560-83ab-3aac7a57dde9 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:52.205955 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0b4db871-338f-4560-83ab-3aac7a57dde9 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:52.206757 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0b4db871-338f-4560-83ab-3aac7a57dde9 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:52.207175 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0b4db871-338f-4560-83ab-3aac7a57dde9 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:52.283602 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-0b4db871-338f-4560-83ab-3aac7a57dde9 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.088765 Nov 23 13:10:52.283602 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 650/1319] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:10:52 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:10:52.645679 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-97c22cd9-94e3-47aa-8bf9-18b0c9b3048f tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:10:52.646639 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-97c22cd9-94e3-47aa-8bf9-18b0c9b3048f tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:10:52.657053 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-97c22cd9-94e3-47aa-8bf9-18b0c9b3048f tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:52.657494 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-97c22cd9-94e3-47aa-8bf9-18b0c9b3048f tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:52.658259 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-97c22cd9-94e3-47aa-8bf9-18b0c9b3048f tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:52.658685 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-97c22cd9-94e3-47aa-8bf9-18b0c9b3048f tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:52.862348 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-97c22cd9-94e3-47aa-8bf9-18b0c9b3048f tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:10:52.871181 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-97c22cd9-94e3-47aa-8bf9-18b0c9b3048f tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.231841 Nov 23 13:10:52.871881 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 670/1320] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:10:52 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:10:53.290834 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-bbdacda5-df22-412b-8b0d-4e311abfd69c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:10:53.292299 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-bbdacda5-df22-412b-8b0d-4e311abfd69c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:10:53.304801 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-bbdacda5-df22-412b-8b0d-4e311abfd69c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:53.305537 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-bbdacda5-df22-412b-8b0d-4e311abfd69c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:53.306848 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-bbdacda5-df22-412b-8b0d-4e311abfd69c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:53.307602 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-bbdacda5-df22-412b-8b0d-4e311abfd69c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:53.376927 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-bbdacda5-df22-412b-8b0d-4e311abfd69c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.092439 Nov 23 13:10:53.377475 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 651/1321] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:10:53 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:10:53.889281 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-08772e14-e14e-4d2d-8a43-53faa3848916 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:10:53.889925 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-08772e14-e14e-4d2d-8a43-53faa3848916 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:10:53.897797 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-08772e14-e14e-4d2d-8a43-53faa3848916 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:53.898239 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-08772e14-e14e-4d2d-8a43-53faa3848916 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:53.899012 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-08772e14-e14e-4d2d-8a43-53faa3848916 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:53.899447 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-08772e14-e14e-4d2d-8a43-53faa3848916 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:54.109795 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-08772e14-e14e-4d2d-8a43-53faa3848916 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:10:54.118147 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-08772e14-e14e-4d2d-8a43-53faa3848916 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.232810 Nov 23 13:10:54.118716 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 671/1322] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:10:53 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:10:54.390402 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-441ccec1-afb2-4200-81df-432005031882 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:10:54.391593 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-441ccec1-afb2-4200-81df-432005031882 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:10:54.401765 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-441ccec1-afb2-4200-81df-432005031882 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:54.402384 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-441ccec1-afb2-4200-81df-432005031882 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:54.403559 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-441ccec1-afb2-4200-81df-432005031882 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:54.404133 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-441ccec1-afb2-4200-81df-432005031882 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:54.471088 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-441ccec1-afb2-4200-81df-432005031882 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.085955 Nov 23 13:10:54.471696 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 652/1323] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:10:54 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:10:55.139922 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-e8e4e3d6-a624-49eb-b575-bdbfef6e4b17 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:10:55.140567 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-e8e4e3d6-a624-49eb-b575-bdbfef6e4b17 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:10:55.152051 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e8e4e3d6-a624-49eb-b575-bdbfef6e4b17 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:55.152787 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e8e4e3d6-a624-49eb-b575-bdbfef6e4b17 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:55.153903 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e8e4e3d6-a624-49eb-b575-bdbfef6e4b17 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:55.154488 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e8e4e3d6-a624-49eb-b575-bdbfef6e4b17 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:55.428033 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-e8e4e3d6-a624-49eb-b575-bdbfef6e4b17 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:10:55.436943 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-e8e4e3d6-a624-49eb-b575-bdbfef6e4b17 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.303420 Nov 23 13:10:55.437535 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 672/1324] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:10:55 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:10:55.483393 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-13256efc-541b-429f-a4cf-500a077d783a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:10:55.484276 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-13256efc-541b-429f-a4cf-500a077d783a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:10:55.491994 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-13256efc-541b-429f-a4cf-500a077d783a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:55.492491 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-13256efc-541b-429f-a4cf-500a077d783a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:55.493240 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-13256efc-541b-429f-a4cf-500a077d783a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:55.493660 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-13256efc-541b-429f-a4cf-500a077d783a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:55.556825 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-13256efc-541b-429f-a4cf-500a077d783a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.077655 Nov 23 13:10:55.557406 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 653/1325] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:10:55 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:10:56.463743 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-f0866c77-736f-4664-80bf-2ddd622b1bc7 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:10:56.464777 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-f0866c77-736f-4664-80bf-2ddd622b1bc7 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:10:56.472887 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f0866c77-736f-4664-80bf-2ddd622b1bc7 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:56.473335 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f0866c77-736f-4664-80bf-2ddd622b1bc7 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:56.474106 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f0866c77-736f-4664-80bf-2ddd622b1bc7 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:56.474563 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f0866c77-736f-4664-80bf-2ddd622b1bc7 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:56.569024 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-e128c3fb-06c8-452d-8664-da3b57e72ce6 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:10:56.569929 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-e128c3fb-06c8-452d-8664-da3b57e72ce6 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:10:56.577630 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e128c3fb-06c8-452d-8664-da3b57e72ce6 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:56.578129 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e128c3fb-06c8-452d-8664-da3b57e72ce6 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:56.578896 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e128c3fb-06c8-452d-8664-da3b57e72ce6 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:56.579323 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e128c3fb-06c8-452d-8664-da3b57e72ce6 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:56.648969 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-e128c3fb-06c8-452d-8664-da3b57e72ce6 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.083782 Nov 23 13:10:56.649874 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 654/1326] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:10:56 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:10:56.674320 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-f0866c77-736f-4664-80bf-2ddd622b1bc7 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:10:56.682776 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-f0866c77-736f-4664-80bf-2ddd622b1bc7 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.225723 Nov 23 13:10:56.683411 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 673/1327] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:10:56 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:10:57.665751 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-79e76b8e-bea4-46aa-a0fa-198c3fb8cdc0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:10:57.667278 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-79e76b8e-bea4-46aa-a0fa-198c3fb8cdc0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:10:57.679838 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-79e76b8e-bea4-46aa-a0fa-198c3fb8cdc0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:57.680646 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-79e76b8e-bea4-46aa-a0fa-198c3fb8cdc0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:57.681910 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-79e76b8e-bea4-46aa-a0fa-198c3fb8cdc0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:57.682643 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-79e76b8e-bea4-46aa-a0fa-198c3fb8cdc0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:57.701527 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-89c363da-03ca-4933-92c9-ac86f444cad8 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:10:57.702107 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-89c363da-03ca-4933-92c9-ac86f444cad8 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:10:57.710131 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-89c363da-03ca-4933-92c9-ac86f444cad8 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:57.710555 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-89c363da-03ca-4933-92c9-ac86f444cad8 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:57.711347 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-89c363da-03ca-4933-92c9-ac86f444cad8 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:57.711772 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-89c363da-03ca-4933-92c9-ac86f444cad8 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:57.748870 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-79e76b8e-bea4-46aa-a0fa-198c3fb8cdc0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.089775 Nov 23 13:10:57.749470 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 655/1328] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:10:57 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:10:57.919330 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-89c363da-03ca-4933-92c9-ac86f444cad8 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:10:57.933148 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-89c363da-03ca-4933-92c9-ac86f444cad8 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.235677 Nov 23 13:10:57.934245 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 674/1329] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:10:57 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:10:58.764152 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-5016149e-ec24-4299-90ed-a6dc611a974b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:10:58.765203 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-5016149e-ec24-4299-90ed-a6dc611a974b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:10:58.774052 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5016149e-ec24-4299-90ed-a6dc611a974b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:58.774550 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5016149e-ec24-4299-90ed-a6dc611a974b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:58.775395 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5016149e-ec24-4299-90ed-a6dc611a974b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:58.775881 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5016149e-ec24-4299-90ed-a6dc611a974b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:58.841357 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-5016149e-ec24-4299-90ed-a6dc611a974b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.082922 Nov 23 13:10:58.845700 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 656/1330] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:10:58 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:10:58.956185 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-23df5e08-5448-4a54-9584-8e2ed7bf39b1 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:10:58.956839 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-23df5e08-5448-4a54-9584-8e2ed7bf39b1 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:10:58.964640 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-23df5e08-5448-4a54-9584-8e2ed7bf39b1 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:58.965100 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-23df5e08-5448-4a54-9584-8e2ed7bf39b1 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:58.965850 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-23df5e08-5448-4a54-9584-8e2ed7bf39b1 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:58.966273 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-23df5e08-5448-4a54-9584-8e2ed7bf39b1 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:59.176804 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-23df5e08-5448-4a54-9584-8e2ed7bf39b1 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:10:59.185768 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-23df5e08-5448-4a54-9584-8e2ed7bf39b1 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.233348 Nov 23 13:10:59.186347 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 675/1331] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:10:58 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:10:59.852926 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-de9a32f4-57ef-4ec1-b016-3a27f198adc5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:10:59.854047 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-de9a32f4-57ef-4ec1-b016-3a27f198adc5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:10:59.861662 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-de9a32f4-57ef-4ec1-b016-3a27f198adc5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:59.862138 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-de9a32f4-57ef-4ec1-b016-3a27f198adc5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:59.862885 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-de9a32f4-57ef-4ec1-b016-3a27f198adc5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:10:59.863452 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-de9a32f4-57ef-4ec1-b016-3a27f198adc5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:10:59.930291 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-de9a32f4-57ef-4ec1-b016-3a27f198adc5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.081314 Nov 23 13:10:59.930868 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 657/1332] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:10:59 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:11:00.207188 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-31f77464-e8ca-4b1b-9748-e992fe18964c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:11:00.208176 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-31f77464-e8ca-4b1b-9748-e992fe18964c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:11:00.218698 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-31f77464-e8ca-4b1b-9748-e992fe18964c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:00.219143 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-31f77464-e8ca-4b1b-9748-e992fe18964c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:00.219956 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-31f77464-e8ca-4b1b-9748-e992fe18964c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:00.220373 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-31f77464-e8ca-4b1b-9748-e992fe18964c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:00.414229 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-31f77464-e8ca-4b1b-9748-e992fe18964c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:11:00.423223 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-31f77464-e8ca-4b1b-9748-e992fe18964c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.222209 Nov 23 13:11:00.423788 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 676/1333] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:11:00 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:11:00.946304 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-7cdf2704-077e-4349-b87c-20c269356286 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:11:00.947760 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-7cdf2704-077e-4349-b87c-20c269356286 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:11:00.956734 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-7cdf2704-077e-4349-b87c-20c269356286 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:00.957171 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-7cdf2704-077e-4349-b87c-20c269356286 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:00.957922 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-7cdf2704-077e-4349-b87c-20c269356286 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:00.958344 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-7cdf2704-077e-4349-b87c-20c269356286 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:01.026324 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-7cdf2704-077e-4349-b87c-20c269356286 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.086493 Nov 23 13:11:01.027140 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 658/1334] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:11:00 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:11:01.444399 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-06fc74c4-2bce-48ca-93d8-ee6d6172efe6 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:11:01.445278 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-06fc74c4-2bce-48ca-93d8-ee6d6172efe6 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:11:01.457857 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-06fc74c4-2bce-48ca-93d8-ee6d6172efe6 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:01.458615 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-06fc74c4-2bce-48ca-93d8-ee6d6172efe6 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:01.459892 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-06fc74c4-2bce-48ca-93d8-ee6d6172efe6 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:01.460670 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-06fc74c4-2bce-48ca-93d8-ee6d6172efe6 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:01.683148 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-06fc74c4-2bce-48ca-93d8-ee6d6172efe6 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:11:01.691589 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-06fc74c4-2bce-48ca-93d8-ee6d6172efe6 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.253729 Nov 23 13:11:01.692171 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 677/1335] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:11:01 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:11:02.042799 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-ae1bea1e-15db-42e3-bac8-f7feebdf1069 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:11:02.044312 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-ae1bea1e-15db-42e3-bac8-f7feebdf1069 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:11:02.056873 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ae1bea1e-15db-42e3-bac8-f7feebdf1069 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:02.057620 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ae1bea1e-15db-42e3-bac8-f7feebdf1069 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:02.058931 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ae1bea1e-15db-42e3-bac8-f7feebdf1069 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:02.059652 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ae1bea1e-15db-42e3-bac8-f7feebdf1069 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:02.125915 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-ae1bea1e-15db-42e3-bac8-f7feebdf1069 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.089756 Nov 23 13:11:02.126745 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 659/1336] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:11:02 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:11:02.713000 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-07952fd5-0bd3-4735-a3b8-0b21592120b7 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:11:02.713947 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-07952fd5-0bd3-4735-a3b8-0b21592120b7 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:11:02.726666 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-07952fd5-0bd3-4735-a3b8-0b21592120b7 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:02.727423 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-07952fd5-0bd3-4735-a3b8-0b21592120b7 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:02.728789 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-07952fd5-0bd3-4735-a3b8-0b21592120b7 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:02.729629 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-07952fd5-0bd3-4735-a3b8-0b21592120b7 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:02.933512 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-07952fd5-0bd3-4735-a3b8-0b21592120b7 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:11:02.942179 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-07952fd5-0bd3-4735-a3b8-0b21592120b7 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.235548 Nov 23 13:11:02.942782 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 678/1337] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:11:02 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:11:03.142156 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-d61ace91-7d81-4b93-a444-76cbd8f32723 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:11:03.143113 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-d61ace91-7d81-4b93-a444-76cbd8f32723 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:11:03.151328 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d61ace91-7d81-4b93-a444-76cbd8f32723 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:03.151775 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d61ace91-7d81-4b93-a444-76cbd8f32723 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:03.152572 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d61ace91-7d81-4b93-a444-76cbd8f32723 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:03.153003 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d61ace91-7d81-4b93-a444-76cbd8f32723 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:03.217792 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-d61ace91-7d81-4b93-a444-76cbd8f32723 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.082017 Nov 23 13:11:03.221982 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 660/1338] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:11:03 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:11:03.965063 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-37544a1c-f334-4484-8016-8e32b6d70987 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:11:03.966101 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-37544a1c-f334-4484-8016-8e32b6d70987 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:11:03.984653 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-37544a1c-f334-4484-8016-8e32b6d70987 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:03.985435 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-37544a1c-f334-4484-8016-8e32b6d70987 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:03.986217 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-37544a1c-f334-4484-8016-8e32b6d70987 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:03.986651 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-37544a1c-f334-4484-8016-8e32b6d70987 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:04.193021 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-37544a1c-f334-4484-8016-8e32b6d70987 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:11:04.202049 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-37544a1c-f334-4484-8016-8e32b6d70987 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.243290 Nov 23 13:11:04.202610 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 679/1339] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:11:03 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:11:04.229859 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-f1d11f51-6cde-4dca-88cd-0618b9ff0958 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:11:04.230823 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-f1d11f51-6cde-4dca-88cd-0618b9ff0958 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:11:04.238734 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f1d11f51-6cde-4dca-88cd-0618b9ff0958 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:04.239179 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f1d11f51-6cde-4dca-88cd-0618b9ff0958 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:04.239951 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f1d11f51-6cde-4dca-88cd-0618b9ff0958 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:04.240414 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f1d11f51-6cde-4dca-88cd-0618b9ff0958 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:04.316267 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-f1d11f51-6cde-4dca-88cd-0618b9ff0958 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.090499 Nov 23 13:11:04.316874 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 661/1340] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:11:04 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:11:05.223858 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-8e44301a-18ab-498b-916c-bbb6ff39d20b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:11:05.224757 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-8e44301a-18ab-498b-916c-bbb6ff39d20b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:11:05.237534 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8e44301a-18ab-498b-916c-bbb6ff39d20b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:05.238281 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8e44301a-18ab-498b-916c-bbb6ff39d20b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:05.239823 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8e44301a-18ab-498b-916c-bbb6ff39d20b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:05.240617 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8e44301a-18ab-498b-916c-bbb6ff39d20b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:05.328788 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-326fa349-2aa8-4210-a06a-78c166a4f121 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:11:05.329777 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-326fa349-2aa8-4210-a06a-78c166a4f121 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:11:05.337887 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-326fa349-2aa8-4210-a06a-78c166a4f121 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:05.338335 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-326fa349-2aa8-4210-a06a-78c166a4f121 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:05.339108 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-326fa349-2aa8-4210-a06a-78c166a4f121 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:05.339535 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-326fa349-2aa8-4210-a06a-78c166a4f121 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:05.408297 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-326fa349-2aa8-4210-a06a-78c166a4f121 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.083718 Nov 23 13:11:05.409289 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 662/1341] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:11:05 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:11:05.461842 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-8e44301a-18ab-498b-916c-bbb6ff39d20b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:11:05.470537 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-8e44301a-18ab-498b-916c-bbb6ff39d20b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.253618 Nov 23 13:11:05.471088 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 680/1342] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:11:05 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:11:06.424207 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-9bf81375-897f-4bdc-83a7-eb0f3c027240 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:11:06.425369 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-9bf81375-897f-4bdc-83a7-eb0f3c027240 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:11:06.434972 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-9bf81375-897f-4bdc-83a7-eb0f3c027240 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:06.435532 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-9bf81375-897f-4bdc-83a7-eb0f3c027240 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:06.436503 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-9bf81375-897f-4bdc-83a7-eb0f3c027240 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:06.437081 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-9bf81375-897f-4bdc-83a7-eb0f3c027240 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:06.487844 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-e344733d-b7bd-451d-b513-0c462a8d7349 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:11:06.488440 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-e344733d-b7bd-451d-b513-0c462a8d7349 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:11:06.496445 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e344733d-b7bd-451d-b513-0c462a8d7349 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:06.497129 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e344733d-b7bd-451d-b513-0c462a8d7349 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:06.498105 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e344733d-b7bd-451d-b513-0c462a8d7349 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:06.498329 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e344733d-b7bd-451d-b513-0c462a8d7349 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:06.506262 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-9bf81375-897f-4bdc-83a7-eb0f3c027240 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.088152 Nov 23 13:11:06.507068 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 663/1343] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:11:06 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:11:06.702442 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-e344733d-b7bd-451d-b513-0c462a8d7349 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:11:06.711043 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-e344733d-b7bd-451d-b513-0c462a8d7349 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.227227 Nov 23 13:11:06.711808 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 681/1344] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:11:06 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:11:07.522719 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-3eb0916b-87fe-4733-acbf-5939dbbd4332 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:11:07.524079 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-3eb0916b-87fe-4733-acbf-5939dbbd4332 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:11:07.534906 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-3eb0916b-87fe-4733-acbf-5939dbbd4332 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:07.535363 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-3eb0916b-87fe-4733-acbf-5939dbbd4332 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:07.536166 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-3eb0916b-87fe-4733-acbf-5939dbbd4332 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:07.536632 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-3eb0916b-87fe-4733-acbf-5939dbbd4332 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:07.609402 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-3eb0916b-87fe-4733-acbf-5939dbbd4332 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.093481 Nov 23 13:11:07.609971 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 664/1345] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:11:07 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:11:07.728048 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-9d0cf1e4-91b0-4909-ae83-ca3578c108f2 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:11:07.728699 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-9d0cf1e4-91b0-4909-ae83-ca3578c108f2 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:11:07.737160 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-9d0cf1e4-91b0-4909-ae83-ca3578c108f2 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:07.737612 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-9d0cf1e4-91b0-4909-ae83-ca3578c108f2 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:07.738406 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-9d0cf1e4-91b0-4909-ae83-ca3578c108f2 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:07.738836 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-9d0cf1e4-91b0-4909-ae83-ca3578c108f2 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:07.886588 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 13:11:07.886782 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: Tue Nov 23 13:11:07 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 (ip 10.222.0.60) !!! Nov 23 13:11:07.946206 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-9d0cf1e4-91b0-4909-ae83-ca3578c108f2 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:11:07.954662 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-9d0cf1e4-91b0-4909-ae83-ca3578c108f2 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.230422 Nov 23 13:11:07.955257 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 682/1346] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:11:07 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:11:08.498419 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 13:11:08.498807 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: Tue Nov 23 13:11:08 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 23 13:11:08.625055 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-1a16c944-f7a8-4a21-a45b-dec6affe42d8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:11:08.626738 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-1a16c944-f7a8-4a21-a45b-dec6affe42d8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:11:08.638324 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-1a16c944-f7a8-4a21-a45b-dec6affe42d8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:08.638994 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-1a16c944-f7a8-4a21-a45b-dec6affe42d8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:08.640134 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-1a16c944-f7a8-4a21-a45b-dec6affe42d8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:08.640825 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-1a16c944-f7a8-4a21-a45b-dec6affe42d8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:08.704756 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-1a16c944-f7a8-4a21-a45b-dec6affe42d8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.085993 Nov 23 13:11:08.705534 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 665/1347] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:11:08 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:11:08.973505 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-d354f54e-01e8-44ee-b5c3-ea0b22c777d4 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:11:08.974451 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-d354f54e-01e8-44ee-b5c3-ea0b22c777d4 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:11:08.986662 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d354f54e-01e8-44ee-b5c3-ea0b22c777d4 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:08.987410 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d354f54e-01e8-44ee-b5c3-ea0b22c777d4 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:08.988920 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d354f54e-01e8-44ee-b5c3-ea0b22c777d4 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:08.989650 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d354f54e-01e8-44ee-b5c3-ea0b22c777d4 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:09.201505 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-d354f54e-01e8-44ee-b5c3-ea0b22c777d4 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:11:09.210420 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-d354f54e-01e8-44ee-b5c3-ea0b22c777d4 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.242162 Nov 23 13:11:09.211016 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 683/1348] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:11:08 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:11:09.721947 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-6559acec-2274-45c6-8afb-5551d2bfe352 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:11:09.723205 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-6559acec-2274-45c6-8afb-5551d2bfe352 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:11:09.733556 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6559acec-2274-45c6-8afb-5551d2bfe352 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:09.734154 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6559acec-2274-45c6-8afb-5551d2bfe352 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:09.735477 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6559acec-2274-45c6-8afb-5551d2bfe352 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:09.736057 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6559acec-2274-45c6-8afb-5551d2bfe352 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:09.810592 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-6559acec-2274-45c6-8afb-5551d2bfe352 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.095172 Nov 23 13:11:09.811389 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 666/1349] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:11:09 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:11:10.231772 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-05fc1eb8-23d6-4df5-82e8-bdd8f4855c8b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:11:10.232829 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-05fc1eb8-23d6-4df5-82e8-bdd8f4855c8b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:11:10.241761 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-05fc1eb8-23d6-4df5-82e8-bdd8f4855c8b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:10.242192 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-05fc1eb8-23d6-4df5-82e8-bdd8f4855c8b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:10.243026 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-05fc1eb8-23d6-4df5-82e8-bdd8f4855c8b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:10.243389 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-05fc1eb8-23d6-4df5-82e8-bdd8f4855c8b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:10.456270 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-05fc1eb8-23d6-4df5-82e8-bdd8f4855c8b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:11:10.467875 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-05fc1eb8-23d6-4df5-82e8-bdd8f4855c8b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.242093 Nov 23 13:11:10.468787 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 684/1350] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:11:10 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:11:10.824107 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-1f325ec7-4bbd-426c-bb52-42fc36ea8a6e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:11:10.825401 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-1f325ec7-4bbd-426c-bb52-42fc36ea8a6e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:11:10.834073 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-1f325ec7-4bbd-426c-bb52-42fc36ea8a6e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:10.834514 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-1f325ec7-4bbd-426c-bb52-42fc36ea8a6e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:10.835332 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-1f325ec7-4bbd-426c-bb52-42fc36ea8a6e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:10.835755 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-1f325ec7-4bbd-426c-bb52-42fc36ea8a6e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:10.901481 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-1f325ec7-4bbd-426c-bb52-42fc36ea8a6e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.082190 Nov 23 13:11:10.902040 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 667/1351] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:11:10 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:11:11.489065 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-48bf87ec-c68f-4e74-9d25-b6b961308886 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:11:11.490250 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-48bf87ec-c68f-4e74-9d25-b6b961308886 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:11:11.502841 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-48bf87ec-c68f-4e74-9d25-b6b961308886 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:11.503388 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-48bf87ec-c68f-4e74-9d25-b6b961308886 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:11.504595 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-48bf87ec-c68f-4e74-9d25-b6b961308886 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:11.505213 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-48bf87ec-c68f-4e74-9d25-b6b961308886 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:11.716699 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-48bf87ec-c68f-4e74-9d25-b6b961308886 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:11:11.725194 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-48bf87ec-c68f-4e74-9d25-b6b961308886 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.243201 Nov 23 13:11:11.725816 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 685/1352] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:11:11 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:11:11.915549 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-b4fb0c53-da2e-4973-8819-ffbd8f28b010 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:11:11.916615 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-b4fb0c53-da2e-4973-8819-ffbd8f28b010 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:11:11.925964 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b4fb0c53-da2e-4973-8819-ffbd8f28b010 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:11.926474 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b4fb0c53-da2e-4973-8819-ffbd8f28b010 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:11.927368 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b4fb0c53-da2e-4973-8819-ffbd8f28b010 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:11.927849 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b4fb0c53-da2e-4973-8819-ffbd8f28b010 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:11.997285 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-b4fb0c53-da2e-4973-8819-ffbd8f28b010 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.086534 Nov 23 13:11:11.997865 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 668/1353] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:11:11 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:11:12.746785 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-52054c11-23d2-4bf5-a899-b84814434cf5 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:11:12.747871 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-52054c11-23d2-4bf5-a899-b84814434cf5 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:11:12.758038 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-52054c11-23d2-4bf5-a899-b84814434cf5 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:12.758488 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-52054c11-23d2-4bf5-a899-b84814434cf5 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:12.759260 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-52054c11-23d2-4bf5-a899-b84814434cf5 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:12.759686 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-52054c11-23d2-4bf5-a899-b84814434cf5 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:12.974275 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-52054c11-23d2-4bf5-a899-b84814434cf5 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:11:12.988184 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-52054c11-23d2-4bf5-a899-b84814434cf5 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.247804 Nov 23 13:11:12.988967 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 686/1354] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:11:12 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:11:13.009642 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-9edba3a1-3a09-44b4-9fb1-97898dc9911d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:11:13.010840 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-9edba3a1-3a09-44b4-9fb1-97898dc9911d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:11:13.018870 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-9edba3a1-3a09-44b4-9fb1-97898dc9911d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:13.019497 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-9edba3a1-3a09-44b4-9fb1-97898dc9911d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:13.020268 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-9edba3a1-3a09-44b4-9fb1-97898dc9911d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:13.020731 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-9edba3a1-3a09-44b4-9fb1-97898dc9911d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:13.096120 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-9edba3a1-3a09-44b4-9fb1-97898dc9911d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.090498 Nov 23 13:11:13.096739 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 669/1355] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:11:13 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:11:14.009873 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-d3f94a5a-4c8d-4881-9375-1ed5699ca384 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:11:14.010837 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-d3f94a5a-4c8d-4881-9375-1ed5699ca384 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:11:14.023396 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d3f94a5a-4c8d-4881-9375-1ed5699ca384 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:14.024163 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d3f94a5a-4c8d-4881-9375-1ed5699ca384 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:14.025499 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d3f94a5a-4c8d-4881-9375-1ed5699ca384 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:14.026205 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d3f94a5a-4c8d-4881-9375-1ed5699ca384 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:14.110062 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-e30d9ac8-29e8-4305-b327-9b96f7b3239b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:11:14.110973 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-e30d9ac8-29e8-4305-b327-9b96f7b3239b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:11:14.122334 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e30d9ac8-29e8-4305-b327-9b96f7b3239b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:14.123321 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e30d9ac8-29e8-4305-b327-9b96f7b3239b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:14.124665 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e30d9ac8-29e8-4305-b327-9b96f7b3239b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:14.125387 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e30d9ac8-29e8-4305-b327-9b96f7b3239b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:14.196063 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-e30d9ac8-29e8-4305-b327-9b96f7b3239b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.091008 Nov 23 13:11:14.197082 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 670/1356] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:11:14 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:11:14.254555 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-d3f94a5a-4c8d-4881-9375-1ed5699ca384 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:11:14.262810 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-d3f94a5a-4c8d-4881-9375-1ed5699ca384 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.259346 Nov 23 13:11:14.263380 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 687/1357] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:11:14 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:11:15.212881 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-71c7b7fc-3a7b-4c9c-a42a-cd0c2240198f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:11:15.214211 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-71c7b7fc-3a7b-4c9c-a42a-cd0c2240198f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:11:15.226760 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-71c7b7fc-3a7b-4c9c-a42a-cd0c2240198f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:15.227510 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-71c7b7fc-3a7b-4c9c-a42a-cd0c2240198f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:15.228829 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-71c7b7fc-3a7b-4c9c-a42a-cd0c2240198f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:15.229551 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-71c7b7fc-3a7b-4c9c-a42a-cd0c2240198f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:15.280167 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-deb8d03c-2b68-4370-aeb2-4a9610a0014c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:11:15.280773 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-deb8d03c-2b68-4370-aeb2-4a9610a0014c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:11:15.288505 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-deb8d03c-2b68-4370-aeb2-4a9610a0014c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:15.288945 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-deb8d03c-2b68-4370-aeb2-4a9610a0014c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:15.290052 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-deb8d03c-2b68-4370-aeb2-4a9610a0014c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:15.290445 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-deb8d03c-2b68-4370-aeb2-4a9610a0014c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:15.297270 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-71c7b7fc-3a7b-4c9c-a42a-cd0c2240198f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.091457 Nov 23 13:11:15.298091 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 671/1358] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:11:15 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:11:15.487739 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-deb8d03c-2b68-4370-aeb2-4a9610a0014c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:11:15.496844 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-deb8d03c-2b68-4370-aeb2-4a9610a0014c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.220468 Nov 23 13:11:15.497411 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 688/1359] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:11:15 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:11:16.313678 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-81090c99-bd77-46b9-965f-523f18f53dbf tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:11:16.315164 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-81090c99-bd77-46b9-965f-523f18f53dbf tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:11:16.323453 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-81090c99-bd77-46b9-965f-523f18f53dbf tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:16.323905 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-81090c99-bd77-46b9-965f-523f18f53dbf tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:16.324706 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-81090c99-bd77-46b9-965f-523f18f53dbf tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:16.325138 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-81090c99-bd77-46b9-965f-523f18f53dbf tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:16.389753 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-81090c99-bd77-46b9-965f-523f18f53dbf tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.082698 Nov 23 13:11:16.391604 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 672/1360] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:11:16 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:11:16.514961 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-fad9e39a-baf7-4fbb-9d5c-2255406d9671 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:11:16.515555 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-fad9e39a-baf7-4fbb-9d5c-2255406d9671 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:11:16.523703 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-fad9e39a-baf7-4fbb-9d5c-2255406d9671 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:16.524148 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-fad9e39a-baf7-4fbb-9d5c-2255406d9671 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:16.524983 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-fad9e39a-baf7-4fbb-9d5c-2255406d9671 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:16.525431 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-fad9e39a-baf7-4fbb-9d5c-2255406d9671 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:16.736014 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-fad9e39a-baf7-4fbb-9d5c-2255406d9671 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:11:16.744953 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-fad9e39a-baf7-4fbb-9d5c-2255406d9671 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.233916 Nov 23 13:11:16.745535 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 689/1361] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:11:16 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:11:17.405365 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-0df39da7-37b7-4d76-997b-1f6ecf86f161 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:11:17.406757 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-0df39da7-37b7-4d76-997b-1f6ecf86f161 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:11:17.418360 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0df39da7-37b7-4d76-997b-1f6ecf86f161 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:17.419050 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0df39da7-37b7-4d76-997b-1f6ecf86f161 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:17.420208 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0df39da7-37b7-4d76-997b-1f6ecf86f161 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:17.420895 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0df39da7-37b7-4d76-997b-1f6ecf86f161 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:17.486316 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-0df39da7-37b7-4d76-997b-1f6ecf86f161 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.087040 Nov 23 13:11:17.487003 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 673/1362] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:11:17 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:11:17.764675 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-f3a0ed8b-2aa7-4199-b4e3-5b1057115f01 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:11:17.765251 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-f3a0ed8b-2aa7-4199-b4e3-5b1057115f01 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:11:17.776307 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f3a0ed8b-2aa7-4199-b4e3-5b1057115f01 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:17.776914 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f3a0ed8b-2aa7-4199-b4e3-5b1057115f01 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:17.777990 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f3a0ed8b-2aa7-4199-b4e3-5b1057115f01 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:17.778521 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f3a0ed8b-2aa7-4199-b4e3-5b1057115f01 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:18.052568 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-f3a0ed8b-2aa7-4199-b4e3-5b1057115f01 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:11:18.061734 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-f3a0ed8b-2aa7-4199-b4e3-5b1057115f01 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.303111 Nov 23 13:11:18.062300 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 690/1363] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:11:17 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:11:18.503074 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-177bfbfe-f03c-412a-9bcd-04996675e8d7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:11:18.504215 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-177bfbfe-f03c-412a-9bcd-04996675e8d7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:11:18.512137 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-177bfbfe-f03c-412a-9bcd-04996675e8d7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:18.512602 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-177bfbfe-f03c-412a-9bcd-04996675e8d7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:18.513491 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-177bfbfe-f03c-412a-9bcd-04996675e8d7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:18.513927 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-177bfbfe-f03c-412a-9bcd-04996675e8d7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:18.582045 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-177bfbfe-f03c-412a-9bcd-04996675e8d7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.085453 Nov 23 13:11:18.582594 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 674/1364] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:11:18 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:11:19.082281 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-334126a3-5856-44a7-9283-5675e294f4bb tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:11:19.082938 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-334126a3-5856-44a7-9283-5675e294f4bb tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:11:19.090472 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-334126a3-5856-44a7-9283-5675e294f4bb tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:19.090920 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-334126a3-5856-44a7-9283-5675e294f4bb tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:19.091692 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-334126a3-5856-44a7-9283-5675e294f4bb tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:19.092125 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-334126a3-5856-44a7-9283-5675e294f4bb tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:19.293178 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-334126a3-5856-44a7-9283-5675e294f4bb tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:11:19.302304 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-334126a3-5856-44a7-9283-5675e294f4bb tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.225668 Nov 23 13:11:19.302877 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 691/1365] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:11:19 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:11:19.598048 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-8591c822-e3bf-4029-bed0-1ea4dd19bc4d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:11:19.599138 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-8591c822-e3bf-4029-bed0-1ea4dd19bc4d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:11:19.610877 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8591c822-e3bf-4029-bed0-1ea4dd19bc4d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:19.611510 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8591c822-e3bf-4029-bed0-1ea4dd19bc4d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:19.612660 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8591c822-e3bf-4029-bed0-1ea4dd19bc4d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:19.616730 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8591c822-e3bf-4029-bed0-1ea4dd19bc4d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:19.680724 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-8591c822-e3bf-4029-bed0-1ea4dd19bc4d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.088829 Nov 23 13:11:19.681284 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 675/1366] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:11:19 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:11:20.328944 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-e66dce7b-0642-4ce9-8d48-7ede184fe09c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:11:20.329852 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-e66dce7b-0642-4ce9-8d48-7ede184fe09c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:11:20.338565 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e66dce7b-0642-4ce9-8d48-7ede184fe09c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:20.339006 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e66dce7b-0642-4ce9-8d48-7ede184fe09c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:20.339760 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e66dce7b-0642-4ce9-8d48-7ede184fe09c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:20.340178 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e66dce7b-0642-4ce9-8d48-7ede184fe09c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:20.547719 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-e66dce7b-0642-4ce9-8d48-7ede184fe09c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:11:20.556416 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-e66dce7b-0642-4ce9-8d48-7ede184fe09c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.233846 Nov 23 13:11:20.556967 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 692/1367] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:11:20 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:11:20.697332 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-a39f81af-b7dd-47d4-a4cd-a87da536f5ce tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:11:20.698696 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-a39f81af-b7dd-47d4-a4cd-a87da536f5ce tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:11:20.711481 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a39f81af-b7dd-47d4-a4cd-a87da536f5ce tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:20.712228 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a39f81af-b7dd-47d4-a4cd-a87da536f5ce tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:20.713571 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a39f81af-b7dd-47d4-a4cd-a87da536f5ce tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:20.714265 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a39f81af-b7dd-47d4-a4cd-a87da536f5ce tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:20.781586 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-a39f81af-b7dd-47d4-a4cd-a87da536f5ce tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.091239 Nov 23 13:11:20.782137 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 676/1368] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:11:20 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:11:21.579536 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-50d2b8ef-bc35-42fd-bd91-72da7955b55b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:11:21.580708 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-50d2b8ef-bc35-42fd-bd91-72da7955b55b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:11:21.593889 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-50d2b8ef-bc35-42fd-bd91-72da7955b55b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:21.594638 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-50d2b8ef-bc35-42fd-bd91-72da7955b55b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:21.595965 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-50d2b8ef-bc35-42fd-bd91-72da7955b55b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:21.596740 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-50d2b8ef-bc35-42fd-bd91-72da7955b55b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:21.793891 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-dd4344ca-8344-484f-8e87-45a76b03cd0b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:11:21.795437 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-dd4344ca-8344-484f-8e87-45a76b03cd0b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:11:21.803825 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-dd4344ca-8344-484f-8e87-45a76b03cd0b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:21.804285 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-dd4344ca-8344-484f-8e87-45a76b03cd0b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:21.805049 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-dd4344ca-8344-484f-8e87-45a76b03cd0b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:21.805640 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-dd4344ca-8344-484f-8e87-45a76b03cd0b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:21.805906 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-50d2b8ef-bc35-42fd-bd91-72da7955b55b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:11:21.814551 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-50d2b8ef-bc35-42fd-bd91-72da7955b55b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.241304 Nov 23 13:11:21.815442 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 693/1369] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:11:21 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:11:21.871745 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-dd4344ca-8344-484f-8e87-45a76b03cd0b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.081965 Nov 23 13:11:21.872336 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 677/1370] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:11:21 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:11:22.832896 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-70e1fe58-beb6-44e6-920b-0c1ee97a1b89 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:11:22.833490 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-70e1fe58-beb6-44e6-920b-0c1ee97a1b89 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:11:22.841395 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-70e1fe58-beb6-44e6-920b-0c1ee97a1b89 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:22.841837 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-70e1fe58-beb6-44e6-920b-0c1ee97a1b89 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:22.842689 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-70e1fe58-beb6-44e6-920b-0c1ee97a1b89 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:22.843150 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-70e1fe58-beb6-44e6-920b-0c1ee97a1b89 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:22.885528 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-8dc58d22-f60a-42de-9315-1dba1ee3cfd5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:11:22.886479 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-8dc58d22-f60a-42de-9315-1dba1ee3cfd5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:11:22.894486 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8dc58d22-f60a-42de-9315-1dba1ee3cfd5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:22.894935 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8dc58d22-f60a-42de-9315-1dba1ee3cfd5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:22.895728 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8dc58d22-f60a-42de-9315-1dba1ee3cfd5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:22.896154 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8dc58d22-f60a-42de-9315-1dba1ee3cfd5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:22.963868 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-8dc58d22-f60a-42de-9315-1dba1ee3cfd5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.082294 Nov 23 13:11:22.964422 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 678/1371] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:11:22 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 13:11:23.042817 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-70e1fe58-beb6-44e6-920b-0c1ee97a1b89 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:11:23.051351 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-70e1fe58-beb6-44e6-920b-0c1ee97a1b89 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.222753 Nov 23 13:11:23.051912 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 694/1372] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:11:22 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:11:23.978232 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-5e183bbc-c982-48fc-8f3e-98d94ba005b7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:11:23.979584 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-5e183bbc-c982-48fc-8f3e-98d94ba005b7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:11:23.991273 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5e183bbc-c982-48fc-8f3e-98d94ba005b7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:23.991972 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5e183bbc-c982-48fc-8f3e-98d94ba005b7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:23.993194 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5e183bbc-c982-48fc-8f3e-98d94ba005b7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:23.994202 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5e183bbc-c982-48fc-8f3e-98d94ba005b7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:24.061088 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-5e183bbc-c982-48fc-8f3e-98d94ba005b7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.088867 Nov 23 13:11:24.061632 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 679/1373] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:11:23 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:11:24.068313 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-672e39cd-d54a-4cfb-bd18-37a0312ed042 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:11:24.068927 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-672e39cd-d54a-4cfb-bd18-37a0312ed042 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:11:24.077530 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-672e39cd-d54a-4cfb-bd18-37a0312ed042 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:24.077997 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-672e39cd-d54a-4cfb-bd18-37a0312ed042 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:24.078773 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-672e39cd-d54a-4cfb-bd18-37a0312ed042 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:24.079208 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-672e39cd-d54a-4cfb-bd18-37a0312ed042 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:24.286616 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-672e39cd-d54a-4cfb-bd18-37a0312ed042 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:11:24.299470 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-672e39cd-d54a-4cfb-bd18-37a0312ed042 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.234637 Nov 23 13:11:24.300413 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 695/1374] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:11:24 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:11:25.076850 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-02254f15-b114-44eb-a6e8-3421bebb5a84 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:11:25.078288 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-02254f15-b114-44eb-a6e8-3421bebb5a84 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:11:25.087361 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-02254f15-b114-44eb-a6e8-3421bebb5a84 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:25.087803 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-02254f15-b114-44eb-a6e8-3421bebb5a84 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:25.088591 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-02254f15-b114-44eb-a6e8-3421bebb5a84 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:25.089013 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-02254f15-b114-44eb-a6e8-3421bebb5a84 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:25.156940 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-02254f15-b114-44eb-a6e8-3421bebb5a84 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.086084 Nov 23 13:11:25.157686 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 680/1375] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:11:25 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:11:25.322296 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-d226c454-bac5-4c13-81d9-846140320c5c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:11:25.323146 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-d226c454-bac5-4c13-81d9-846140320c5c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:11:25.333920 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d226c454-bac5-4c13-81d9-846140320c5c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:25.334641 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d226c454-bac5-4c13-81d9-846140320c5c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:25.335841 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d226c454-bac5-4c13-81d9-846140320c5c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:25.336598 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d226c454-bac5-4c13-81d9-846140320c5c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:25.545394 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-d226c454-bac5-4c13-81d9-846140320c5c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:11:25.554529 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-d226c454-bac5-4c13-81d9-846140320c5c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.236151 Nov 23 13:11:25.555114 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 696/1376] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:11:25 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:11:26.170839 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-ed21d671-cdc8-419d-b3a5-7cc94f52f013 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:11:26.171749 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-ed21d671-cdc8-419d-b3a5-7cc94f52f013 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:11:26.180085 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ed21d671-cdc8-419d-b3a5-7cc94f52f013 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:26.180582 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ed21d671-cdc8-419d-b3a5-7cc94f52f013 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:26.181380 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ed21d671-cdc8-419d-b3a5-7cc94f52f013 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:26.181832 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ed21d671-cdc8-419d-b3a5-7cc94f52f013 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:26.251800 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-ed21d671-cdc8-419d-b3a5-7cc94f52f013 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.085103 Nov 23 13:11:26.252397 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 681/1377] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:11:26 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:11:26.581297 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-d7bd8e1e-ec26-43e0-8681-23afbc040e65 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:11:26.582141 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-d7bd8e1e-ec26-43e0-8681-23afbc040e65 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:11:26.590683 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d7bd8e1e-ec26-43e0-8681-23afbc040e65 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:26.591156 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d7bd8e1e-ec26-43e0-8681-23afbc040e65 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:26.591965 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d7bd8e1e-ec26-43e0-8681-23afbc040e65 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:26.592480 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d7bd8e1e-ec26-43e0-8681-23afbc040e65 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:26.809337 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-d7bd8e1e-ec26-43e0-8681-23afbc040e65 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:11:26.818231 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-d7bd8e1e-ec26-43e0-8681-23afbc040e65 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.243485 Nov 23 13:11:26.818764 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 697/1378] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:11:26 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:11:27.269611 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-fcca19cb-23d3-40fb-ba0d-a2a9b5ae47c8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:11:27.271403 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-fcca19cb-23d3-40fb-ba0d-a2a9b5ae47c8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:11:27.279194 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-fcca19cb-23d3-40fb-ba0d-a2a9b5ae47c8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:27.279643 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-fcca19cb-23d3-40fb-ba0d-a2a9b5ae47c8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:27.280444 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-fcca19cb-23d3-40fb-ba0d-a2a9b5ae47c8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:27.280874 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-fcca19cb-23d3-40fb-ba0d-a2a9b5ae47c8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:27.346714 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-fcca19cb-23d3-40fb-ba0d-a2a9b5ae47c8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.084757 Nov 23 13:11:27.347489 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 682/1379] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:11:27 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:11:27.836222 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-4968fd70-6d91-4e69-94d7-95b6df5bd966 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:11:27.836869 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-4968fd70-6d91-4e69-94d7-95b6df5bd966 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:11:27.845095 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-4968fd70-6d91-4e69-94d7-95b6df5bd966 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:27.845577 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-4968fd70-6d91-4e69-94d7-95b6df5bd966 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:27.846583 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-4968fd70-6d91-4e69-94d7-95b6df5bd966 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:27.847077 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-4968fd70-6d91-4e69-94d7-95b6df5bd966 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:28.046097 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-4968fd70-6d91-4e69-94d7-95b6df5bd966 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:11:28.055116 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-4968fd70-6d91-4e69-94d7-95b6df5bd966 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.223182 Nov 23 13:11:28.055684 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 698/1380] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:11:27 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:11:28.362649 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-90bd1d76-2203-4498-851d-44846eb1e6eb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:11:28.364213 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-90bd1d76-2203-4498-851d-44846eb1e6eb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:11:28.377134 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-90bd1d76-2203-4498-851d-44846eb1e6eb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:28.377883 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-90bd1d76-2203-4498-851d-44846eb1e6eb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:28.379179 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-90bd1d76-2203-4498-851d-44846eb1e6eb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:28.379887 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-90bd1d76-2203-4498-851d-44846eb1e6eb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:28.444436 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-90bd1d76-2203-4498-851d-44846eb1e6eb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.088160 Nov 23 13:11:28.444994 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 683/1381] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:11:28 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:11:29.075079 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-a552cddc-6068-4968-b0d2-9bc932e9a13f tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:11:29.076957 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-a552cddc-6068-4968-b0d2-9bc932e9a13f tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:11:29.087714 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a552cddc-6068-4968-b0d2-9bc932e9a13f tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:29.088316 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a552cddc-6068-4968-b0d2-9bc932e9a13f tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:29.089365 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a552cddc-6068-4968-b0d2-9bc932e9a13f tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:29.089931 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a552cddc-6068-4968-b0d2-9bc932e9a13f tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:29.295948 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-a552cddc-6068-4968-b0d2-9bc932e9a13f tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:11:29.304884 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-a552cddc-6068-4968-b0d2-9bc932e9a13f tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.234911 Nov 23 13:11:29.305451 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 699/1382] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:11:29 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:11:29.455718 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-6ce7064a-483b-4a6e-a5a4-2e8d9ae8fddc tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:11:29.456674 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-6ce7064a-483b-4a6e-a5a4-2e8d9ae8fddc tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:11:29.464688 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6ce7064a-483b-4a6e-a5a4-2e8d9ae8fddc tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:29.465136 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6ce7064a-483b-4a6e-a5a4-2e8d9ae8fddc tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:29.465905 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6ce7064a-483b-4a6e-a5a4-2e8d9ae8fddc tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:29.466333 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6ce7064a-483b-4a6e-a5a4-2e8d9ae8fddc tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:29.530390 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-6ce7064a-483b-4a6e-a5a4-2e8d9ae8fddc tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.078514 Nov 23 13:11:29.530983 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 684/1383] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:11:29 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:11:30.326269 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-90c1792a-fd10-41cb-80af-bebd6f259639 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:11:30.327306 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-90c1792a-fd10-41cb-80af-bebd6f259639 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:11:30.337531 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-90c1792a-fd10-41cb-80af-bebd6f259639 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:30.337975 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-90c1792a-fd10-41cb-80af-bebd6f259639 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:30.338730 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-90c1792a-fd10-41cb-80af-bebd6f259639 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:30.339170 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-90c1792a-fd10-41cb-80af-bebd6f259639 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:30.543896 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-6f98684c-188d-4c8f-92d1-1aa342c21656 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:11:30.545069 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-6f98684c-188d-4c8f-92d1-1aa342c21656 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:11:30.552764 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6f98684c-188d-4c8f-92d1-1aa342c21656 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:30.553197 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6f98684c-188d-4c8f-92d1-1aa342c21656 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:30.553969 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6f98684c-188d-4c8f-92d1-1aa342c21656 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:30.554368 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6f98684c-188d-4c8f-92d1-1aa342c21656 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:30.595796 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-90c1792a-fd10-41cb-80af-bebd6f259639 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:11:30.610225 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-90c1792a-fd10-41cb-80af-bebd6f259639 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.290344 Nov 23 13:11:30.611491 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 700/1384] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:11:30 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:11:30.629941 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-6f98684c-188d-4c8f-92d1-1aa342c21656 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.090093 Nov 23 13:11:30.630585 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 685/1385] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:11:30 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 13:11:31.631610 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-5c2699e2-14dd-40cc-90f5-9bfed61b4158 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:11:31.632611 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-5c2699e2-14dd-40cc-90f5-9bfed61b4158 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:11:31.644771 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5c2699e2-14dd-40cc-90f5-9bfed61b4158 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:31.645514 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5c2699e2-14dd-40cc-90f5-9bfed61b4158 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:31.646525 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-f9936872-d805-45c3-a5c4-ddd14a3f3921 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:11:31.647018 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5c2699e2-14dd-40cc-90f5-9bfed61b4158 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:31.647184 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5c2699e2-14dd-40cc-90f5-9bfed61b4158 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:31.647463 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-f9936872-d805-45c3-a5c4-ddd14a3f3921 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:11:31.655255 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f9936872-d805-45c3-a5c4-ddd14a3f3921 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:31.655705 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f9936872-d805-45c3-a5c4-ddd14a3f3921 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:31.656530 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f9936872-d805-45c3-a5c4-ddd14a3f3921 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:31.656957 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f9936872-d805-45c3-a5c4-ddd14a3f3921 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:31.721314 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-f9936872-d805-45c3-a5c4-ddd14a3f3921 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.081964 Nov 23 13:11:31.721903 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 686/1386] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:11:31 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:11:31.858051 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-5c2699e2-14dd-40cc-90f5-9bfed61b4158 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:11:31.866825 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-5c2699e2-14dd-40cc-90f5-9bfed61b4158 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.241776 Nov 23 13:11:31.867500 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 701/1387] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:11:31 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:11:32.182072 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 13:11:32.182426 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: Tue Nov 23 13:11:32 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 23 13:11:32.734024 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-1f5ce9ee-ab42-470e-bae1-a95f4a6bf2e0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:11:32.735049 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-1f5ce9ee-ab42-470e-bae1-a95f4a6bf2e0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:11:32.744117 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-1f5ce9ee-ab42-470e-bae1-a95f4a6bf2e0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:32.744667 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-1f5ce9ee-ab42-470e-bae1-a95f4a6bf2e0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:32.745643 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-1f5ce9ee-ab42-470e-bae1-a95f4a6bf2e0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:32.746130 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-1f5ce9ee-ab42-470e-bae1-a95f4a6bf2e0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:32.810311 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-1f5ce9ee-ab42-470e-bae1-a95f4a6bf2e0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.080564 Nov 23 13:11:32.810780 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 687/1388] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:11:32 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:11:32.885632 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-2d1ac628-3f1e-44de-8d72-adaf2eb94593 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:11:32.886243 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-2d1ac628-3f1e-44de-8d72-adaf2eb94593 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:11:32.894123 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2d1ac628-3f1e-44de-8d72-adaf2eb94593 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:32.894565 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2d1ac628-3f1e-44de-8d72-adaf2eb94593 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:32.895341 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2d1ac628-3f1e-44de-8d72-adaf2eb94593 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:32.895768 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2d1ac628-3f1e-44de-8d72-adaf2eb94593 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:33.111685 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-2d1ac628-3f1e-44de-8d72-adaf2eb94593 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:11:33.122693 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-2d1ac628-3f1e-44de-8d72-adaf2eb94593 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.240874 Nov 23 13:11:33.123304 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 702/1389] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:11:32 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:11:33.823646 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-5555853b-bed3-422e-ae25-1a5c7048fee2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:11:33.824740 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-5555853b-bed3-422e-ae25-1a5c7048fee2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:11:33.833723 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5555853b-bed3-422e-ae25-1a5c7048fee2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:33.834400 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5555853b-bed3-422e-ae25-1a5c7048fee2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:33.835172 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5555853b-bed3-422e-ae25-1a5c7048fee2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:33.835607 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5555853b-bed3-422e-ae25-1a5c7048fee2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:33.900963 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-5555853b-bed3-422e-ae25-1a5c7048fee2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.082276 Nov 23 13:11:33.901549 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 688/1390] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:11:33 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:11:34.145671 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-c0e7fda8-4ee6-4e13-a66a-b893e5af2958 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:11:34.146145 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-c0e7fda8-4ee6-4e13-a66a-b893e5af2958 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:11:34.156509 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c0e7fda8-4ee6-4e13-a66a-b893e5af2958 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:34.156957 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c0e7fda8-4ee6-4e13-a66a-b893e5af2958 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:34.157735 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c0e7fda8-4ee6-4e13-a66a-b893e5af2958 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:34.158165 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c0e7fda8-4ee6-4e13-a66a-b893e5af2958 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:34.380057 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-c0e7fda8-4ee6-4e13-a66a-b893e5af2958 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:11:34.389378 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-c0e7fda8-4ee6-4e13-a66a-b893e5af2958 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.247740 Nov 23 13:11:34.389941 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 703/1391] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:11:34 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:11:34.913100 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-574087b5-4d5c-4db6-a793-e9e7e75a2a24 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:11:34.913980 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-574087b5-4d5c-4db6-a793-e9e7e75a2a24 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:11:34.921812 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-574087b5-4d5c-4db6-a793-e9e7e75a2a24 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:34.922261 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-574087b5-4d5c-4db6-a793-e9e7e75a2a24 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:34.923013 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-574087b5-4d5c-4db6-a793-e9e7e75a2a24 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:34.923436 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-574087b5-4d5c-4db6-a793-e9e7e75a2a24 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:35.005838 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-574087b5-4d5c-4db6-a793-e9e7e75a2a24 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.096644 Nov 23 13:11:35.006401 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 689/1392] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:11:34 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 13:11:35.412260 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-3f5b5494-1d94-4636-a714-c65d7fba4304 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:11:35.412990 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-3f5b5494-1d94-4636-a714-c65d7fba4304 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:11:35.420758 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3f5b5494-1d94-4636-a714-c65d7fba4304 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:35.421130 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3f5b5494-1d94-4636-a714-c65d7fba4304 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:35.421896 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3f5b5494-1d94-4636-a714-c65d7fba4304 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:35.422308 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3f5b5494-1d94-4636-a714-c65d7fba4304 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:35.656766 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-3f5b5494-1d94-4636-a714-c65d7fba4304 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:11:35.666394 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-3f5b5494-1d94-4636-a714-c65d7fba4304 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.257886 Nov 23 13:11:35.666963 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 704/1393] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:11:35 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:11:36.021254 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-b0707068-78ba-4ca2-b91a-f560862dfc0d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:11:36.022398 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-b0707068-78ba-4ca2-b91a-f560862dfc0d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:11:36.035226 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b0707068-78ba-4ca2-b91a-f560862dfc0d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:36.036013 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b0707068-78ba-4ca2-b91a-f560862dfc0d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:36.037443 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b0707068-78ba-4ca2-b91a-f560862dfc0d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:36.037888 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b0707068-78ba-4ca2-b91a-f560862dfc0d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:36.125741 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-b0707068-78ba-4ca2-b91a-f560862dfc0d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.111354 Nov 23 13:11:36.126448 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 690/1394] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:11:36 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:11:36.693571 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-638b38ab-6fcd-449f-b536-0a9946895f48 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:11:36.694639 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-638b38ab-6fcd-449f-b536-0a9946895f48 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:11:36.702452 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-638b38ab-6fcd-449f-b536-0a9946895f48 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:36.702908 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-638b38ab-6fcd-449f-b536-0a9946895f48 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:36.703674 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-638b38ab-6fcd-449f-b536-0a9946895f48 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:36.704101 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-638b38ab-6fcd-449f-b536-0a9946895f48 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:36.908498 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-638b38ab-6fcd-449f-b536-0a9946895f48 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:11:36.916882 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-638b38ab-6fcd-449f-b536-0a9946895f48 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.229251 Nov 23 13:11:36.917485 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 705/1395] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:11:36 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:11:37.143112 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-1278961c-54c0-4514-aa05-400dfd5b0d26 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:11:37.144624 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-1278961c-54c0-4514-aa05-400dfd5b0d26 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:11:37.157092 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-1278961c-54c0-4514-aa05-400dfd5b0d26 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:37.157819 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-1278961c-54c0-4514-aa05-400dfd5b0d26 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:37.159050 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-1278961c-54c0-4514-aa05-400dfd5b0d26 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:37.159751 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-1278961c-54c0-4514-aa05-400dfd5b0d26 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:37.225195 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-1278961c-54c0-4514-aa05-400dfd5b0d26 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.088628 Nov 23 13:11:37.225757 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 691/1396] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:11:37 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:11:37.942450 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-14148d5d-cb2b-441c-b9fa-f38c4ceefe53 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:11:37.943390 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-14148d5d-cb2b-441c-b9fa-f38c4ceefe53 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:11:37.952711 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-14148d5d-cb2b-441c-b9fa-f38c4ceefe53 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:37.953089 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-14148d5d-cb2b-441c-b9fa-f38c4ceefe53 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:37.953883 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-14148d5d-cb2b-441c-b9fa-f38c4ceefe53 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:37.954335 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-14148d5d-cb2b-441c-b9fa-f38c4ceefe53 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:38.172223 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-14148d5d-cb2b-441c-b9fa-f38c4ceefe53 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:11:38.185285 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-14148d5d-cb2b-441c-b9fa-f38c4ceefe53 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.248889 Nov 23 13:11:38.186027 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 706/1397] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:11:37 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:11:38.239769 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-cfdb217e-8265-431e-9f68-aa4392cb99fb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:11:38.240586 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-cfdb217e-8265-431e-9f68-aa4392cb99fb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:11:38.248581 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-cfdb217e-8265-431e-9f68-aa4392cb99fb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:38.249015 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-cfdb217e-8265-431e-9f68-aa4392cb99fb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:38.249765 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-cfdb217e-8265-431e-9f68-aa4392cb99fb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:38.250172 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-cfdb217e-8265-431e-9f68-aa4392cb99fb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:38.314911 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-cfdb217e-8265-431e-9f68-aa4392cb99fb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.079098 Nov 23 13:11:38.315489 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 692/1398] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:11:38 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 13:11:39.206482 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-375156ac-5d38-4720-8adf-f00c103a0698 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:11:39.207046 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-375156ac-5d38-4720-8adf-f00c103a0698 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:11:39.214710 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-375156ac-5d38-4720-8adf-f00c103a0698 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:39.215145 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-375156ac-5d38-4720-8adf-f00c103a0698 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:39.215899 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-375156ac-5d38-4720-8adf-f00c103a0698 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:39.216350 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-375156ac-5d38-4720-8adf-f00c103a0698 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:39.327745 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-2827c637-a845-4a3b-8713-72211bb514b8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:11:39.328896 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-2827c637-a845-4a3b-8713-72211bb514b8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:11:39.337002 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-2827c637-a845-4a3b-8713-72211bb514b8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:39.337452 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-2827c637-a845-4a3b-8713-72211bb514b8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:39.338206 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-2827c637-a845-4a3b-8713-72211bb514b8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:39.338660 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-2827c637-a845-4a3b-8713-72211bb514b8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:39.407029 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-2827c637-a845-4a3b-8713-72211bb514b8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.083740 Nov 23 13:11:39.407607 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 693/1399] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:11:39 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:11:39.422381 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-375156ac-5d38-4720-8adf-f00c103a0698 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:11:39.431289 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-375156ac-5d38-4720-8adf-f00c103a0698 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.228669 Nov 23 13:11:39.431827 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 707/1400] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:11:39 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:11:40.423378 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-7beee311-cd6e-4479-9588-e6c38655ca63 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:11:40.424754 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-7beee311-cd6e-4479-9588-e6c38655ca63 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:11:40.434479 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-7beee311-cd6e-4479-9588-e6c38655ca63 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:40.434926 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-7beee311-cd6e-4479-9588-e6c38655ca63 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:40.435679 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-7beee311-cd6e-4479-9588-e6c38655ca63 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:40.436106 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-7beee311-cd6e-4479-9588-e6c38655ca63 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:40.448374 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-4dea7661-1eb9-4656-a268-99ba4fbe6179 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:11:40.449019 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-4dea7661-1eb9-4656-a268-99ba4fbe6179 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:11:40.456730 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-4dea7661-1eb9-4656-a268-99ba4fbe6179 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:40.457186 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-4dea7661-1eb9-4656-a268-99ba4fbe6179 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:40.457946 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-4dea7661-1eb9-4656-a268-99ba4fbe6179 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:40.458371 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-4dea7661-1eb9-4656-a268-99ba4fbe6179 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:40.499995 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-7beee311-cd6e-4479-9588-e6c38655ca63 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.083045 Nov 23 13:11:40.500582 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 694/1401] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:11:40 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:11:40.666972 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-4dea7661-1eb9-4656-a268-99ba4fbe6179 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:11:40.675918 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-4dea7661-1eb9-4656-a268-99ba4fbe6179 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.231277 Nov 23 13:11:40.686094 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 708/1402] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:11:40 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:11:41.516454 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-a8c366e3-1b76-40b3-8a2a-33422089d1f9 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:11:41.517814 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-a8c366e3-1b76-40b3-8a2a-33422089d1f9 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:11:41.527818 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a8c366e3-1b76-40b3-8a2a-33422089d1f9 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:41.528269 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a8c366e3-1b76-40b3-8a2a-33422089d1f9 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:41.529051 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a8c366e3-1b76-40b3-8a2a-33422089d1f9 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:41.529476 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a8c366e3-1b76-40b3-8a2a-33422089d1f9 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:41.592284 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-a8c366e3-1b76-40b3-8a2a-33422089d1f9 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.082489 Nov 23 13:11:41.592854 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 695/1403] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:11:41 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:11:41.696200 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-f2e78cb4-2f86-458f-b83b-2708558e3e78 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:11:41.697069 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-f2e78cb4-2f86-458f-b83b-2708558e3e78 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:11:41.708540 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f2e78cb4-2f86-458f-b83b-2708558e3e78 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:41.709059 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f2e78cb4-2f86-458f-b83b-2708558e3e78 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:41.709874 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f2e78cb4-2f86-458f-b83b-2708558e3e78 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:41.710607 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f2e78cb4-2f86-458f-b83b-2708558e3e78 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:41.923338 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-f2e78cb4-2f86-458f-b83b-2708558e3e78 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:11:41.932306 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-f2e78cb4-2f86-458f-b83b-2708558e3e78 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.241701 Nov 23 13:11:41.932871 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 709/1404] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:11:41 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:11:42.606562 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-a3393427-8a61-4011-9560-e434ffcc06db tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:11:42.607480 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-a3393427-8a61-4011-9560-e434ffcc06db tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:11:42.615214 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a3393427-8a61-4011-9560-e434ffcc06db tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:42.615658 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a3393427-8a61-4011-9560-e434ffcc06db tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:42.616433 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a3393427-8a61-4011-9560-e434ffcc06db tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:42.616831 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a3393427-8a61-4011-9560-e434ffcc06db tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:42.681032 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-a3393427-8a61-4011-9560-e434ffcc06db tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.078468 Nov 23 13:11:42.681576 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 696/1405] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:11:42 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:11:42.949818 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-c463c11e-4979-4c29-b102-79589c6221aa tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:11:42.950426 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-c463c11e-4979-4c29-b102-79589c6221aa tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:11:42.958201 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c463c11e-4979-4c29-b102-79589c6221aa tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:42.958653 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c463c11e-4979-4c29-b102-79589c6221aa tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:42.959430 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c463c11e-4979-4c29-b102-79589c6221aa tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:42.959862 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c463c11e-4979-4c29-b102-79589c6221aa tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:43.171208 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-c463c11e-4979-4c29-b102-79589c6221aa tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:11:43.184037 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-c463c11e-4979-4c29-b102-79589c6221aa tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.237988 Nov 23 13:11:43.184889 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 710/1406] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:11:42 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:11:43.694315 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-38b5b14e-6a8d-46f3-a498-9909d0e0a6dd tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:11:43.695704 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-38b5b14e-6a8d-46f3-a498-9909d0e0a6dd tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:11:43.705538 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-38b5b14e-6a8d-46f3-a498-9909d0e0a6dd tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:43.706029 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-38b5b14e-6a8d-46f3-a498-9909d0e0a6dd tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:43.706839 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-38b5b14e-6a8d-46f3-a498-9909d0e0a6dd tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:43.707336 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-38b5b14e-6a8d-46f3-a498-9909d0e0a6dd tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:43.793239 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-38b5b14e-6a8d-46f3-a498-9909d0e0a6dd tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.104010 Nov 23 13:11:43.793787 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 697/1407] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:11:43 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:11:44.210641 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-2e966186-0aa1-4e15-b083-2500bc07e130 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:11:44.211499 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-2e966186-0aa1-4e15-b083-2500bc07e130 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:11:44.219428 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2e966186-0aa1-4e15-b083-2500bc07e130 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:44.219868 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2e966186-0aa1-4e15-b083-2500bc07e130 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:44.220648 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2e966186-0aa1-4e15-b083-2500bc07e130 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:44.221073 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2e966186-0aa1-4e15-b083-2500bc07e130 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:44.434270 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-2e966186-0aa1-4e15-b083-2500bc07e130 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:11:44.443223 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-2e966186-0aa1-4e15-b083-2500bc07e130 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.238938 Nov 23 13:11:44.443904 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 711/1408] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:11:44 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:11:44.809263 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-d9e36e71-1863-4c2f-a907-524c2c459caa tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:11:44.810719 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-d9e36e71-1863-4c2f-a907-524c2c459caa tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:11:44.822670 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d9e36e71-1863-4c2f-a907-524c2c459caa tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:44.823152 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d9e36e71-1863-4c2f-a907-524c2c459caa tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:44.823913 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d9e36e71-1863-4c2f-a907-524c2c459caa tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:44.824380 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d9e36e71-1863-4c2f-a907-524c2c459caa tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:44.888608 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-d9e36e71-1863-4c2f-a907-524c2c459caa tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.085897 Nov 23 13:11:44.889166 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 698/1409] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:11:44 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:11:45.466776 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-da7b6616-60f0-498c-9f86-676beebc8cee tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:11:45.467694 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-da7b6616-60f0-498c-9f86-676beebc8cee tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:11:45.479266 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-da7b6616-60f0-498c-9f86-676beebc8cee tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:45.479699 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-da7b6616-60f0-498c-9f86-676beebc8cee tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:45.480490 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-da7b6616-60f0-498c-9f86-676beebc8cee tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:45.480917 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-da7b6616-60f0-498c-9f86-676beebc8cee tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:45.707861 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-da7b6616-60f0-498c-9f86-676beebc8cee tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:11:45.724730 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-da7b6616-60f0-498c-9f86-676beebc8cee tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.264392 Nov 23 13:11:45.725243 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 712/1410] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:11:45 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:11:45.901767 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-fbd8f75a-abaa-4ebd-94b8-75dcef5ee153 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:11:45.902689 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-fbd8f75a-abaa-4ebd-94b8-75dcef5ee153 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:11:45.910687 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-fbd8f75a-abaa-4ebd-94b8-75dcef5ee153 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:45.911130 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-fbd8f75a-abaa-4ebd-94b8-75dcef5ee153 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:45.911881 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-fbd8f75a-abaa-4ebd-94b8-75dcef5ee153 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:45.912332 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-fbd8f75a-abaa-4ebd-94b8-75dcef5ee153 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:45.975776 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-fbd8f75a-abaa-4ebd-94b8-75dcef5ee153 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.077838 Nov 23 13:11:45.976304 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 699/1411] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:11:45 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:11:46.747361 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-905de937-769b-431a-8a91-e1246abd683f tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:11:46.748572 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-905de937-769b-431a-8a91-e1246abd683f tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:11:46.761015 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-905de937-769b-431a-8a91-e1246abd683f tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:46.761777 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-905de937-769b-431a-8a91-e1246abd683f tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:46.763104 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-905de937-769b-431a-8a91-e1246abd683f tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:46.763820 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-905de937-769b-431a-8a91-e1246abd683f tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:46.964313 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-905de937-769b-431a-8a91-e1246abd683f tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:11:46.972675 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-905de937-769b-431a-8a91-e1246abd683f tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.232259 Nov 23 13:11:46.973249 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 713/1412] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:11:46 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:11:46.988829 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-25e7fd55-ae65-4914-8fb5-30c6725e4d3c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:11:46.989976 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-25e7fd55-ae65-4914-8fb5-30c6725e4d3c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:11:47.001963 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-25e7fd55-ae65-4914-8fb5-30c6725e4d3c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:47.002461 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-25e7fd55-ae65-4914-8fb5-30c6725e4d3c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:47.003600 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-25e7fd55-ae65-4914-8fb5-30c6725e4d3c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:47.004144 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-25e7fd55-ae65-4914-8fb5-30c6725e4d3c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:47.068973 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-25e7fd55-ae65-4914-8fb5-30c6725e4d3c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.085782 Nov 23 13:11:47.069529 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 700/1413] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:11:46 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:11:47.995105 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-028fc02a-9888-4bf4-ab83-83ce4e990bad tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:11:47.995913 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-028fc02a-9888-4bf4-ab83-83ce4e990bad tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:11:48.006030 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-028fc02a-9888-4bf4-ab83-83ce4e990bad tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:48.006625 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-028fc02a-9888-4bf4-ab83-83ce4e990bad tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:48.007631 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-028fc02a-9888-4bf4-ab83-83ce4e990bad tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:48.008175 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-028fc02a-9888-4bf4-ab83-83ce4e990bad tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:48.082661 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-89ab0f54-f2b6-4001-82f2-a81a91c218b3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:11:48.084293 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-89ab0f54-f2b6-4001-82f2-a81a91c218b3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:11:48.093054 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-89ab0f54-f2b6-4001-82f2-a81a91c218b3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:48.093602 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-89ab0f54-f2b6-4001-82f2-a81a91c218b3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:48.094464 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-89ab0f54-f2b6-4001-82f2-a81a91c218b3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:48.094966 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-89ab0f54-f2b6-4001-82f2-a81a91c218b3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:48.162945 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-89ab0f54-f2b6-4001-82f2-a81a91c218b3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.085409 Nov 23 13:11:48.163615 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 701/1414] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:11:48 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:11:48.214762 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-028fc02a-9888-4bf4-ab83-83ce4e990bad tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:11:48.223562 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-028fc02a-9888-4bf4-ab83-83ce4e990bad tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.234612 Nov 23 13:11:48.224136 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 714/1415] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:11:47 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:11:49.179801 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-308655cd-e875-4699-8fa5-1d9b4c03aed2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:11:49.181452 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-308655cd-e875-4699-8fa5-1d9b4c03aed2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:11:49.194011 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-308655cd-e875-4699-8fa5-1d9b4c03aed2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:49.194743 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-308655cd-e875-4699-8fa5-1d9b4c03aed2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:49.195992 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-308655cd-e875-4699-8fa5-1d9b4c03aed2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:49.196822 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-308655cd-e875-4699-8fa5-1d9b4c03aed2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:49.241185 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-d65d1af6-aa3e-4511-b2b0-9cd5933bbdc0 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:11:49.241792 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-d65d1af6-aa3e-4511-b2b0-9cd5933bbdc0 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:11:49.250331 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d65d1af6-aa3e-4511-b2b0-9cd5933bbdc0 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:49.250753 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d65d1af6-aa3e-4511-b2b0-9cd5933bbdc0 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:49.251582 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d65d1af6-aa3e-4511-b2b0-9cd5933bbdc0 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:49.252042 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d65d1af6-aa3e-4511-b2b0-9cd5933bbdc0 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:49.265142 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-308655cd-e875-4699-8fa5-1d9b4c03aed2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.091913 Nov 23 13:11:49.266653 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 702/1416] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:11:49 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:11:49.460647 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-d65d1af6-aa3e-4511-b2b0-9cd5933bbdc0 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:11:49.469355 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-d65d1af6-aa3e-4511-b2b0-9cd5933bbdc0 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.232210 Nov 23 13:11:49.470000 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 715/1417] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:11:49 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:11:50.281558 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-0f613889-1818-46f6-b5ed-952578e2b18f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:11:50.283066 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-0f613889-1818-46f6-b5ed-952578e2b18f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:11:50.296016 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0f613889-1818-46f6-b5ed-952578e2b18f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:50.296829 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0f613889-1818-46f6-b5ed-952578e2b18f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:50.298311 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0f613889-1818-46f6-b5ed-952578e2b18f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:50.299029 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0f613889-1818-46f6-b5ed-952578e2b18f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:50.366057 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-0f613889-1818-46f6-b5ed-952578e2b18f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.090992 Nov 23 13:11:50.366624 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 703/1418] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:11:50 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:11:50.490871 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-eadc82a0-b5b1-40f5-abdb-6ea79537a1a5 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:11:50.491850 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-eadc82a0-b5b1-40f5-abdb-6ea79537a1a5 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:11:50.500885 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-eadc82a0-b5b1-40f5-abdb-6ea79537a1a5 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:50.501324 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-eadc82a0-b5b1-40f5-abdb-6ea79537a1a5 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:50.502089 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-eadc82a0-b5b1-40f5-abdb-6ea79537a1a5 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:50.502520 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-eadc82a0-b5b1-40f5-abdb-6ea79537a1a5 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:50.706179 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-eadc82a0-b5b1-40f5-abdb-6ea79537a1a5 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:11:50.718847 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-eadc82a0-b5b1-40f5-abdb-6ea79537a1a5 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.234122 Nov 23 13:11:50.719592 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 716/1419] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:11:50 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:11:51.378722 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-e85049e0-e97a-4961-9167-b7c5b2e296c2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:11:51.379662 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-e85049e0-e97a-4961-9167-b7c5b2e296c2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:11:51.388069 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e85049e0-e97a-4961-9167-b7c5b2e296c2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:51.388548 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e85049e0-e97a-4961-9167-b7c5b2e296c2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:51.389317 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e85049e0-e97a-4961-9167-b7c5b2e296c2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:51.389835 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e85049e0-e97a-4961-9167-b7c5b2e296c2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:51.454669 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-e85049e0-e97a-4961-9167-b7c5b2e296c2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.079839 Nov 23 13:11:51.455230 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 704/1420] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:11:51 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:11:51.736557 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-ec8eed9c-01f2-414c-b48b-04b02f4ae27e tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:11:51.737150 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-ec8eed9c-01f2-414c-b48b-04b02f4ae27e tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:11:51.745176 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ec8eed9c-01f2-414c-b48b-04b02f4ae27e tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:51.745629 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ec8eed9c-01f2-414c-b48b-04b02f4ae27e tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:51.746409 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ec8eed9c-01f2-414c-b48b-04b02f4ae27e tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:51.746831 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ec8eed9c-01f2-414c-b48b-04b02f4ae27e tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:51.954051 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-ec8eed9c-01f2-414c-b48b-04b02f4ae27e tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:11:51.962377 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-ec8eed9c-01f2-414c-b48b-04b02f4ae27e tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.229597 Nov 23 13:11:51.962974 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 717/1421] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:11:51 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:11:52.468907 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-3613df62-ad76-47f8-a8c8-bca8329f87b9 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:11:52.470019 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-3613df62-ad76-47f8-a8c8-bca8329f87b9 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:11:52.479605 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-3613df62-ad76-47f8-a8c8-bca8329f87b9 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:52.480161 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-3613df62-ad76-47f8-a8c8-bca8329f87b9 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:52.481167 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-3613df62-ad76-47f8-a8c8-bca8329f87b9 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:52.481701 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-3613df62-ad76-47f8-a8c8-bca8329f87b9 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:52.551468 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-3613df62-ad76-47f8-a8c8-bca8329f87b9 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.087404 Nov 23 13:11:52.552071 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 705/1422] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:11:52 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:11:52.982525 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-188777c4-e275-4e01-b556-14a43cd1e7b9 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:11:52.983176 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-188777c4-e275-4e01-b556-14a43cd1e7b9 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:11:52.992430 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-188777c4-e275-4e01-b556-14a43cd1e7b9 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:52.992925 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-188777c4-e275-4e01-b556-14a43cd1e7b9 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:52.994180 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-188777c4-e275-4e01-b556-14a43cd1e7b9 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:52.994965 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-188777c4-e275-4e01-b556-14a43cd1e7b9 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:53.202054 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-188777c4-e275-4e01-b556-14a43cd1e7b9 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:11:53.210641 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-188777c4-e275-4e01-b556-14a43cd1e7b9 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.233701 Nov 23 13:11:53.211208 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 718/1423] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:11:52 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:11:53.567901 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-441139ec-aaaa-4287-9e28-761df5353051 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:11:53.569497 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-441139ec-aaaa-4287-9e28-761df5353051 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:11:53.578734 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-441139ec-aaaa-4287-9e28-761df5353051 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:53.579180 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-441139ec-aaaa-4287-9e28-761df5353051 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:53.579950 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-441139ec-aaaa-4287-9e28-761df5353051 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:53.580432 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-441139ec-aaaa-4287-9e28-761df5353051 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:53.650292 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-441139ec-aaaa-4287-9e28-761df5353051 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.088724 Nov 23 13:11:53.651025 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 706/1424] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:11:53 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:11:54.232414 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-33beb680-eaed-4fa6-8540-9fff71a5b645 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:11:54.233267 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-33beb680-eaed-4fa6-8540-9fff71a5b645 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:11:54.246604 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-33beb680-eaed-4fa6-8540-9fff71a5b645 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:54.247058 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-33beb680-eaed-4fa6-8540-9fff71a5b645 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:54.247832 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-33beb680-eaed-4fa6-8540-9fff71a5b645 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:54.248266 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-33beb680-eaed-4fa6-8540-9fff71a5b645 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:54.523056 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-33beb680-eaed-4fa6-8540-9fff71a5b645 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:11:54.531436 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-33beb680-eaed-4fa6-8540-9fff71a5b645 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.305826 Nov 23 13:11:54.531997 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 719/1425] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:11:54 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:11:54.666601 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-9bac9f17-f168-4a24-a207-09c65c0f737b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:11:54.667803 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-9bac9f17-f168-4a24-a207-09c65c0f737b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:11:54.675851 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-9bac9f17-f168-4a24-a207-09c65c0f737b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:54.676342 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-9bac9f17-f168-4a24-a207-09c65c0f737b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:54.677113 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-9bac9f17-f168-4a24-a207-09c65c0f737b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:54.677545 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-9bac9f17-f168-4a24-a207-09c65c0f737b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:54.741066 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-9bac9f17-f168-4a24-a207-09c65c0f737b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.079570 Nov 23 13:11:54.741625 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 707/1426] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:11:54 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:11:55.547930 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-9ed5c035-3eb6-4b54-bc5d-6182357608ac tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:11:55.548557 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-9ed5c035-3eb6-4b54-bc5d-6182357608ac tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:11:55.556450 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-9ed5c035-3eb6-4b54-bc5d-6182357608ac tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:55.556898 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-9ed5c035-3eb6-4b54-bc5d-6182357608ac tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:55.557679 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-9ed5c035-3eb6-4b54-bc5d-6182357608ac tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:55.558103 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-9ed5c035-3eb6-4b54-bc5d-6182357608ac tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:55.754294 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-4bb46f16-7e54-43b2-90ad-047230a35003 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:11:55.755435 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-4bb46f16-7e54-43b2-90ad-047230a35003 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:11:55.765549 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4bb46f16-7e54-43b2-90ad-047230a35003 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:55.765928 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4bb46f16-7e54-43b2-90ad-047230a35003 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:55.766865 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4bb46f16-7e54-43b2-90ad-047230a35003 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:55.767252 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4bb46f16-7e54-43b2-90ad-047230a35003 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:55.770334 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-9ed5c035-3eb6-4b54-bc5d-6182357608ac tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:11:55.782533 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-9ed5c035-3eb6-4b54-bc5d-6182357608ac tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.238530 Nov 23 13:11:55.783359 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 720/1427] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:11:55 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:11:55.846172 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-4bb46f16-7e54-43b2-90ad-047230a35003 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.096601 Nov 23 13:11:55.846726 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 708/1428] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:11:55 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:11:56.811262 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-46be1dd2-3040-47c6-be20-dfde3e72be48 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:11:56.811830 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-46be1dd2-3040-47c6-be20-dfde3e72be48 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:11:56.822459 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-46be1dd2-3040-47c6-be20-dfde3e72be48 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:56.822920 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-46be1dd2-3040-47c6-be20-dfde3e72be48 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:56.823696 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-46be1dd2-3040-47c6-be20-dfde3e72be48 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:56.824121 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-46be1dd2-3040-47c6-be20-dfde3e72be48 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:56.858268 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-65b6d8d7-7a64-4e4e-930e-8f3da4679a1a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:11:56.859212 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-65b6d8d7-7a64-4e4e-930e-8f3da4679a1a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:11:56.866671 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-65b6d8d7-7a64-4e4e-930e-8f3da4679a1a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:56.867126 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-65b6d8d7-7a64-4e4e-930e-8f3da4679a1a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:56.868225 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-65b6d8d7-7a64-4e4e-930e-8f3da4679a1a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:56.868690 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-65b6d8d7-7a64-4e4e-930e-8f3da4679a1a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:56.937513 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-65b6d8d7-7a64-4e4e-930e-8f3da4679a1a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.083172 Nov 23 13:11:56.938081 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 709/1429] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:11:56 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:11:57.025700 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-46be1dd2-3040-47c6-be20-dfde3e72be48 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:11:57.034095 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-46be1dd2-3040-47c6-be20-dfde3e72be48 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.231417 Nov 23 13:11:57.034634 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 721/1430] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:11:56 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:11:57.950602 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-118b4738-eed8-4eb4-a634-7cda804d3809 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:11:57.951577 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-118b4738-eed8-4eb4-a634-7cda804d3809 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:11:57.960515 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-118b4738-eed8-4eb4-a634-7cda804d3809 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:57.960998 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-118b4738-eed8-4eb4-a634-7cda804d3809 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:57.961861 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-118b4738-eed8-4eb4-a634-7cda804d3809 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:57.962305 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-118b4738-eed8-4eb4-a634-7cda804d3809 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:58.027692 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-118b4738-eed8-4eb4-a634-7cda804d3809 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.081780 Nov 23 13:11:58.028284 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 710/1431] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:11:57 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:11:58.057593 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-5eb58f88-abe4-4291-826e-356b9c5f4253 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:11:58.058412 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-5eb58f88-abe4-4291-826e-356b9c5f4253 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:11:58.066960 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5eb58f88-abe4-4291-826e-356b9c5f4253 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:58.067451 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5eb58f88-abe4-4291-826e-356b9c5f4253 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:58.068216 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5eb58f88-abe4-4291-826e-356b9c5f4253 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:58.068671 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5eb58f88-abe4-4291-826e-356b9c5f4253 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:58.283510 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-5eb58f88-abe4-4291-826e-356b9c5f4253 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:11:58.292028 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-5eb58f88-abe4-4291-826e-356b9c5f4253 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.240640 Nov 23 13:11:58.292664 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 722/1432] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:11:58 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:11:59.043590 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-d37fcc10-e123-48ad-89f0-65b47d552f51 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:11:59.045470 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-d37fcc10-e123-48ad-89f0-65b47d552f51 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:11:59.057901 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d37fcc10-e123-48ad-89f0-65b47d552f51 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:59.058627 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d37fcc10-e123-48ad-89f0-65b47d552f51 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:59.059990 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d37fcc10-e123-48ad-89f0-65b47d552f51 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:59.060443 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d37fcc10-e123-48ad-89f0-65b47d552f51 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:59.124964 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-d37fcc10-e123-48ad-89f0-65b47d552f51 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.087877 Nov 23 13:11:59.125534 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 711/1433] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:11:59 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:11:59.309660 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-b855bb45-2b2d-412a-813c-6ea855ad815e tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:11:59.310252 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-b855bb45-2b2d-412a-813c-6ea855ad815e tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:11:59.317962 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b855bb45-2b2d-412a-813c-6ea855ad815e tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:59.318398 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b855bb45-2b2d-412a-813c-6ea855ad815e tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:59.319157 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b855bb45-2b2d-412a-813c-6ea855ad815e tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:11:59.319575 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b855bb45-2b2d-412a-813c-6ea855ad815e tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:11:59.517927 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-b855bb45-2b2d-412a-813c-6ea855ad815e tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:11:59.526319 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-b855bb45-2b2d-412a-813c-6ea855ad815e tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.220541 Nov 23 13:11:59.526883 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 723/1434] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:11:59 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:12:00.140835 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-5e01df3a-ec32-4852-97d1-59c87c009f86 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:12:00.142006 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-5e01df3a-ec32-4852-97d1-59c87c009f86 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:12:00.151603 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5e01df3a-ec32-4852-97d1-59c87c009f86 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:00.152161 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5e01df3a-ec32-4852-97d1-59c87c009f86 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:00.153170 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5e01df3a-ec32-4852-97d1-59c87c009f86 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:00.153711 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5e01df3a-ec32-4852-97d1-59c87c009f86 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:00.223618 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-5e01df3a-ec32-4852-97d1-59c87c009f86 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.088725 Nov 23 13:12:00.224464 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 712/1435] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:12:00 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:12:00.543786 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-b089ad8c-2319-40f0-bac7-a58b3ae57e2b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:12:00.544386 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-b089ad8c-2319-40f0-bac7-a58b3ae57e2b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:12:00.551941 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b089ad8c-2319-40f0-bac7-a58b3ae57e2b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:00.552409 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b089ad8c-2319-40f0-bac7-a58b3ae57e2b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:00.553180 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b089ad8c-2319-40f0-bac7-a58b3ae57e2b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:00.553634 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b089ad8c-2319-40f0-bac7-a58b3ae57e2b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:00.759439 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-b089ad8c-2319-40f0-bac7-a58b3ae57e2b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:12:00.768069 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-b089ad8c-2319-40f0-bac7-a58b3ae57e2b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.228123 Nov 23 13:12:00.768676 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 724/1436] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:12:00 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:12:01.240325 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-bb6ab284-371f-4d39-ba52-718bad2a02af tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:12:01.241879 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-bb6ab284-371f-4d39-ba52-718bad2a02af tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:12:01.252518 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-bb6ab284-371f-4d39-ba52-718bad2a02af tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:01.252966 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-bb6ab284-371f-4d39-ba52-718bad2a02af tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:01.253739 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-bb6ab284-371f-4d39-ba52-718bad2a02af tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:01.254168 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-bb6ab284-371f-4d39-ba52-718bad2a02af tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:01.320905 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-bb6ab284-371f-4d39-ba52-718bad2a02af tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.087155 Nov 23 13:12:01.321481 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 713/1437] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:12:01 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:12:01.788729 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-68119c4c-9337-4e46-bdee-8c6fb1819ebc tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:12:01.789693 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-68119c4c-9337-4e46-bdee-8c6fb1819ebc tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:12:01.802795 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-68119c4c-9337-4e46-bdee-8c6fb1819ebc tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:01.803543 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-68119c4c-9337-4e46-bdee-8c6fb1819ebc tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:01.804880 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-68119c4c-9337-4e46-bdee-8c6fb1819ebc tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:01.805602 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-68119c4c-9337-4e46-bdee-8c6fb1819ebc tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:02.028680 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-68119c4c-9337-4e46-bdee-8c6fb1819ebc tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:12:02.037924 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-68119c4c-9337-4e46-bdee-8c6fb1819ebc tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.255348 Nov 23 13:12:02.038393 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 725/1438] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:12:01 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:12:02.336626 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-f4f5ad1a-1643-4d5c-a502-59b42a99ae3b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:12:02.337977 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-f4f5ad1a-1643-4d5c-a502-59b42a99ae3b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:12:02.350830 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f4f5ad1a-1643-4d5c-a502-59b42a99ae3b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:02.351579 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f4f5ad1a-1643-4d5c-a502-59b42a99ae3b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:02.352957 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f4f5ad1a-1643-4d5c-a502-59b42a99ae3b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:02.353680 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f4f5ad1a-1643-4d5c-a502-59b42a99ae3b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:02.419395 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-f4f5ad1a-1643-4d5c-a502-59b42a99ae3b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.089531 Nov 23 13:12:02.420027 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 714/1439] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:12:02 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:12:03.056806 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-5e605601-1a8b-48d5-bda7-01435955aacb tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:12:03.057508 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-5e605601-1a8b-48d5-bda7-01435955aacb tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:12:03.067260 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5e605601-1a8b-48d5-bda7-01435955aacb tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:03.067832 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5e605601-1a8b-48d5-bda7-01435955aacb tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:03.068872 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5e605601-1a8b-48d5-bda7-01435955aacb tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:03.069447 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5e605601-1a8b-48d5-bda7-01435955aacb tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:03.291804 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-5e605601-1a8b-48d5-bda7-01435955aacb tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:12:03.300712 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-5e605601-1a8b-48d5-bda7-01435955aacb tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.248634 Nov 23 13:12:03.301275 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 726/1440] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:12:03 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:12:03.437122 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-d616041a-3d4e-4604-8362-f044b1d03ca5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:12:03.438017 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-d616041a-3d4e-4604-8362-f044b1d03ca5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:12:03.446244 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d616041a-3d4e-4604-8362-f044b1d03ca5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:03.446718 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d616041a-3d4e-4604-8362-f044b1d03ca5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:03.447526 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d616041a-3d4e-4604-8362-f044b1d03ca5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:03.447976 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d616041a-3d4e-4604-8362-f044b1d03ca5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:03.513237 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-d616041a-3d4e-4604-8362-f044b1d03ca5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.082902 Nov 23 13:12:03.513797 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 715/1441] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:12:03 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:12:04.319898 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-bd98f268-b0f8-49d8-bd4c-766b7c71b922 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:12:04.320645 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-bd98f268-b0f8-49d8-bd4c-766b7c71b922 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:12:04.329612 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-bd98f268-b0f8-49d8-bd4c-766b7c71b922 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:04.330059 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-bd98f268-b0f8-49d8-bd4c-766b7c71b922 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:04.330835 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-bd98f268-b0f8-49d8-bd4c-766b7c71b922 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:04.331267 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-bd98f268-b0f8-49d8-bd4c-766b7c71b922 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:04.525033 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-aac660aa-50d7-4265-8190-664f023b7e2a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:12:04.526012 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-aac660aa-50d7-4265-8190-664f023b7e2a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:12:04.533847 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-aac660aa-50d7-4265-8190-664f023b7e2a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:04.534298 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-aac660aa-50d7-4265-8190-664f023b7e2a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:04.535083 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-aac660aa-50d7-4265-8190-664f023b7e2a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:04.535509 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-aac660aa-50d7-4265-8190-664f023b7e2a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:04.545019 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-bd98f268-b0f8-49d8-bd4c-766b7c71b922 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:12:04.553537 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-bd98f268-b0f8-49d8-bd4c-766b7c71b922 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.238255 Nov 23 13:12:04.554127 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 727/1442] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:12:04 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:12:04.599042 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-aac660aa-50d7-4265-8190-664f023b7e2a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.078374 Nov 23 13:12:04.599525 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 716/1443] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:12:04 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:12:05.574899 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-6c17b7a6-e1d8-4eec-a890-7c1e46cc629a tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:12:05.575848 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-6c17b7a6-e1d8-4eec-a890-7c1e46cc629a tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:12:05.588553 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-6c17b7a6-e1d8-4eec-a890-7c1e46cc629a tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:05.589401 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-6c17b7a6-e1d8-4eec-a890-7c1e46cc629a tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:05.590592 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-6c17b7a6-e1d8-4eec-a890-7c1e46cc629a tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:05.591310 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-6c17b7a6-e1d8-4eec-a890-7c1e46cc629a tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:05.611055 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-4b701911-ddb3-48e0-ab3f-4f8045be3870 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:12:05.612072 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-4b701911-ddb3-48e0-ab3f-4f8045be3870 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:12:05.620380 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4b701911-ddb3-48e0-ab3f-4f8045be3870 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:05.620829 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4b701911-ddb3-48e0-ab3f-4f8045be3870 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:05.621602 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4b701911-ddb3-48e0-ab3f-4f8045be3870 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:05.622029 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4b701911-ddb3-48e0-ab3f-4f8045be3870 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:05.689740 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-4b701911-ddb3-48e0-ab3f-4f8045be3870 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.082635 Nov 23 13:12:05.690424 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 717/1444] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:12:05 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:12:05.789382 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-6c17b7a6-e1d8-4eec-a890-7c1e46cc629a tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:12:05.798547 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-6c17b7a6-e1d8-4eec-a890-7c1e46cc629a tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.230064 Nov 23 13:12:05.799143 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 728/1445] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:12:05 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:12:06.705345 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-5124751c-4c13-45a3-a421-1cb8eff05d06 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:12:06.706543 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-5124751c-4c13-45a3-a421-1cb8eff05d06 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:12:06.716181 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5124751c-4c13-45a3-a421-1cb8eff05d06 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:06.716783 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5124751c-4c13-45a3-a421-1cb8eff05d06 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:06.717743 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5124751c-4c13-45a3-a421-1cb8eff05d06 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:06.718315 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5124751c-4c13-45a3-a421-1cb8eff05d06 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:06.939775 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-5124751c-4c13-45a3-a421-1cb8eff05d06 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.240425 Nov 23 13:12:06.940367 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 718/1446] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:12:06 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:12:06.953457 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-47b86cfd-ba2c-49f1-9a4e-d25c8dd3bbf0 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:12:06.954144 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-47b86cfd-ba2c-49f1-9a4e-d25c8dd3bbf0 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:12:06.961990 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-47b86cfd-ba2c-49f1-9a4e-d25c8dd3bbf0 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:06.962353 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-47b86cfd-ba2c-49f1-9a4e-d25c8dd3bbf0 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:06.963117 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-47b86cfd-ba2c-49f1-9a4e-d25c8dd3bbf0 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:06.963539 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-47b86cfd-ba2c-49f1-9a4e-d25c8dd3bbf0 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:07.167274 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-47b86cfd-ba2c-49f1-9a4e-d25c8dd3bbf0 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:12:07.176282 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-47b86cfd-ba2c-49f1-9a4e-d25c8dd3bbf0 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.364924 Nov 23 13:12:07.185724 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 729/1447] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:12:06 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:12:07.956416 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-b2b7d622-3e55-4236-a002-3b50e06ab93a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:12:07.957746 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-b2b7d622-3e55-4236-a002-3b50e06ab93a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:12:07.969548 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b2b7d622-3e55-4236-a002-3b50e06ab93a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:07.969997 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b2b7d622-3e55-4236-a002-3b50e06ab93a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:07.970760 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b2b7d622-3e55-4236-a002-3b50e06ab93a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:07.971182 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b2b7d622-3e55-4236-a002-3b50e06ab93a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:08.041969 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-b2b7d622-3e55-4236-a002-3b50e06ab93a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.092553 Nov 23 13:12:08.042545 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 719/1448] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:12:07 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:12:08.198404 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-40b3aa4c-48b1-44cb-bca2-89139c322ce4 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:12:08.198404 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-40b3aa4c-48b1-44cb-bca2-89139c322ce4 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:12:08.207699 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-40b3aa4c-48b1-44cb-bca2-89139c322ce4 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:08.208150 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-40b3aa4c-48b1-44cb-bca2-89139c322ce4 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:08.208967 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-40b3aa4c-48b1-44cb-bca2-89139c322ce4 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:08.209397 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-40b3aa4c-48b1-44cb-bca2-89139c322ce4 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:08.407359 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-40b3aa4c-48b1-44cb-bca2-89139c322ce4 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:12:08.415749 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-40b3aa4c-48b1-44cb-bca2-89139c322ce4 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.225002 Nov 23 13:12:08.416337 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 730/1449] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:12:08 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:12:09.057916 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-f972799d-3955-4014-8047-12d0c754925c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:12:09.059385 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-f972799d-3955-4014-8047-12d0c754925c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:12:09.073144 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f972799d-3955-4014-8047-12d0c754925c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:09.073940 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f972799d-3955-4014-8047-12d0c754925c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:09.075164 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f972799d-3955-4014-8047-12d0c754925c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:09.075867 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f972799d-3955-4014-8047-12d0c754925c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:09.148595 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-f972799d-3955-4014-8047-12d0c754925c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.096959 Nov 23 13:12:09.149054 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 720/1450] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:12:09 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:12:09.436826 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-2f9696c8-7466-4276-9d24-99631d7b329b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:12:09.437440 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-2f9696c8-7466-4276-9d24-99631d7b329b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:12:09.444894 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2f9696c8-7466-4276-9d24-99631d7b329b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:09.445346 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2f9696c8-7466-4276-9d24-99631d7b329b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:09.446139 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2f9696c8-7466-4276-9d24-99631d7b329b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:09.446546 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2f9696c8-7466-4276-9d24-99631d7b329b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:09.653364 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-2f9696c8-7466-4276-9d24-99631d7b329b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:12:09.662823 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-2f9696c8-7466-4276-9d24-99631d7b329b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.231422 Nov 23 13:12:09.663406 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 731/1451] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:12:09 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:12:10.160737 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-ed66a0e0-cc6b-4500-882f-249d3db5eeda tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:12:10.161645 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-ed66a0e0-cc6b-4500-882f-249d3db5eeda tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:12:10.169321 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ed66a0e0-cc6b-4500-882f-249d3db5eeda tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:10.169774 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ed66a0e0-cc6b-4500-882f-249d3db5eeda tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:10.170548 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ed66a0e0-cc6b-4500-882f-249d3db5eeda tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:10.170977 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ed66a0e0-cc6b-4500-882f-249d3db5eeda tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:10.235067 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-ed66a0e0-cc6b-4500-882f-249d3db5eeda tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.078255 Nov 23 13:12:10.235653 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 721/1452] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:12:10 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:12:10.680499 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-0e1024bf-590e-487a-bb6a-8b30dff22d00 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:12:10.681101 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-0e1024bf-590e-487a-bb6a-8b30dff22d00 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:12:10.689430 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0e1024bf-590e-487a-bb6a-8b30dff22d00 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:10.689879 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0e1024bf-590e-487a-bb6a-8b30dff22d00 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:10.690643 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0e1024bf-590e-487a-bb6a-8b30dff22d00 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:10.691075 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0e1024bf-590e-487a-bb6a-8b30dff22d00 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:10.900925 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-0e1024bf-590e-487a-bb6a-8b30dff22d00 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:12:10.909815 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-0e1024bf-590e-487a-bb6a-8b30dff22d00 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.233529 Nov 23 13:12:10.910391 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 732/1453] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:12:10 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:12:11.247757 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-4c1ded81-7b2f-4a1b-b618-9e53a5aa456b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:12:11.248699 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-4c1ded81-7b2f-4a1b-b618-9e53a5aa456b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:12:11.256510 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4c1ded81-7b2f-4a1b-b618-9e53a5aa456b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:11.256951 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4c1ded81-7b2f-4a1b-b618-9e53a5aa456b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:11.257717 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4c1ded81-7b2f-4a1b-b618-9e53a5aa456b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:11.258143 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4c1ded81-7b2f-4a1b-b618-9e53a5aa456b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:11.321144 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-4c1ded81-7b2f-4a1b-b618-9e53a5aa456b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.077286 Nov 23 13:12:11.321695 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 722/1454] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:12:11 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:12:11.934848 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-364b4705-c058-4abc-8035-ea21fb2ceeb0 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:12:11.935710 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-364b4705-c058-4abc-8035-ea21fb2ceeb0 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:12:11.946202 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-364b4705-c058-4abc-8035-ea21fb2ceeb0 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:11.946823 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-364b4705-c058-4abc-8035-ea21fb2ceeb0 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:11.947828 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-364b4705-c058-4abc-8035-ea21fb2ceeb0 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:11.948465 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-364b4705-c058-4abc-8035-ea21fb2ceeb0 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:12.164207 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-364b4705-c058-4abc-8035-ea21fb2ceeb0 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:12:12.173176 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-364b4705-c058-4abc-8035-ea21fb2ceeb0 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.243405 Nov 23 13:12:12.173733 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 733/1455] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:12:11 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:12:12.337306 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-54548755-1384-4666-b12a-4acc8b8a36c8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:12:12.338750 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-54548755-1384-4666-b12a-4acc8b8a36c8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:12:12.348329 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-54548755-1384-4666-b12a-4acc8b8a36c8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:12.348765 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-54548755-1384-4666-b12a-4acc8b8a36c8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:12.349526 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-54548755-1384-4666-b12a-4acc8b8a36c8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:12.349952 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-54548755-1384-4666-b12a-4acc8b8a36c8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:12.414774 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-54548755-1384-4666-b12a-4acc8b8a36c8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.083743 Nov 23 13:12:12.415244 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 723/1456] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:12:12 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:12:13.194137 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-1ec572ae-c6ba-49ce-96ce-43cdf91b95ac tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:12:13.194723 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-1ec572ae-c6ba-49ce-96ce-43cdf91b95ac tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:12:13.203734 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1ec572ae-c6ba-49ce-96ce-43cdf91b95ac tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:13.204438 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1ec572ae-c6ba-49ce-96ce-43cdf91b95ac tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:13.205635 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1ec572ae-c6ba-49ce-96ce-43cdf91b95ac tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:13.206283 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1ec572ae-c6ba-49ce-96ce-43cdf91b95ac tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:13.417912 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-1ec572ae-c6ba-49ce-96ce-43cdf91b95ac tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:12:13.427591 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-1ec572ae-c6ba-49ce-96ce-43cdf91b95ac tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.239166 Nov 23 13:12:13.428157 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 734/1457] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:12:13 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:12:13.428420 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-63ce77d0-7955-4864-a62d-a44f204bd218 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:12:13.429442 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-63ce77d0-7955-4864-a62d-a44f204bd218 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:12:13.436849 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-63ce77d0-7955-4864-a62d-a44f204bd218 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:13.437295 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-63ce77d0-7955-4864-a62d-a44f204bd218 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:13.438094 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-63ce77d0-7955-4864-a62d-a44f204bd218 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:13.438523 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-63ce77d0-7955-4864-a62d-a44f204bd218 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:13.505546 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-63ce77d0-7955-4864-a62d-a44f204bd218 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.080959 Nov 23 13:12:13.506007 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 724/1458] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:12:13 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:12:14.448625 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-dbde0cf1-1491-4c2f-87f3-2702a3a39fe5 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:12:14.449556 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-dbde0cf1-1491-4c2f-87f3-2702a3a39fe5 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:12:14.461954 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-dbde0cf1-1491-4c2f-87f3-2702a3a39fe5 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:14.462741 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-dbde0cf1-1491-4c2f-87f3-2702a3a39fe5 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:14.464052 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-dbde0cf1-1491-4c2f-87f3-2702a3a39fe5 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:14.464811 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-dbde0cf1-1491-4c2f-87f3-2702a3a39fe5 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:14.517565 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-9f4bf1d1-10b2-4d7c-896f-9361f9aac93d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:12:14.518592 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-9f4bf1d1-10b2-4d7c-896f-9361f9aac93d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:12:14.529495 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-9f4bf1d1-10b2-4d7c-896f-9361f9aac93d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:14.529934 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-9f4bf1d1-10b2-4d7c-896f-9361f9aac93d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:14.530698 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-9f4bf1d1-10b2-4d7c-896f-9361f9aac93d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:14.531228 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-9f4bf1d1-10b2-4d7c-896f-9361f9aac93d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:14.594713 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-9f4bf1d1-10b2-4d7c-896f-9361f9aac93d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.080938 Nov 23 13:12:14.595425 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 725/1459] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:12:14 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:12:14.670742 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-dbde0cf1-1491-4c2f-87f3-2702a3a39fe5 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:12:14.679289 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-dbde0cf1-1491-4c2f-87f3-2702a3a39fe5 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.237190 Nov 23 13:12:14.680052 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 735/1460] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:12:14 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:12:15.610407 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-54136a57-b6a2-47b8-a1f4-5acf2e0927a3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:12:15.611317 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-54136a57-b6a2-47b8-a1f4-5acf2e0927a3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:12:15.619890 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-54136a57-b6a2-47b8-a1f4-5acf2e0927a3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:15.620502 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-54136a57-b6a2-47b8-a1f4-5acf2e0927a3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:15.621274 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-54136a57-b6a2-47b8-a1f4-5acf2e0927a3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:15.621696 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-54136a57-b6a2-47b8-a1f4-5acf2e0927a3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:15.684981 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-54136a57-b6a2-47b8-a1f4-5acf2e0927a3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.080727 Nov 23 13:12:15.685514 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 726/1461] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:12:15 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:12:15.701838 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-c24be4eb-f108-4c07-bd74-d949c177b971 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:12:15.702500 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-c24be4eb-f108-4c07-bd74-d949c177b971 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:12:15.710681 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c24be4eb-f108-4c07-bd74-d949c177b971 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:15.711130 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c24be4eb-f108-4c07-bd74-d949c177b971 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:15.711915 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c24be4eb-f108-4c07-bd74-d949c177b971 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:15.712371 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c24be4eb-f108-4c07-bd74-d949c177b971 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:15.924198 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-c24be4eb-f108-4c07-bd74-d949c177b971 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:12:15.932617 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-c24be4eb-f108-4c07-bd74-d949c177b971 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.236996 Nov 23 13:12:15.933158 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 736/1462] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:12:15 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:12:16.701514 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-672ef0bf-56bf-415c-a4ba-2e829beebd80 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:12:16.702880 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-672ef0bf-56bf-415c-a4ba-2e829beebd80 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:12:16.715535 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-672ef0bf-56bf-415c-a4ba-2e829beebd80 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:16.716285 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-672ef0bf-56bf-415c-a4ba-2e829beebd80 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:16.717578 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-672ef0bf-56bf-415c-a4ba-2e829beebd80 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:16.718290 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-672ef0bf-56bf-415c-a4ba-2e829beebd80 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:16.781807 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-672ef0bf-56bf-415c-a4ba-2e829beebd80 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.087014 Nov 23 13:12:16.782345 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 727/1463] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:12:16 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:12:16.956426 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-df8b2e69-e275-411a-9f41-73f225c54eee tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:12:16.957292 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-df8b2e69-e275-411a-9f41-73f225c54eee tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:12:16.970030 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-df8b2e69-e275-411a-9f41-73f225c54eee tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:16.970755 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-df8b2e69-e275-411a-9f41-73f225c54eee tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:16.971533 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-df8b2e69-e275-411a-9f41-73f225c54eee tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:16.971971 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-df8b2e69-e275-411a-9f41-73f225c54eee tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:17.180187 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-df8b2e69-e275-411a-9f41-73f225c54eee tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:12:17.193664 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-df8b2e69-e275-411a-9f41-73f225c54eee tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.243867 Nov 23 13:12:17.194558 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 737/1464] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:12:16 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:12:17.794939 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-e8cd60ee-5cb6-43d1-b8a9-267ebad2888d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:12:17.796068 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-e8cd60ee-5cb6-43d1-b8a9-267ebad2888d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:12:17.804266 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e8cd60ee-5cb6-43d1-b8a9-267ebad2888d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:17.804743 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e8cd60ee-5cb6-43d1-b8a9-267ebad2888d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:17.805496 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e8cd60ee-5cb6-43d1-b8a9-267ebad2888d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:17.805917 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e8cd60ee-5cb6-43d1-b8a9-267ebad2888d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:17.872659 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-e8cd60ee-5cb6-43d1-b8a9-267ebad2888d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.082547 Nov 23 13:12:17.873225 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 728/1465] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:12:17 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:12:18.210935 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-68165c33-bf22-4437-8845-1e48ef99bca9 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:12:18.211513 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-68165c33-bf22-4437-8845-1e48ef99bca9 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:12:18.219060 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-68165c33-bf22-4437-8845-1e48ef99bca9 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:18.219703 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-68165c33-bf22-4437-8845-1e48ef99bca9 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:18.220497 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-68165c33-bf22-4437-8845-1e48ef99bca9 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:18.221027 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-68165c33-bf22-4437-8845-1e48ef99bca9 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:18.483611 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-68165c33-bf22-4437-8845-1e48ef99bca9 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:12:18.492205 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-68165c33-bf22-4437-8845-1e48ef99bca9 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.285190 Nov 23 13:12:18.493167 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 738/1466] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:12:18 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:12:18.884717 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-02b79c40-2489-4bc5-9ea2-1f9ada41e851 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:12:18.885632 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-02b79c40-2489-4bc5-9ea2-1f9ada41e851 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:12:18.893340 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-02b79c40-2489-4bc5-9ea2-1f9ada41e851 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:18.893780 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-02b79c40-2489-4bc5-9ea2-1f9ada41e851 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:18.894538 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-02b79c40-2489-4bc5-9ea2-1f9ada41e851 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:18.894965 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-02b79c40-2489-4bc5-9ea2-1f9ada41e851 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:18.958745 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-02b79c40-2489-4bc5-9ea2-1f9ada41e851 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.077961 Nov 23 13:12:18.959283 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 729/1467] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:12:18 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:12:19.510473 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-8b1872a3-e94a-42f1-b073-0bc77da7023c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:12:19.511055 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-8b1872a3-e94a-42f1-b073-0bc77da7023c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:12:19.514353 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a7b7a666-a1ad-48b3-bbff-ac4178364592] AMQP server on 10.222.0.60:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 23 13:12:19.519989 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8b1872a3-e94a-42f1-b073-0bc77da7023c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:19.520466 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8b1872a3-e94a-42f1-b073-0bc77da7023c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:19.521234 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8b1872a3-e94a-42f1-b073-0bc77da7023c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:19.521658 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8b1872a3-e94a-42f1-b073-0bc77da7023c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:19.726882 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-8b1872a3-e94a-42f1-b073-0bc77da7023c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:12:19.735952 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-8b1872a3-e94a-42f1-b073-0bc77da7023c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.229379 Nov 23 13:12:19.736581 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 739/1468] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:12:19 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:12:19.970763 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-b18bf5f3-9678-4249-8c99-93f115b66ae8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:12:19.971936 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-b18bf5f3-9678-4249-8c99-93f115b66ae8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:12:19.979740 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b18bf5f3-9678-4249-8c99-93f115b66ae8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:19.980177 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b18bf5f3-9678-4249-8c99-93f115b66ae8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:19.980963 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b18bf5f3-9678-4249-8c99-93f115b66ae8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:19.981383 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b18bf5f3-9678-4249-8c99-93f115b66ae8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:20.045080 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-b18bf5f3-9678-4249-8c99-93f115b66ae8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.078305 Nov 23 13:12:20.045640 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 730/1469] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:12:19 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:12:20.757723 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-e4b130a4-1b9d-4208-96e4-ea481537a740 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:12:20.758577 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-e4b130a4-1b9d-4208-96e4-ea481537a740 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:12:20.779980 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e4b130a4-1b9d-4208-96e4-ea481537a740 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:20.780468 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e4b130a4-1b9d-4208-96e4-ea481537a740 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:20.781260 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e4b130a4-1b9d-4208-96e4-ea481537a740 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:20.781689 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e4b130a4-1b9d-4208-96e4-ea481537a740 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:20.815898 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO oslo.messaging._drivers.impl_rabbit [-] [a7b7a666-a1ad-48b3-bbff-ac4178364592] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 49402. Nov 23 13:12:20.993483 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-e4b130a4-1b9d-4208-96e4-ea481537a740 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:12:21.002054 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-e4b130a4-1b9d-4208-96e4-ea481537a740 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.250813 Nov 23 13:12:21.002635 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 740/1470] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:12:20 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:12:21.061389 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-d60884bc-907f-4d24-ad96-ff13911286da tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:12:21.062862 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-d60884bc-907f-4d24-ad96-ff13911286da tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:12:21.075473 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d60884bc-907f-4d24-ad96-ff13911286da tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:21.076218 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d60884bc-907f-4d24-ad96-ff13911286da tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:21.077541 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d60884bc-907f-4d24-ad96-ff13911286da tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:21.078296 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d60884bc-907f-4d24-ad96-ff13911286da tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:21.143927 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-d60884bc-907f-4d24-ad96-ff13911286da tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.089064 Nov 23 13:12:21.144519 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 731/1471] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:12:21 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 13:12:22.029173 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-a3656d3c-244c-4468-a709-6e36aa746adf tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:12:22.030100 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-a3656d3c-244c-4468-a709-6e36aa746adf tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:12:22.039714 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a3656d3c-244c-4468-a709-6e36aa746adf tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:22.040160 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a3656d3c-244c-4468-a709-6e36aa746adf tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:22.040954 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a3656d3c-244c-4468-a709-6e36aa746adf tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:22.041382 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a3656d3c-244c-4468-a709-6e36aa746adf tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:22.156326 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-45f16d76-5809-43a3-83d2-ae834e2a02b8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:12:22.157278 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-45f16d76-5809-43a3-83d2-ae834e2a02b8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:12:22.165062 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-45f16d76-5809-43a3-83d2-ae834e2a02b8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:22.165538 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-45f16d76-5809-43a3-83d2-ae834e2a02b8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:22.166325 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-45f16d76-5809-43a3-83d2-ae834e2a02b8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:22.166748 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-45f16d76-5809-43a3-83d2-ae834e2a02b8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:22.234850 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-45f16d76-5809-43a3-83d2-ae834e2a02b8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.082663 Nov 23 13:12:22.235389 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 732/1472] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:12:22 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:12:22.250865 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-a3656d3c-244c-4468-a709-6e36aa746adf tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:12:22.259273 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-a3656d3c-244c-4468-a709-6e36aa746adf tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.236439 Nov 23 13:12:22.259876 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 741/1473] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:12:22 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:12:23.251512 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-0c2bf130-1fd6-4dac-9a8c-6d48959a916f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:12:23.252950 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-0c2bf130-1fd6-4dac-9a8c-6d48959a916f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:12:23.265338 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0c2bf130-1fd6-4dac-9a8c-6d48959a916f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:23.266086 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0c2bf130-1fd6-4dac-9a8c-6d48959a916f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:23.267356 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0c2bf130-1fd6-4dac-9a8c-6d48959a916f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:23.268247 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0c2bf130-1fd6-4dac-9a8c-6d48959a916f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:23.276682 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-79d7831c-e4bf-4db2-bdd4-66d9433160b0 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:12:23.277305 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-79d7831c-e4bf-4db2-bdd4-66d9433160b0 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:12:23.285312 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-79d7831c-e4bf-4db2-bdd4-66d9433160b0 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:23.285754 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-79d7831c-e4bf-4db2-bdd4-66d9433160b0 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:23.286568 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-79d7831c-e4bf-4db2-bdd4-66d9433160b0 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:23.286993 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-79d7831c-e4bf-4db2-bdd4-66d9433160b0 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:23.331592 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-0c2bf130-1fd6-4dac-9a8c-6d48959a916f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.086622 Nov 23 13:12:23.332148 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 733/1474] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:12:23 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:12:23.499332 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-79d7831c-e4bf-4db2-bdd4-66d9433160b0 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:12:23.508466 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-79d7831c-e4bf-4db2-bdd4-66d9433160b0 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.235648 Nov 23 13:12:23.508971 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 742/1475] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:12:23 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:12:24.347696 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-b1589a33-9598-48c3-8cdb-7e708b19f8e5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:12:24.348860 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-b1589a33-9598-48c3-8cdb-7e708b19f8e5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:12:24.358537 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b1589a33-9598-48c3-8cdb-7e708b19f8e5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:24.359092 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b1589a33-9598-48c3-8cdb-7e708b19f8e5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:24.360041 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b1589a33-9598-48c3-8cdb-7e708b19f8e5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:24.360614 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b1589a33-9598-48c3-8cdb-7e708b19f8e5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:24.426749 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-b1589a33-9598-48c3-8cdb-7e708b19f8e5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.085590 Nov 23 13:12:24.427315 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 734/1476] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:12:24 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:12:24.527012 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-1074c422-2613-4c2d-be26-0788c9e2e894 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:12:24.527619 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-1074c422-2613-4c2d-be26-0788c9e2e894 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:12:24.535327 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1074c422-2613-4c2d-be26-0788c9e2e894 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:24.535779 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1074c422-2613-4c2d-be26-0788c9e2e894 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:24.536582 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1074c422-2613-4c2d-be26-0788c9e2e894 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:24.537010 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1074c422-2613-4c2d-be26-0788c9e2e894 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:24.745308 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-1074c422-2613-4c2d-be26-0788c9e2e894 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:12:24.753894 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-1074c422-2613-4c2d-be26-0788c9e2e894 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.231182 Nov 23 13:12:24.754606 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 743/1477] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:12:24 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:12:25.441386 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-90853620-1ef0-422b-8abe-c3b5544b3fbe tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:12:25.442311 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-90853620-1ef0-422b-8abe-c3b5544b3fbe tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:12:25.450130 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-90853620-1ef0-422b-8abe-c3b5544b3fbe tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:25.450575 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-90853620-1ef0-422b-8abe-c3b5544b3fbe tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:25.451348 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-90853620-1ef0-422b-8abe-c3b5544b3fbe tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:25.451772 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-90853620-1ef0-422b-8abe-c3b5544b3fbe tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:25.515901 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-90853620-1ef0-422b-8abe-c3b5544b3fbe tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.078647 Nov 23 13:12:25.516506 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 735/1478] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:12:25 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:12:25.774761 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-4be14998-13ed-46e0-bbaf-c04e0c1f1bff tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:12:25.775730 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-4be14998-13ed-46e0-bbaf-c04e0c1f1bff tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:12:25.786733 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-4be14998-13ed-46e0-bbaf-c04e0c1f1bff tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:25.787178 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-4be14998-13ed-46e0-bbaf-c04e0c1f1bff tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:25.787935 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-4be14998-13ed-46e0-bbaf-c04e0c1f1bff tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:25.788391 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-4be14998-13ed-46e0-bbaf-c04e0c1f1bff tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:26.006249 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-4be14998-13ed-46e0-bbaf-c04e0c1f1bff tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:12:26.014962 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-4be14998-13ed-46e0-bbaf-c04e0c1f1bff tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.246487 Nov 23 13:12:26.015598 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 744/1479] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:12:25 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:12:26.528123 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-0e4d8443-9758-4a47-b8bb-8b6e60365212 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:12:26.531512 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-0e4d8443-9758-4a47-b8bb-8b6e60365212 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:12:26.537269 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0e4d8443-9758-4a47-b8bb-8b6e60365212 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:26.537719 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0e4d8443-9758-4a47-b8bb-8b6e60365212 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:26.538506 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0e4d8443-9758-4a47-b8bb-8b6e60365212 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:26.538940 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0e4d8443-9758-4a47-b8bb-8b6e60365212 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:26.606559 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-0e4d8443-9758-4a47-b8bb-8b6e60365212 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.082430 Nov 23 13:12:26.607107 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 736/1480] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:12:26 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:12:27.031585 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-5ffbd9bd-5714-436a-b82e-947e48400d5e tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:12:27.040884 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-5ffbd9bd-5714-436a-b82e-947e48400d5e tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:12:27.052769 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5ffbd9bd-5714-436a-b82e-947e48400d5e tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:27.053273 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5ffbd9bd-5714-436a-b82e-947e48400d5e tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:27.054095 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5ffbd9bd-5714-436a-b82e-947e48400d5e tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:27.054530 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5ffbd9bd-5714-436a-b82e-947e48400d5e tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:27.259927 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-5ffbd9bd-5714-436a-b82e-947e48400d5e tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:12:27.269369 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-5ffbd9bd-5714-436a-b82e-947e48400d5e tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.241559 Nov 23 13:12:27.270069 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 745/1481] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:12:27 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:12:27.623135 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-c42e869c-895a-4eb9-b6f9-a61e39b8af5a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:12:27.624627 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-c42e869c-895a-4eb9-b6f9-a61e39b8af5a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:12:27.636901 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c42e869c-895a-4eb9-b6f9-a61e39b8af5a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:27.637629 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c42e869c-895a-4eb9-b6f9-a61e39b8af5a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:27.638859 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c42e869c-895a-4eb9-b6f9-a61e39b8af5a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:27.639561 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c42e869c-895a-4eb9-b6f9-a61e39b8af5a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:27.703447 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-c42e869c-895a-4eb9-b6f9-a61e39b8af5a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.087200 Nov 23 13:12:27.703992 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 737/1482] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:12:27 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:12:28.291189 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-32265169-7b62-49cc-aab0-8ddb07868f81 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:12:28.292269 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-32265169-7b62-49cc-aab0-8ddb07868f81 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:12:28.303184 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-32265169-7b62-49cc-aab0-8ddb07868f81 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:28.303632 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-32265169-7b62-49cc-aab0-8ddb07868f81 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:28.304435 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-32265169-7b62-49cc-aab0-8ddb07868f81 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:28.304865 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-32265169-7b62-49cc-aab0-8ddb07868f81 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:28.518713 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-32265169-7b62-49cc-aab0-8ddb07868f81 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:12:28.527274 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-32265169-7b62-49cc-aab0-8ddb07868f81 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.242700 Nov 23 13:12:28.527850 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 746/1483] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:12:28 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:12:28.719984 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-798b8718-abf7-463e-99f1-3cca718bf949 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:12:28.721376 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-798b8718-abf7-463e-99f1-3cca718bf949 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:12:28.729694 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-798b8718-abf7-463e-99f1-3cca718bf949 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:28.730144 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-798b8718-abf7-463e-99f1-3cca718bf949 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:28.730909 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-798b8718-abf7-463e-99f1-3cca718bf949 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:28.731338 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-798b8718-abf7-463e-99f1-3cca718bf949 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:28.794174 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-798b8718-abf7-463e-99f1-3cca718bf949 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.081057 Nov 23 13:12:28.794735 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 738/1484] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:12:28 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:12:29.548899 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-76610636-7491-4c0f-a7a4-24cf630e58d7 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:12:29.549905 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-76610636-7491-4c0f-a7a4-24cf630e58d7 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:12:29.562544 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-76610636-7491-4c0f-a7a4-24cf630e58d7 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:29.563339 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-76610636-7491-4c0f-a7a4-24cf630e58d7 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:29.564681 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-76610636-7491-4c0f-a7a4-24cf630e58d7 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:29.565403 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-76610636-7491-4c0f-a7a4-24cf630e58d7 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:29.783002 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-76610636-7491-4c0f-a7a4-24cf630e58d7 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:12:29.794999 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-76610636-7491-4c0f-a7a4-24cf630e58d7 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.252678 Nov 23 13:12:29.795523 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 747/1485] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:12:29 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:12:29.805281 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-c9376b9c-490b-437e-bad5-ca73b86fe88c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:12:29.806202 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-c9376b9c-490b-437e-bad5-ca73b86fe88c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:12:29.813858 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c9376b9c-490b-437e-bad5-ca73b86fe88c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:29.814297 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c9376b9c-490b-437e-bad5-ca73b86fe88c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:29.815049 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c9376b9c-490b-437e-bad5-ca73b86fe88c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:29.815474 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c9376b9c-490b-437e-bad5-ca73b86fe88c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:29.879146 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-c9376b9c-490b-437e-bad5-ca73b86fe88c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.077794 Nov 23 13:12:29.879695 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 739/1486] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:12:29 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:12:30.816541 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-62551346-9395-498f-bde7-a14d826ffbb6 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:12:30.817170 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-62551346-9395-498f-bde7-a14d826ffbb6 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:12:30.825347 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-62551346-9395-498f-bde7-a14d826ffbb6 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:30.825787 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-62551346-9395-498f-bde7-a14d826ffbb6 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:30.826545 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-62551346-9395-498f-bde7-a14d826ffbb6 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:30.826969 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-62551346-9395-498f-bde7-a14d826ffbb6 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:30.891555 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-54aa2245-840f-4d87-b902-d66b5923412e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:12:30.893212 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-54aa2245-840f-4d87-b902-d66b5923412e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:12:30.901521 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-54aa2245-840f-4d87-b902-d66b5923412e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:30.902257 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-54aa2245-840f-4d87-b902-d66b5923412e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:30.903359 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-54aa2245-840f-4d87-b902-d66b5923412e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:30.904012 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-54aa2245-840f-4d87-b902-d66b5923412e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:30.972870 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-54aa2245-840f-4d87-b902-d66b5923412e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.085740 Nov 23 13:12:30.973759 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 740/1487] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:12:30 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 13:12:31.028257 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-62551346-9395-498f-bde7-a14d826ffbb6 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:12:31.037212 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-62551346-9395-498f-bde7-a14d826ffbb6 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1562 microversion: 2.1 time: 0.226948 Nov 23 13:12:31.037787 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 748/1488] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:12:30 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1562 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:12:31.984804 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-3941454b-e2a5-4e78-a5bd-db7404512b21 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:12:31.985959 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-3941454b-e2a5-4e78-a5bd-db7404512b21 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:12:31.994305 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-3941454b-e2a5-4e78-a5bd-db7404512b21 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:31.994858 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-3941454b-e2a5-4e78-a5bd-db7404512b21 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:31.995744 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-3941454b-e2a5-4e78-a5bd-db7404512b21 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:31.996263 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-3941454b-e2a5-4e78-a5bd-db7404512b21 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:32.071728 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-3941454b-e2a5-4e78-a5bd-db7404512b21 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.090853 Nov 23 13:12:32.072399 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 741/1489] 10.222.0.60 () {60 vars in 1342 bytes} [Tue Nov 23 13:12:31 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:12:32.634933 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-e4de4adb-749c-4f82-9ca8-8bc8de908ca0 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:12:32.636100 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-e4de4adb-749c-4f82-9ca8-8bc8de908ca0 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:12:32.645966 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e4de4adb-749c-4f82-9ca8-8bc8de908ca0 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:32.646618 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e4de4adb-749c-4f82-9ca8-8bc8de908ca0 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:32.647717 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e4de4adb-749c-4f82-9ca8-8bc8de908ca0 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:32.648334 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e4de4adb-749c-4f82-9ca8-8bc8de908ca0 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:32.711858 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-e4de4adb-749c-4f82-9ca8-8bc8de908ca0 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Going to try to terminate instance {{(pid=100974) delete /opt/stack/nova/nova/compute/api.py:2562}} Nov 23 13:12:32.714611 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [req-e0cd37c4-138a-4fc7-b02d-464dfedc0185 req-ebe42257-3a73-4b86-8c56-2cdb37ad137c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a3c40e3-d194-4953-be2a-355e3cd882d7", "tag": "9334a9ef-7661-4c37-bee0-88d739f97311"}]} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:12:32.716507 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 13:12:32.716507 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: warnings.warn(msg) Nov 23 13:12:32.726830 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [req-e0cd37c4-138a-4fc7-b02d-464dfedc0185 req-ebe42257-3a73-4b86-8c56-2cdb37ad137c service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:32.727577 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [req-e0cd37c4-138a-4fc7-b02d-464dfedc0185 req-ebe42257-3a73-4b86-8c56-2cdb37ad137c service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:32.746192 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.compute.server_external_events [req-e0cd37c4-138a-4fc7-b02d-464dfedc0185 req-ebe42257-3a73-4b86-8c56-2cdb37ad137c service nova] Creating event network-changed:9334a9ef-7661-4c37-bee0-88d739f97311 for instance 5a3c40e3-d194-4953-be2a-355e3cd882d7 on hv-cinder-81888 Nov 23 13:12:32.751724 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [req-e0cd37c4-138a-4fc7-b02d-464dfedc0185 req-ebe42257-3a73-4b86-8c56-2cdb37ad137c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118481 Nov 23 13:12:32.752343 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 742/1490] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Nov 23 13:12:32 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 13:12:32.840613 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-e4de4adb-749c-4f82-9ca8-8bc8de908ca0 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "DELETE /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 204 len: 0 microversion: 2.1 time: 0.210110 Nov 23 13:12:32.841870 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 749/1491] 10.222.0.60 () {58 vars in 1238 bytes} [Tue Nov 23 13:12:32 2021] DELETE /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 23 13:12:32.850470 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-5d8c6c34-4dd9-45b4-9f2e-a13dc5a0c774 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:12:32.851156 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-5d8c6c34-4dd9-45b4-9f2e-a13dc5a0c774 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:12:32.858749 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5d8c6c34-4dd9-45b4-9f2e-a13dc5a0c774 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:32.859391 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5d8c6c34-4dd9-45b4-9f2e-a13dc5a0c774 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:32.860167 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5d8c6c34-4dd9-45b4-9f2e-a13dc5a0c774 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:32.860651 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5d8c6c34-4dd9-45b4-9f2e-a13dc5a0c774 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:33.084473 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-873a1365-5f23-4126-ab37-de4fe6f6a7ac tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:12:33.084669 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-5d8c6c34-4dd9-45b4-9f2e-a13dc5a0c774 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:12:33.086537 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-873a1365-5f23-4126-ab37-de4fe6f6a7ac tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:12:33.093655 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-5d8c6c34-4dd9-45b4-9f2e-a13dc5a0c774 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1568 microversion: 2.1 time: 0.247422 Nov 23 13:12:33.094809 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 743/1492] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:12:32 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1568 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:12:33.104914 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-873a1365-5f23-4126-ab37-de4fe6f6a7ac tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:33.105395 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-873a1365-5f23-4126-ab37-de4fe6f6a7ac tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:33.106249 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-873a1365-5f23-4126-ab37-de4fe6f6a7ac tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:33.106679 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-873a1365-5f23-4126-ab37-de4fe6f6a7ac tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:33.253732 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-873a1365-5f23-4126-ab37-de4fe6f6a7ac tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action" status: 200 len: 38456 microversion: 2.20 time: 0.173703 Nov 23 13:12:33.254743 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 750/1493] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:12:33 2021] POST /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20/action => generated 38456 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 13:12:33.346156 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-cc4c0190-8373-4869-9bd2-40cc33cf8ff2 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:12:33.347431 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-cc4c0190-8373-4869-9bd2-40cc33cf8ff2 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] [instance: f6d81116-5b48-433f-8c7e-88f2a9687167] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:12:33.354753 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8c3a1481-9693-4499-8478-a55e09a5b02f] AMQP server on 10.222.0.60:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 23 13:12:33.356547 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-cc4c0190-8373-4869-9bd2-40cc33cf8ff2 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:33.357295 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-cc4c0190-8373-4869-9bd2-40cc33cf8ff2 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:33.358256 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-cc4c0190-8373-4869-9bd2-40cc33cf8ff2 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:33.358985 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-cc4c0190-8373-4869-9bd2-40cc33cf8ff2 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:33.539291 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.objects.instance [None req-cc4c0190-8373-4869-9bd2-40cc33cf8ff2 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lazy-loading 'services' on Instance uuid f6d81116-5b48-433f-8c7e-88f2a9687167 {{(pid=100973) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 23 13:12:33.704810 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-cc4c0190-8373-4869-9bd2-40cc33cf8ff2 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] 10.222.0.60 "DELETE /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167/os-volume_attachments/b954c2b0-5fce-44b9-8d2d-4325f6201837" status: 202 len: 0 microversion: 2.1 time: 0.362038 Nov 23 13:12:33.706115 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 744/1494] 10.222.0.60 () {58 vars in 1415 bytes} [Tue Nov 23 13:12:33 2021] DELETE /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167/os-volume_attachments/b954c2b0-5fce-44b9-8d2d-4325f6201837 => generated 0 bytes in 364 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:12:34.111886 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-0d4443e8-03d3-4054-bb0c-a07b37f9a71b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:12:34.113746 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-0d4443e8-03d3-4054-bb0c-a07b37f9a71b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:12:34.122579 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0d4443e8-03d3-4054-bb0c-a07b37f9a71b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:34.123195 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0d4443e8-03d3-4054-bb0c-a07b37f9a71b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:34.124045 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0d4443e8-03d3-4054-bb0c-a07b37f9a71b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:34.124590 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0d4443e8-03d3-4054-bb0c-a07b37f9a71b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:34.574153 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO oslo.messaging._drivers.impl_rabbit [-] [8c3a1481-9693-4499-8478-a55e09a5b02f] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 49548. Nov 23 13:12:34.610448 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-0d4443e8-03d3-4054-bb0c-a07b37f9a71b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:12:34.621682 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-0d4443e8-03d3-4054-bb0c-a07b37f9a71b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1449 microversion: 2.1 time: 0.514050 Nov 23 13:12:34.632527 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 751/1495] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:12:34 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1449 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:12:34.637059 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [req-7a3f1870-23e6-4dc5-933c-40807cbd60e4 req-49cc2da1-a2f1-4038-b234-020395614bbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a3c40e3-d194-4953-be2a-355e3cd882d7", "name": "network-vif-deleted", "tag": "9334a9ef-7661-4c37-bee0-88d739f97311"}]} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:12:34.639608 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 13:12:34.639608 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: warnings.warn(msg) Nov 23 13:12:34.648937 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [req-7a3f1870-23e6-4dc5-933c-40807cbd60e4 req-49cc2da1-a2f1-4038-b234-020395614bbd service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:34.649373 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [req-7a3f1870-23e6-4dc5-933c-40807cbd60e4 req-49cc2da1-a2f1-4038-b234-020395614bbd service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:34.665764 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.compute.server_external_events [req-7a3f1870-23e6-4dc5-933c-40807cbd60e4 req-49cc2da1-a2f1-4038-b234-020395614bbd service nova] Creating event network-vif-deleted:9334a9ef-7661-4c37-bee0-88d739f97311 for instance 5a3c40e3-d194-4953-be2a-355e3cd882d7 on hv-cinder-81888 Nov 23 13:12:34.670932 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [req-7a3f1870-23e6-4dc5-933c-40807cbd60e4 req-49cc2da1-a2f1-4038-b234-020395614bbd service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120037 Nov 23 13:12:34.671517 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 745/1496] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Nov 23 13:12:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 13:12:35.644007 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-c06e4b0c-9d8f-4efb-bf02-25adc83cbad2 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:12:35.644966 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-c06e4b0c-9d8f-4efb-bf02-25adc83cbad2 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:12:35.658050 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c06e4b0c-9d8f-4efb-bf02-25adc83cbad2 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:35.658776 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c06e4b0c-9d8f-4efb-bf02-25adc83cbad2 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:35.660039 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c06e4b0c-9d8f-4efb-bf02-25adc83cbad2 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:35.660522 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c06e4b0c-9d8f-4efb-bf02-25adc83cbad2 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:35.800384 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-c06e4b0c-9d8f-4efb-bf02-25adc83cbad2 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:12:35.809508 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-c06e4b0c-9d8f-4efb-bf02-25adc83cbad2 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1219 microversion: 2.1 time: 0.172336 Nov 23 13:12:35.810114 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 752/1497] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:12:35 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1219 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:12:36.828063 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-5368b2dd-d057-409f-bde9-7d6db9ba0ed3 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:12:36.828809 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-5368b2dd-d057-409f-bde9-7d6db9ba0ed3 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:12:36.836997 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5368b2dd-d057-409f-bde9-7d6db9ba0ed3 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:36.837442 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5368b2dd-d057-409f-bde9-7d6db9ba0ed3 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:36.838208 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5368b2dd-d057-409f-bde9-7d6db9ba0ed3 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:36.838631 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5368b2dd-d057-409f-bde9-7d6db9ba0ed3 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:36.989490 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-5368b2dd-d057-409f-bde9-7d6db9ba0ed3 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:12:37.001045 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-5368b2dd-d057-409f-bde9-7d6db9ba0ed3 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1219 microversion: 2.1 time: 0.177793 Nov 23 13:12:37.001652 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 746/1498] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:12:36 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1219 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:12:38.022524 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-49f439e4-7ae0-4eec-9bd6-49b966c3da43 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:12:38.023157 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-49f439e4-7ae0-4eec-9bd6-49b966c3da43 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:12:38.032796 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-49f439e4-7ae0-4eec-9bd6-49b966c3da43 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:38.033332 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-49f439e4-7ae0-4eec-9bd6-49b966c3da43 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:38.034239 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-49f439e4-7ae0-4eec-9bd6-49b966c3da43 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:38.034746 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-49f439e4-7ae0-4eec-9bd6-49b966c3da43 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:38.155721 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-49f439e4-7ae0-4eec-9bd6-49b966c3da43 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:12:38.168306 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-49f439e4-7ae0-4eec-9bd6-49b966c3da43 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1219 microversion: 2.1 time: 0.151410 Nov 23 13:12:38.169136 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 753/1499] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:12:38 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1219 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:12:39.187709 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-7387c131-c6fb-4ed1-8035-df6e927392e3 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:12:39.188354 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-7387c131-c6fb-4ed1-8035-df6e927392e3 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:12:39.196210 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-7387c131-c6fb-4ed1-8035-df6e927392e3 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:39.196699 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-7387c131-c6fb-4ed1-8035-df6e927392e3 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:39.197466 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-7387c131-c6fb-4ed1-8035-df6e927392e3 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:39.197946 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-7387c131-c6fb-4ed1-8035-df6e927392e3 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:39.314171 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-7387c131-c6fb-4ed1-8035-df6e927392e3 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:12:39.324161 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-7387c131-c6fb-4ed1-8035-df6e927392e3 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1219 microversion: 2.1 time: 0.140413 Nov 23 13:12:39.324780 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 747/1500] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:12:39 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1219 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:12:40.345305 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-6368b1dd-5d2f-48a9-bb1c-49a48b3a08c1 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:12:40.346267 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-6368b1dd-5d2f-48a9-bb1c-49a48b3a08c1 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:12:40.358582 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-6368b1dd-5d2f-48a9-bb1c-49a48b3a08c1 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:40.359327 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-6368b1dd-5d2f-48a9-bb1c-49a48b3a08c1 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:40.360651 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-6368b1dd-5d2f-48a9-bb1c-49a48b3a08c1 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:40.361412 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-6368b1dd-5d2f-48a9-bb1c-49a48b3a08c1 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:40.486718 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-6368b1dd-5d2f-48a9-bb1c-49a48b3a08c1 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:12:40.498754 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-6368b1dd-5d2f-48a9-bb1c-49a48b3a08c1 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1219 microversion: 2.1 time: 0.159510 Nov 23 13:12:40.499528 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 754/1501] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:12:40 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1219 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:12:41.519190 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-a1f3c672-4cea-4b2b-880c-ce1e3715e605 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:12:41.519799 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-a1f3c672-4cea-4b2b-880c-ce1e3715e605 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:12:41.532176 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a1f3c672-4cea-4b2b-880c-ce1e3715e605 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:41.532961 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a1f3c672-4cea-4b2b-880c-ce1e3715e605 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:41.534137 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a1f3c672-4cea-4b2b-880c-ce1e3715e605 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:41.534837 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a1f3c672-4cea-4b2b-880c-ce1e3715e605 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:41.662274 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-a1f3c672-4cea-4b2b-880c-ce1e3715e605 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:12:41.675397 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-a1f3c672-4cea-4b2b-880c-ce1e3715e605 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1219 microversion: 2.1 time: 0.162046 Nov 23 13:12:41.676120 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 748/1502] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:12:41 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1219 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:12:42.693709 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-2b91aab3-7c85-4bdd-9bb5-2d5458b737b6 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:12:42.694364 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-2b91aab3-7c85-4bdd-9bb5-2d5458b737b6 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:12:42.702417 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2b91aab3-7c85-4bdd-9bb5-2d5458b737b6 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:42.702866 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2b91aab3-7c85-4bdd-9bb5-2d5458b737b6 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:42.703620 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2b91aab3-7c85-4bdd-9bb5-2d5458b737b6 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:42.704046 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2b91aab3-7c85-4bdd-9bb5-2d5458b737b6 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:42.832948 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-2b91aab3-7c85-4bdd-9bb5-2d5458b737b6 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:12:42.842818 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-2b91aab3-7c85-4bdd-9bb5-2d5458b737b6 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1219 microversion: 2.1 time: 0.151637 Nov 23 13:12:42.844858 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 755/1503] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:12:42 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1219 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:12:43.858406 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-0300f9fb-0bc7-41ad-ae8d-69dd4218fa90 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:12:43.859005 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-0300f9fb-0bc7-41ad-ae8d-69dd4218fa90 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:12:43.866848 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0300f9fb-0bc7-41ad-ae8d-69dd4218fa90 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:43.867611 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0300f9fb-0bc7-41ad-ae8d-69dd4218fa90 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:43.868408 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0300f9fb-0bc7-41ad-ae8d-69dd4218fa90 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:43.868831 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0300f9fb-0bc7-41ad-ae8d-69dd4218fa90 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:43.989430 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-0300f9fb-0bc7-41ad-ae8d-69dd4218fa90 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:12:43.998538 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-0300f9fb-0bc7-41ad-ae8d-69dd4218fa90 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1219 microversion: 2.1 time: 0.143940 Nov 23 13:12:43.999139 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 749/1504] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:12:43 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1219 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:12:44.977737 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 13:12:44.978747 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: Tue Nov 23 13:12:44 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 23 13:12:45.019043 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-8dea7149-09e2-4788-9a94-c9ed11f0b286 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:12:45.019635 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-8dea7149-09e2-4788-9a94-c9ed11f0b286 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:12:45.031994 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8dea7149-09e2-4788-9a94-c9ed11f0b286 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:45.032653 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8dea7149-09e2-4788-9a94-c9ed11f0b286 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:45.033815 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8dea7149-09e2-4788-9a94-c9ed11f0b286 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:45.034480 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8dea7149-09e2-4788-9a94-c9ed11f0b286 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:45.161888 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-8dea7149-09e2-4788-9a94-c9ed11f0b286 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:12:45.171807 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-8dea7149-09e2-4788-9a94-c9ed11f0b286 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1219 microversion: 2.1 time: 0.158957 Nov 23 13:12:45.172411 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 756/1505] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:12:45 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1219 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:12:46.193213 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-f6a88fba-3e72-45e3-833b-e1ffe3f519a8 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:12:46.194072 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-f6a88fba-3e72-45e3-833b-e1ffe3f519a8 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:12:46.206620 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f6a88fba-3e72-45e3-833b-e1ffe3f519a8 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:46.207358 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f6a88fba-3e72-45e3-833b-e1ffe3f519a8 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:46.208692 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f6a88fba-3e72-45e3-833b-e1ffe3f519a8 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:46.209423 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f6a88fba-3e72-45e3-833b-e1ffe3f519a8 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:46.333691 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-f6a88fba-3e72-45e3-833b-e1ffe3f519a8 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:12:46.342406 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-f6a88fba-3e72-45e3-833b-e1ffe3f519a8 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1219 microversion: 2.1 time: 0.155639 Nov 23 13:12:46.342982 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 750/1506] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:12:46 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1219 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:12:47.361405 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-0bda063f-21eb-4c5c-8f12-edceaf46ff14 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:12:47.362211 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-0bda063f-21eb-4c5c-8f12-edceaf46ff14 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:12:47.372835 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0bda063f-21eb-4c5c-8f12-edceaf46ff14 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:47.373429 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0bda063f-21eb-4c5c-8f12-edceaf46ff14 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:47.374440 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0bda063f-21eb-4c5c-8f12-edceaf46ff14 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:47.375014 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0bda063f-21eb-4c5c-8f12-edceaf46ff14 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:47.490517 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-0bda063f-21eb-4c5c-8f12-edceaf46ff14 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:12:47.502529 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-0bda063f-21eb-4c5c-8f12-edceaf46ff14 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1219 microversion: 2.1 time: 0.145991 Nov 23 13:12:47.503263 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 757/1507] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:12:47 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1219 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:12:48.525518 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-44c9b279-5353-47a3-9b06-97fe1ecbb466 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:12:48.526092 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-44c9b279-5353-47a3-9b06-97fe1ecbb466 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:12:48.533628 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-44c9b279-5353-47a3-9b06-97fe1ecbb466 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:48.534081 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-44c9b279-5353-47a3-9b06-97fe1ecbb466 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:48.534831 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-44c9b279-5353-47a3-9b06-97fe1ecbb466 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:48.535249 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-44c9b279-5353-47a3-9b06-97fe1ecbb466 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:48.747787 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-44c9b279-5353-47a3-9b06-97fe1ecbb466 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:12:48.760091 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-44c9b279-5353-47a3-9b06-97fe1ecbb466 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1219 microversion: 2.1 time: 0.241479 Nov 23 13:12:48.760651 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 751/1508] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:12:48 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1219 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:12:49.781454 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-30779198-58e5-408f-b346-ee991bcf24b3 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:12:49.782417 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-30779198-58e5-408f-b346-ee991bcf24b3 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:12:49.793095 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-30779198-58e5-408f-b346-ee991bcf24b3 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:49.793544 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-30779198-58e5-408f-b346-ee991bcf24b3 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:49.794319 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-30779198-58e5-408f-b346-ee991bcf24b3 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:49.794750 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-30779198-58e5-408f-b346-ee991bcf24b3 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:49.913954 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-30779198-58e5-408f-b346-ee991bcf24b3 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:12:49.924380 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-30779198-58e5-408f-b346-ee991bcf24b3 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1219 microversion: 2.1 time: 0.149922 Nov 23 13:12:49.925149 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 758/1509] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:12:49 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1219 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:12:50.946835 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-22650b01-84e0-430c-adea-6d70a9a389d6 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:12:50.947435 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-22650b01-84e0-430c-adea-6d70a9a389d6 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:12:50.955181 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-22650b01-84e0-430c-adea-6d70a9a389d6 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:50.955626 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-22650b01-84e0-430c-adea-6d70a9a389d6 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:50.956407 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-22650b01-84e0-430c-adea-6d70a9a389d6 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:50.956829 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-22650b01-84e0-430c-adea-6d70a9a389d6 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:51.068923 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-22650b01-84e0-430c-adea-6d70a9a389d6 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:12:51.077278 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-22650b01-84e0-430c-adea-6d70a9a389d6 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1219 microversion: 2.1 time: 0.135958 Nov 23 13:12:51.077832 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 752/1510] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:12:50 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1219 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:12:52.098282 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-b783ebf8-1261-4497-9428-0692d2a9e098 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:12:52.099267 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-b783ebf8-1261-4497-9428-0692d2a9e098 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:12:52.112163 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b783ebf8-1261-4497-9428-0692d2a9e098 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:52.112950 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b783ebf8-1261-4497-9428-0692d2a9e098 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:52.114198 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b783ebf8-1261-4497-9428-0692d2a9e098 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:52.114914 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b783ebf8-1261-4497-9428-0692d2a9e098 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:52.251049 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-b783ebf8-1261-4497-9428-0692d2a9e098 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:12:52.264065 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-b783ebf8-1261-4497-9428-0692d2a9e098 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1219 microversion: 2.1 time: 0.172041 Nov 23 13:12:52.264840 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 759/1511] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:12:52 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1219 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:12:53.285832 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-4284c03d-dadf-4ff1-85ac-cb838f19596b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:12:53.286851 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-4284c03d-dadf-4ff1-85ac-cb838f19596b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:12:53.295209 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4284c03d-dadf-4ff1-85ac-cb838f19596b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:53.295678 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4284c03d-dadf-4ff1-85ac-cb838f19596b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:53.296483 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4284c03d-dadf-4ff1-85ac-cb838f19596b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:53.296920 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4284c03d-dadf-4ff1-85ac-cb838f19596b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:53.410639 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-4284c03d-dadf-4ff1-85ac-cb838f19596b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:12:53.419326 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-4284c03d-dadf-4ff1-85ac-cb838f19596b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1219 microversion: 2.1 time: 0.139881 Nov 23 13:12:53.419889 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 753/1512] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:12:53 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1219 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:12:54.440490 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-75dde549-71d0-49c1-a90d-22bd4b360034 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:12:54.441523 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-75dde549-71d0-49c1-a90d-22bd4b360034 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:12:54.453993 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-75dde549-71d0-49c1-a90d-22bd4b360034 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:54.454738 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-75dde549-71d0-49c1-a90d-22bd4b360034 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:54.455998 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-75dde549-71d0-49c1-a90d-22bd4b360034 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:54.456761 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-75dde549-71d0-49c1-a90d-22bd4b360034 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:54.572150 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-75dde549-71d0-49c1-a90d-22bd4b360034 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:12:54.580803 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-75dde549-71d0-49c1-a90d-22bd4b360034 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1219 microversion: 2.1 time: 0.146706 Nov 23 13:12:54.581504 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 760/1513] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:12:54 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1219 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:12:55.602492 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-e370fb56-0bae-4a58-84ef-8ae61cb89ff1 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:12:55.603140 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-e370fb56-0bae-4a58-84ef-8ae61cb89ff1 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:12:55.612201 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e370fb56-0bae-4a58-84ef-8ae61cb89ff1 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:55.612749 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e370fb56-0bae-4a58-84ef-8ae61cb89ff1 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:55.613640 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e370fb56-0bae-4a58-84ef-8ae61cb89ff1 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:55.614169 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e370fb56-0bae-4a58-84ef-8ae61cb89ff1 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:55.732645 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-e370fb56-0bae-4a58-84ef-8ae61cb89ff1 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:12:55.740818 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-e370fb56-0bae-4a58-84ef-8ae61cb89ff1 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1219 microversion: 2.1 time: 0.145076 Nov 23 13:12:55.741388 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 754/1514] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:12:55 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1219 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:12:56.762240 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-a5d3ffdd-b14d-42ea-905a-83ec68fa5cd1 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:12:56.763344 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-a5d3ffdd-b14d-42ea-905a-83ec68fa5cd1 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:12:56.775321 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a5d3ffdd-b14d-42ea-905a-83ec68fa5cd1 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:56.775761 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a5d3ffdd-b14d-42ea-905a-83ec68fa5cd1 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:56.776584 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a5d3ffdd-b14d-42ea-905a-83ec68fa5cd1 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:56.777004 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a5d3ffdd-b14d-42ea-905a-83ec68fa5cd1 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:56.895977 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-a5d3ffdd-b14d-42ea-905a-83ec68fa5cd1 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:12:56.905401 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-a5d3ffdd-b14d-42ea-905a-83ec68fa5cd1 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1219 microversion: 2.1 time: 0.149690 Nov 23 13:12:56.905963 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 761/1515] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:12:56 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1219 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:12:57.926158 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-caa10d93-f66c-4d22-87c1-ed2b7c0ce039 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:12:57.927159 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-caa10d93-f66c-4d22-87c1-ed2b7c0ce039 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:12:57.939325 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-caa10d93-f66c-4d22-87c1-ed2b7c0ce039 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:57.940064 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-caa10d93-f66c-4d22-87c1-ed2b7c0ce039 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:57.941377 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-caa10d93-f66c-4d22-87c1-ed2b7c0ce039 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:57.942091 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-caa10d93-f66c-4d22-87c1-ed2b7c0ce039 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:58.070507 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-caa10d93-f66c-4d22-87c1-ed2b7c0ce039 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:12:58.084639 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-caa10d93-f66c-4d22-87c1-ed2b7c0ce039 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1219 microversion: 2.1 time: 0.164454 Nov 23 13:12:58.085530 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 755/1516] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:12:57 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1219 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:12:59.106697 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-199966fd-9fea-4b23-8453-ee714c3a4c44 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:12:59.107618 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-199966fd-9fea-4b23-8453-ee714c3a4c44 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:12:59.119708 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-199966fd-9fea-4b23-8453-ee714c3a4c44 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:59.120095 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-199966fd-9fea-4b23-8453-ee714c3a4c44 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:59.120903 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-199966fd-9fea-4b23-8453-ee714c3a4c44 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:12:59.121332 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-199966fd-9fea-4b23-8453-ee714c3a4c44 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:12:59.242270 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-199966fd-9fea-4b23-8453-ee714c3a4c44 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:12:59.256094 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-199966fd-9fea-4b23-8453-ee714c3a4c44 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1219 microversion: 2.1 time: 0.155581 Nov 23 13:12:59.257114 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 762/1517] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:12:59 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1219 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:13:00.277412 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-d392fe94-5433-4d17-bf8a-0683776c30a7 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:13:00.278059 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-d392fe94-5433-4d17-bf8a-0683776c30a7 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:13:00.290056 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d392fe94-5433-4d17-bf8a-0683776c30a7 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:13:00.290609 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d392fe94-5433-4d17-bf8a-0683776c30a7 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:13:00.291388 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d392fe94-5433-4d17-bf8a-0683776c30a7 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:13:00.291800 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d392fe94-5433-4d17-bf8a-0683776c30a7 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:13:00.406984 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-d392fe94-5433-4d17-bf8a-0683776c30a7 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:13:00.419229 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-d392fe94-5433-4d17-bf8a-0683776c30a7 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1219 microversion: 2.1 time: 0.148186 Nov 23 13:13:00.419845 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 756/1518] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:13:00 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1219 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:13:01.440299 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-71152d51-df5e-4add-8bf0-7f1d1561bddb tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:13:01.441366 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-71152d51-df5e-4add-8bf0-7f1d1561bddb tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:13:01.451179 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-71152d51-df5e-4add-8bf0-7f1d1561bddb tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:13:01.451629 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-71152d51-df5e-4add-8bf0-7f1d1561bddb tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:13:01.452432 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-71152d51-df5e-4add-8bf0-7f1d1561bddb tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:13:01.452863 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-71152d51-df5e-4add-8bf0-7f1d1561bddb tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:13:01.573210 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-71152d51-df5e-4add-8bf0-7f1d1561bddb tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:13:01.582230 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-71152d51-df5e-4add-8bf0-7f1d1561bddb tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1219 microversion: 2.1 time: 0.148216 Nov 23 13:13:01.582782 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 763/1519] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:13:01 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1219 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:13:02.600099 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-5cc62b48-69e4-4e64-8df7-0a0349ad01c8 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:13:02.600743 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-5cc62b48-69e4-4e64-8df7-0a0349ad01c8 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:13:02.609911 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5cc62b48-69e4-4e64-8df7-0a0349ad01c8 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:13:02.610479 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5cc62b48-69e4-4e64-8df7-0a0349ad01c8 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:13:02.611407 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5cc62b48-69e4-4e64-8df7-0a0349ad01c8 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:13:02.611926 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5cc62b48-69e4-4e64-8df7-0a0349ad01c8 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:13:02.730685 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-5cc62b48-69e4-4e64-8df7-0a0349ad01c8 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:13:02.743967 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-5cc62b48-69e4-4e64-8df7-0a0349ad01c8 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1219 microversion: 2.1 time: 0.148492 Nov 23 13:13:02.744563 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 757/1520] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:13:02 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1219 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:13:03.765198 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-78ff0d68-8d1e-40ef-afd5-0121315324b3 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:13:03.766081 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-78ff0d68-8d1e-40ef-afd5-0121315324b3 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:13:03.778524 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-78ff0d68-8d1e-40ef-afd5-0121315324b3 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:13:03.779280 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-78ff0d68-8d1e-40ef-afd5-0121315324b3 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:13:03.780613 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-78ff0d68-8d1e-40ef-afd5-0121315324b3 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:13:03.781324 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-78ff0d68-8d1e-40ef-afd5-0121315324b3 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:13:04.054334 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-78ff0d68-8d1e-40ef-afd5-0121315324b3 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:13:04.063075 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-78ff0d68-8d1e-40ef-afd5-0121315324b3 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1219 microversion: 2.1 time: 0.304288 Nov 23 13:13:04.063636 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 764/1521] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:13:03 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1219 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:13:05.084041 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-1ef587a6-8d9c-4a37-b047-1e21866a6278 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:13:05.085140 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-1ef587a6-8d9c-4a37-b047-1e21866a6278 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:13:05.093590 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-1ef587a6-8d9c-4a37-b047-1e21866a6278 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:13:05.094031 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-1ef587a6-8d9c-4a37-b047-1e21866a6278 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:13:05.094781 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-1ef587a6-8d9c-4a37-b047-1e21866a6278 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:13:05.095205 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-1ef587a6-8d9c-4a37-b047-1e21866a6278 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:13:05.215358 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-1ef587a6-8d9c-4a37-b047-1e21866a6278 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:13:05.227589 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-1ef587a6-8d9c-4a37-b047-1e21866a6278 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1219 microversion: 2.1 time: 0.149687 Nov 23 13:13:05.228141 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 758/1522] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:13:05 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1219 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:13:06.249368 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-bf7da179-164d-46fe-9488-d82b59245c0f tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:13:06.250268 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-bf7da179-164d-46fe-9488-d82b59245c0f tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:13:06.261074 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-bf7da179-164d-46fe-9488-d82b59245c0f tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:13:06.261513 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-bf7da179-164d-46fe-9488-d82b59245c0f tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:13:06.262264 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-bf7da179-164d-46fe-9488-d82b59245c0f tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:13:06.262692 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-bf7da179-164d-46fe-9488-d82b59245c0f tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:13:06.397008 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-bf7da179-164d-46fe-9488-d82b59245c0f tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:13:06.406901 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-bf7da179-164d-46fe-9488-d82b59245c0f tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1219 microversion: 2.1 time: 0.164036 Nov 23 13:13:06.407456 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 765/1523] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:13:06 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1219 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:13:07.432716 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-f07a253e-973d-4b45-b5d9-2e440894c130 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:13:07.433529 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-f07a253e-973d-4b45-b5d9-2e440894c130 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:13:07.442682 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f07a253e-973d-4b45-b5d9-2e440894c130 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:13:07.443205 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f07a253e-973d-4b45-b5d9-2e440894c130 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:13:07.444095 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f07a253e-973d-4b45-b5d9-2e440894c130 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:13:07.444629 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f07a253e-973d-4b45-b5d9-2e440894c130 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:13:07.568611 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-f07a253e-973d-4b45-b5d9-2e440894c130 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:13:07.580367 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-f07a253e-973d-4b45-b5d9-2e440894c130 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1219 microversion: 2.1 time: 0.153073 Nov 23 13:13:07.581271 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 759/1524] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:13:07 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1219 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:13:08.601840 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-403494b9-161f-424d-8b3b-ca6e261d1326 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:13:08.602814 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-403494b9-161f-424d-8b3b-ca6e261d1326 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:13:08.615271 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-403494b9-161f-424d-8b3b-ca6e261d1326 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:13:08.616046 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-403494b9-161f-424d-8b3b-ca6e261d1326 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:13:08.617823 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-403494b9-161f-424d-8b3b-ca6e261d1326 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:13:08.618249 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-403494b9-161f-424d-8b3b-ca6e261d1326 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:13:08.742322 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-403494b9-161f-424d-8b3b-ca6e261d1326 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:13:08.751292 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-403494b9-161f-424d-8b3b-ca6e261d1326 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1219 microversion: 2.1 time: 0.155939 Nov 23 13:13:08.751846 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 766/1525] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:13:08 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1219 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:13:09.772697 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-d1534928-759c-47fa-b5b8-2c4df4c0e7c1 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:13:09.773589 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-d1534928-759c-47fa-b5b8-2c4df4c0e7c1 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:13:09.786175 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d1534928-759c-47fa-b5b8-2c4df4c0e7c1 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:13:09.786930 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d1534928-759c-47fa-b5b8-2c4df4c0e7c1 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:13:09.788186 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d1534928-759c-47fa-b5b8-2c4df4c0e7c1 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:13:09.788946 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d1534928-759c-47fa-b5b8-2c4df4c0e7c1 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:13:09.911635 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-d1534928-759c-47fa-b5b8-2c4df4c0e7c1 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:13:09.920384 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-d1534928-759c-47fa-b5b8-2c4df4c0e7c1 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1219 microversion: 2.1 time: 0.154307 Nov 23 13:13:09.921342 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 760/1526] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:13:09 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1219 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:13:10.942199 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-97c29432-2a7b-4c43-b36a-70e0b199aa92 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:13:10.943272 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-97c29432-2a7b-4c43-b36a-70e0b199aa92 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:13:10.955662 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-97c29432-2a7b-4c43-b36a-70e0b199aa92 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:13:10.956464 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-97c29432-2a7b-4c43-b36a-70e0b199aa92 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:13:10.957728 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-97c29432-2a7b-4c43-b36a-70e0b199aa92 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:13:10.958434 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-97c29432-2a7b-4c43-b36a-70e0b199aa92 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:13:11.091188 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-97c29432-2a7b-4c43-b36a-70e0b199aa92 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:13:11.100279 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-97c29432-2a7b-4c43-b36a-70e0b199aa92 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1219 microversion: 2.1 time: 0.164438 Nov 23 13:13:11.100868 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 767/1527] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:13:10 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1219 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:13:12.127237 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-840a9821-9897-4dba-b147-0137b871d153 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:13:12.128122 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-840a9821-9897-4dba-b147-0137b871d153 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:13:12.138216 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-840a9821-9897-4dba-b147-0137b871d153 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:13:12.138661 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-840a9821-9897-4dba-b147-0137b871d153 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:13:12.139418 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-840a9821-9897-4dba-b147-0137b871d153 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:13:12.139845 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-840a9821-9897-4dba-b147-0137b871d153 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:13:12.261490 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-840a9821-9897-4dba-b147-0137b871d153 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:13:12.274503 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-840a9821-9897-4dba-b147-0137b871d153 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1219 microversion: 2.1 time: 0.153626 Nov 23 13:13:12.275166 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 761/1528] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:13:12 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1219 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:13:13.295716 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-24c08835-65e5-4283-9dd2-e1e87f2c07ec tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:13:13.296703 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-24c08835-65e5-4283-9dd2-e1e87f2c07ec tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:13:13.307669 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-24c08835-65e5-4283-9dd2-e1e87f2c07ec tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:13:13.308121 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-24c08835-65e5-4283-9dd2-e1e87f2c07ec tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:13:13.308916 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-24c08835-65e5-4283-9dd2-e1e87f2c07ec tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:13:13.309343 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-24c08835-65e5-4283-9dd2-e1e87f2c07ec tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:13:13.430740 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-24c08835-65e5-4283-9dd2-e1e87f2c07ec tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:13:13.439697 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-24c08835-65e5-4283-9dd2-e1e87f2c07ec tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1219 microversion: 2.1 time: 0.150217 Nov 23 13:13:13.440274 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 768/1529] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:13:13 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1219 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:13:14.459082 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-4f58016b-a333-47d0-93a6-cba9bee96864 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:13:14.459701 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-4f58016b-a333-47d0-93a6-cba9bee96864 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:13:14.467813 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4f58016b-a333-47d0-93a6-cba9bee96864 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:13:14.468279 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4f58016b-a333-47d0-93a6-cba9bee96864 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:13:14.469138 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4f58016b-a333-47d0-93a6-cba9bee96864 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:13:14.469559 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4f58016b-a333-47d0-93a6-cba9bee96864 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:13:14.589549 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-4f58016b-a333-47d0-93a6-cba9bee96864 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:13:14.598357 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-4f58016b-a333-47d0-93a6-cba9bee96864 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1219 microversion: 2.1 time: 0.143157 Nov 23 13:13:14.598907 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 762/1530] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:13:14 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1219 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:13:15.616272 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-be5db514-0882-4b69-b003-183edea50678 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:13:15.617317 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-be5db514-0882-4b69-b003-183edea50678 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:13:15.625670 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-be5db514-0882-4b69-b003-183edea50678 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:13:15.626121 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-be5db514-0882-4b69-b003-183edea50678 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:13:15.626885 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-be5db514-0882-4b69-b003-183edea50678 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:13:15.627315 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-be5db514-0882-4b69-b003-183edea50678 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:13:15.742848 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-be5db514-0882-4b69-b003-183edea50678 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:13:15.755996 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-be5db514-0882-4b69-b003-183edea50678 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1219 microversion: 2.1 time: 0.144040 Nov 23 13:13:15.756897 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 769/1531] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:13:15 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1219 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:13:16.777843 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-f618bb36-84e2-4f1c-a39d-1f35e2b839b0 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:13:16.778477 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-f618bb36-84e2-4f1c-a39d-1f35e2b839b0 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:13:16.786992 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f618bb36-84e2-4f1c-a39d-1f35e2b839b0 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:13:16.787478 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f618bb36-84e2-4f1c-a39d-1f35e2b839b0 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:13:16.788312 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f618bb36-84e2-4f1c-a39d-1f35e2b839b0 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:13:16.788809 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f618bb36-84e2-4f1c-a39d-1f35e2b839b0 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:13:16.909542 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-f618bb36-84e2-4f1c-a39d-1f35e2b839b0 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:13:16.918660 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-f618bb36-84e2-4f1c-a39d-1f35e2b839b0 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1219 microversion: 2.1 time: 0.147202 Nov 23 13:13:16.919229 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 763/1532] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:13:16 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1219 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:13:17.944744 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-76acee05-e7ff-4071-a660-3f4df1067b7d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:13:17.945376 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-76acee05-e7ff-4071-a660-3f4df1067b7d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:13:17.954765 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-76acee05-e7ff-4071-a660-3f4df1067b7d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:13:17.955211 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-76acee05-e7ff-4071-a660-3f4df1067b7d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:13:17.955978 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-76acee05-e7ff-4071-a660-3f4df1067b7d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:13:17.956529 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-76acee05-e7ff-4071-a660-3f4df1067b7d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:13:18.075966 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-76acee05-e7ff-4071-a660-3f4df1067b7d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:13:18.084512 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-76acee05-e7ff-4071-a660-3f4df1067b7d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1219 microversion: 2.1 time: 0.145919 Nov 23 13:13:18.085063 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 770/1533] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:13:17 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1219 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:13:19.105971 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-03082af0-7383-4b77-bcad-29ed14c0328e tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:13:19.107019 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-03082af0-7383-4b77-bcad-29ed14c0328e tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:13:19.118212 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-03082af0-7383-4b77-bcad-29ed14c0328e tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:13:19.118804 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-03082af0-7383-4b77-bcad-29ed14c0328e tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:13:19.119870 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-03082af0-7383-4b77-bcad-29ed14c0328e tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:13:19.120483 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-03082af0-7383-4b77-bcad-29ed14c0328e tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:13:19.236208 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-03082af0-7383-4b77-bcad-29ed14c0328e tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:13:19.245019 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-03082af0-7383-4b77-bcad-29ed14c0328e tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1219 microversion: 2.1 time: 0.146101 Nov 23 13:13:19.245619 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 764/1534] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:13:19 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1219 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:13:20.266941 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-8d1fa235-f48f-44dd-a443-caf32e9b8878 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:13:20.267894 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-8d1fa235-f48f-44dd-a443-caf32e9b8878 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:13:20.280464 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8d1fa235-f48f-44dd-a443-caf32e9b8878 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:13:20.281215 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8d1fa235-f48f-44dd-a443-caf32e9b8878 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:13:20.282494 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8d1fa235-f48f-44dd-a443-caf32e9b8878 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:13:20.283314 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8d1fa235-f48f-44dd-a443-caf32e9b8878 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:13:20.402302 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-8d1fa235-f48f-44dd-a443-caf32e9b8878 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:13:20.415967 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-8d1fa235-f48f-44dd-a443-caf32e9b8878 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1219 microversion: 2.1 time: 0.155527 Nov 23 13:13:20.416940 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 771/1535] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:13:20 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1219 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:13:21.438602 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-cf613820-573f-4ceb-8e10-ad15f5f11db0 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:13:21.439609 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-cf613820-573f-4ceb-8e10-ad15f5f11db0 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:13:21.452448 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-cf613820-573f-4ceb-8e10-ad15f5f11db0 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:13:21.453191 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-cf613820-573f-4ceb-8e10-ad15f5f11db0 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:13:21.454548 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-cf613820-573f-4ceb-8e10-ad15f5f11db0 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:13:21.455254 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-cf613820-573f-4ceb-8e10-ad15f5f11db0 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:13:21.580453 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-cf613820-573f-4ceb-8e10-ad15f5f11db0 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:13:21.592260 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-cf613820-573f-4ceb-8e10-ad15f5f11db0 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1219 microversion: 2.1 time: 0.160691 Nov 23 13:13:21.592834 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 765/1536] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:13:21 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1219 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:13:22.614482 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-3c6809ea-9c6b-4638-a612-66c3a830e2ba tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:13:22.615487 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-3c6809ea-9c6b-4638-a612-66c3a830e2ba tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:13:22.626043 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3c6809ea-9c6b-4638-a612-66c3a830e2ba tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:13:22.626498 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3c6809ea-9c6b-4638-a612-66c3a830e2ba tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:13:22.627250 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3c6809ea-9c6b-4638-a612-66c3a830e2ba tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:13:22.627691 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3c6809ea-9c6b-4638-a612-66c3a830e2ba tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:13:22.750439 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-3c6809ea-9c6b-4638-a612-66c3a830e2ba tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:13:22.762928 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-3c6809ea-9c6b-4638-a612-66c3a830e2ba tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1219 microversion: 2.1 time: 0.155270 Nov 23 13:13:22.763486 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 772/1537] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:13:22 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1219 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:13:23.779404 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-d1ba107f-4fa1-4983-b6a2-1b96ece2601e tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:13:23.780016 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-d1ba107f-4fa1-4983-b6a2-1b96ece2601e tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:13:23.787957 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d1ba107f-4fa1-4983-b6a2-1b96ece2601e tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:13:23.788442 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d1ba107f-4fa1-4983-b6a2-1b96ece2601e tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:13:23.789218 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d1ba107f-4fa1-4983-b6a2-1b96ece2601e tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:13:23.789648 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d1ba107f-4fa1-4983-b6a2-1b96ece2601e tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:13:23.909748 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-d1ba107f-4fa1-4983-b6a2-1b96ece2601e tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:13:23.922775 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-d1ba107f-4fa1-4983-b6a2-1b96ece2601e tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1219 microversion: 2.1 time: 0.147035 Nov 23 13:13:23.923520 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 766/1538] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:13:23 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1219 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:13:24.945338 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-42e893aa-9851-4ddf-aed3-b053ab8bd6c2 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:13:24.946437 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-42e893aa-9851-4ddf-aed3-b053ab8bd6c2 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:13:24.959186 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-42e893aa-9851-4ddf-aed3-b053ab8bd6c2 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:13:24.959937 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-42e893aa-9851-4ddf-aed3-b053ab8bd6c2 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:13:24.961277 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-42e893aa-9851-4ddf-aed3-b053ab8bd6c2 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:13:24.961987 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-42e893aa-9851-4ddf-aed3-b053ab8bd6c2 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:13:25.091434 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-42e893aa-9851-4ddf-aed3-b053ab8bd6c2 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:13:25.104525 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-42e893aa-9851-4ddf-aed3-b053ab8bd6c2 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1219 microversion: 2.1 time: 0.165239 Nov 23 13:13:25.105371 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 773/1539] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:13:24 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1219 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:13:26.124991 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-8efc1348-57f1-45db-9f23-52eb3441bc93 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:13:26.125728 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-8efc1348-57f1-45db-9f23-52eb3441bc93 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:13:26.133292 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8efc1348-57f1-45db-9f23-52eb3441bc93 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:13:26.133738 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8efc1348-57f1-45db-9f23-52eb3441bc93 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:13:26.134509 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8efc1348-57f1-45db-9f23-52eb3441bc93 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:13:26.134962 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8efc1348-57f1-45db-9f23-52eb3441bc93 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:13:26.247309 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-8efc1348-57f1-45db-9f23-52eb3441bc93 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:13:26.255783 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-8efc1348-57f1-45db-9f23-52eb3441bc93 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1219 microversion: 2.1 time: 0.135753 Nov 23 13:13:26.256362 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 767/1540] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:13:26 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1219 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:13:27.276770 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-6114dd6c-77a0-4665-a8c4-e878cdb1c831 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:13:27.277688 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-6114dd6c-77a0-4665-a8c4-e878cdb1c831 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:13:27.290197 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-6114dd6c-77a0-4665-a8c4-e878cdb1c831 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:13:27.290931 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-6114dd6c-77a0-4665-a8c4-e878cdb1c831 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:13:27.292954 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-6114dd6c-77a0-4665-a8c4-e878cdb1c831 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:13:27.293844 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-6114dd6c-77a0-4665-a8c4-e878cdb1c831 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:13:27.426501 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-6114dd6c-77a0-4665-a8c4-e878cdb1c831 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:13:27.437520 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-6114dd6c-77a0-4665-a8c4-e878cdb1c831 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1219 microversion: 2.1 time: 0.167217 Nov 23 13:13:27.438079 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 774/1541] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:13:27 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1219 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:13:28.458525 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-44ac4da0-7507-478e-bc93-c9c90a52dc4d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:13:28.459468 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-44ac4da0-7507-478e-bc93-c9c90a52dc4d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:13:28.469646 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-44ac4da0-7507-478e-bc93-c9c90a52dc4d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:13:28.470086 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-44ac4da0-7507-478e-bc93-c9c90a52dc4d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:13:28.470837 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-44ac4da0-7507-478e-bc93-c9c90a52dc4d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:13:28.471261 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-44ac4da0-7507-478e-bc93-c9c90a52dc4d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:13:28.621987 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-44ac4da0-7507-478e-bc93-c9c90a52dc4d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:13:28.631076 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-44ac4da0-7507-478e-bc93-c9c90a52dc4d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1219 microversion: 2.1 time: 0.178640 Nov 23 13:13:28.631643 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 768/1542] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:13:28 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1219 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:13:29.651427 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-c09d91e5-4071-48a0-9339-951f70416e68 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:13:29.652397 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-c09d91e5-4071-48a0-9339-951f70416e68 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:13:29.664774 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c09d91e5-4071-48a0-9339-951f70416e68 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:13:29.665568 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c09d91e5-4071-48a0-9339-951f70416e68 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:13:29.666822 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c09d91e5-4071-48a0-9339-951f70416e68 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:13:29.667532 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c09d91e5-4071-48a0-9339-951f70416e68 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:13:29.792533 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-c09d91e5-4071-48a0-9339-951f70416e68 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:13:29.801664 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-c09d91e5-4071-48a0-9339-951f70416e68 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1219 microversion: 2.1 time: 0.156682 Nov 23 13:13:29.802243 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 775/1543] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:13:29 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1219 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:13:30.819850 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-9d1b8a9b-db21-45f2-b191-aeb76e7f66d8 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:13:30.820467 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-9d1b8a9b-db21-45f2-b191-aeb76e7f66d8 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:13:30.828376 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-9d1b8a9b-db21-45f2-b191-aeb76e7f66d8 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:13:30.828815 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-9d1b8a9b-db21-45f2-b191-aeb76e7f66d8 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:13:30.829590 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-9d1b8a9b-db21-45f2-b191-aeb76e7f66d8 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:13:30.830032 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-9d1b8a9b-db21-45f2-b191-aeb76e7f66d8 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:13:30.951346 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-9d1b8a9b-db21-45f2-b191-aeb76e7f66d8 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:13:30.960017 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-9d1b8a9b-db21-45f2-b191-aeb76e7f66d8 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1219 microversion: 2.1 time: 0.143943 Nov 23 13:13:30.960651 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 769/1544] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:13:30 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1219 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:13:31.981160 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-2923957b-5755-4f26-9847-cc4a44189754 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:13:31.982209 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-2923957b-5755-4f26-9847-cc4a44189754 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:13:31.990870 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2923957b-5755-4f26-9847-cc4a44189754 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:13:31.991656 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2923957b-5755-4f26-9847-cc4a44189754 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:13:31.992571 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2923957b-5755-4f26-9847-cc4a44189754 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:13:31.993080 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2923957b-5755-4f26-9847-cc4a44189754 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:13:32.119882 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-2923957b-5755-4f26-9847-cc4a44189754 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:13:32.129998 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-2923957b-5755-4f26-9847-cc4a44189754 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1219 microversion: 2.1 time: 0.155145 Nov 23 13:13:32.130485 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 776/1545] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:13:31 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1219 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:13:33.147219 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-f728301f-56f8-4228-bae7-252d6eedd435 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:13:33.147821 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-f728301f-56f8-4228-bae7-252d6eedd435 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:13:33.155816 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f728301f-56f8-4228-bae7-252d6eedd435 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:13:33.156389 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f728301f-56f8-4228-bae7-252d6eedd435 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:13:33.157128 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f728301f-56f8-4228-bae7-252d6eedd435 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:13:33.157554 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f728301f-56f8-4228-bae7-252d6eedd435 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:13:33.270834 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-f728301f-56f8-4228-bae7-252d6eedd435 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:13:33.279563 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-f728301f-56f8-4228-bae7-252d6eedd435 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1219 microversion: 2.1 time: 0.136149 Nov 23 13:13:33.280144 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 770/1546] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:13:33 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1219 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:13:34.299596 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-74245159-ae81-4206-b05f-64e198bd1147 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:13:34.300398 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-74245159-ae81-4206-b05f-64e198bd1147 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:13:34.309910 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-74245159-ae81-4206-b05f-64e198bd1147 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:13:34.310467 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-74245159-ae81-4206-b05f-64e198bd1147 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:13:34.311470 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-74245159-ae81-4206-b05f-64e198bd1147 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:13:34.311902 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-74245159-ae81-4206-b05f-64e198bd1147 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:13:34.437840 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-74245159-ae81-4206-b05f-64e198bd1147 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:13:34.450737 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-74245159-ae81-4206-b05f-64e198bd1147 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1219 microversion: 2.1 time: 0.156344 Nov 23 13:13:34.451489 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 777/1547] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:13:34 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1219 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:13:35.473470 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-bec0a158-9799-4875-9d2b-cbd7cacf1ab8 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:13:35.474085 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-bec0a158-9799-4875-9d2b-cbd7cacf1ab8 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:13:35.481883 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-bec0a158-9799-4875-9d2b-cbd7cacf1ab8 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:13:35.482332 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-bec0a158-9799-4875-9d2b-cbd7cacf1ab8 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:13:35.483106 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-bec0a158-9799-4875-9d2b-cbd7cacf1ab8 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:13:35.483539 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-bec0a158-9799-4875-9d2b-cbd7cacf1ab8 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:13:35.607960 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-bec0a158-9799-4875-9d2b-cbd7cacf1ab8 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:13:35.617268 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-bec0a158-9799-4875-9d2b-cbd7cacf1ab8 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1219 microversion: 2.1 time: 0.147860 Nov 23 13:13:35.617833 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 771/1548] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:13:35 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1219 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:13:36.635159 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-0d8c9247-482d-4cea-9b5b-ca98ae2df0c0 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:13:36.635827 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-0d8c9247-482d-4cea-9b5b-ca98ae2df0c0 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:13:36.644262 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0d8c9247-482d-4cea-9b5b-ca98ae2df0c0 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:13:36.644725 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0d8c9247-482d-4cea-9b5b-ca98ae2df0c0 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:13:36.646011 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0d8c9247-482d-4cea-9b5b-ca98ae2df0c0 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:13:36.646446 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0d8c9247-482d-4cea-9b5b-ca98ae2df0c0 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:13:36.790429 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-0d8c9247-482d-4cea-9b5b-ca98ae2df0c0 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:13:36.805432 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-0d8c9247-482d-4cea-9b5b-ca98ae2df0c0 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1219 microversion: 2.1 time: 0.174162 Nov 23 13:13:36.806263 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 778/1549] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:13:36 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1219 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:13:37.826301 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-629b6758-cadd-47b3-bf02-521eccb13444 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:13:37.827138 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-629b6758-cadd-47b3-bf02-521eccb13444 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:13:37.835618 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-629b6758-cadd-47b3-bf02-521eccb13444 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:13:37.836063 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-629b6758-cadd-47b3-bf02-521eccb13444 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:13:37.836847 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-629b6758-cadd-47b3-bf02-521eccb13444 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:13:37.837276 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-629b6758-cadd-47b3-bf02-521eccb13444 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:13:37.962453 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-629b6758-cadd-47b3-bf02-521eccb13444 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:13:37.975369 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-629b6758-cadd-47b3-bf02-521eccb13444 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1219 microversion: 2.1 time: 0.154857 Nov 23 13:13:37.976139 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 772/1550] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:13:37 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1219 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:13:39.000065 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-7a7dfc88-a341-49f2-b0c2-f2e019c6cebf tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:13:39.001203 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-7a7dfc88-a341-49f2-b0c2-f2e019c6cebf tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:13:39.009173 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7a7dfc88-a341-49f2-b0c2-f2e019c6cebf tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:13:39.009620 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7a7dfc88-a341-49f2-b0c2-f2e019c6cebf tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:13:39.010428 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7a7dfc88-a341-49f2-b0c2-f2e019c6cebf tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:13:39.010859 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7a7dfc88-a341-49f2-b0c2-f2e019c6cebf tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:13:39.129586 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-7a7dfc88-a341-49f2-b0c2-f2e019c6cebf tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:13:39.142250 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-7a7dfc88-a341-49f2-b0c2-f2e019c6cebf tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1219 microversion: 2.1 time: 0.148560 Nov 23 13:13:39.142787 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 779/1551] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:13:38 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1219 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:13:40.158960 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-2d6efade-40ce-4d6e-8d11-6f481b5344cd tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:13:40.159563 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-2d6efade-40ce-4d6e-8d11-6f481b5344cd tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:13:40.167108 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-2d6efade-40ce-4d6e-8d11-6f481b5344cd tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:13:40.167562 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-2d6efade-40ce-4d6e-8d11-6f481b5344cd tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:13:40.168349 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-2d6efade-40ce-4d6e-8d11-6f481b5344cd tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:13:40.168784 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-2d6efade-40ce-4d6e-8d11-6f481b5344cd tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:13:40.295702 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-2d6efade-40ce-4d6e-8d11-6f481b5344cd tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:13:40.309925 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-2d6efade-40ce-4d6e-8d11-6f481b5344cd tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1219 microversion: 2.1 time: 0.154450 Nov 23 13:13:40.310851 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 773/1552] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:13:40 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1219 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:13:41.331033 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-e94f2a4b-b546-4798-8daa-47fb922471f2 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:13:41.331885 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-e94f2a4b-b546-4798-8daa-47fb922471f2 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:13:41.343966 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e94f2a4b-b546-4798-8daa-47fb922471f2 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:13:41.344705 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e94f2a4b-b546-4798-8daa-47fb922471f2 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:13:41.345504 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e94f2a4b-b546-4798-8daa-47fb922471f2 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:13:41.345923 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e94f2a4b-b546-4798-8daa-47fb922471f2 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:13:41.463397 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-e94f2a4b-b546-4798-8daa-47fb922471f2 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:13:41.476163 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-e94f2a4b-b546-4798-8daa-47fb922471f2 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1219 microversion: 2.1 time: 0.151106 Nov 23 13:13:41.476905 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 780/1553] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:13:41 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1219 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:13:42.501061 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-16d150f5-b9a9-43e1-a135-548591c8b52a tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:13:42.501708 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-16d150f5-b9a9-43e1-a135-548591c8b52a tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:13:42.509604 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-16d150f5-b9a9-43e1-a135-548591c8b52a tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:13:42.510048 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-16d150f5-b9a9-43e1-a135-548591c8b52a tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:13:42.510861 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-16d150f5-b9a9-43e1-a135-548591c8b52a tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:13:42.511289 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-16d150f5-b9a9-43e1-a135-548591c8b52a tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:13:42.635966 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-16d150f5-b9a9-43e1-a135-548591c8b52a tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:13:42.646280 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-16d150f5-b9a9-43e1-a135-548591c8b52a tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1219 microversion: 2.1 time: 0.151718 Nov 23 13:13:42.646855 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 774/1554] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:13:42 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1219 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:13:43.667648 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-2d5d29e8-52d6-43c1-b0e8-e3e93985bf9b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:13:43.668554 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-2d5d29e8-52d6-43c1-b0e8-e3e93985bf9b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:13:43.678182 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2d5d29e8-52d6-43c1-b0e8-e3e93985bf9b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:13:43.678625 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2d5d29e8-52d6-43c1-b0e8-e3e93985bf9b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:13:43.679410 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2d5d29e8-52d6-43c1-b0e8-e3e93985bf9b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:13:43.679839 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2d5d29e8-52d6-43c1-b0e8-e3e93985bf9b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:13:43.804124 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-2d5d29e8-52d6-43c1-b0e8-e3e93985bf9b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:13:43.812987 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-2d5d29e8-52d6-43c1-b0e8-e3e93985bf9b tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1219 microversion: 2.1 time: 0.151991 Nov 23 13:13:43.813910 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 781/1555] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:13:43 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1219 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:13:44.829213 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-e2fa6acc-3dc4-4c28-b940-20a408269ad5 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:13:44.829987 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-e2fa6acc-3dc4-4c28-b940-20a408269ad5 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:13:44.837958 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e2fa6acc-3dc4-4c28-b940-20a408269ad5 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:13:44.838396 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e2fa6acc-3dc4-4c28-b940-20a408269ad5 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:13:44.839158 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e2fa6acc-3dc4-4c28-b940-20a408269ad5 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:13:44.839609 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e2fa6acc-3dc4-4c28-b940-20a408269ad5 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:13:44.957239 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-e2fa6acc-3dc4-4c28-b940-20a408269ad5 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:13:44.969852 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-e2fa6acc-3dc4-4c28-b940-20a408269ad5 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1219 microversion: 2.1 time: 0.144051 Nov 23 13:13:44.970546 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 775/1556] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:13:44 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1219 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 13:13:45.990596 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-1efeae5c-bb5c-461c-bf2c-e6ff18c0d3ea tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:13:45.991946 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-1efeae5c-bb5c-461c-bf2c-e6ff18c0d3ea tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:13:46.004727 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1efeae5c-bb5c-461c-bf2c-e6ff18c0d3ea tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:13:46.005471 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1efeae5c-bb5c-461c-bf2c-e6ff18c0d3ea tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:13:46.006721 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1efeae5c-bb5c-461c-bf2c-e6ff18c0d3ea tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:13:46.007436 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1efeae5c-bb5c-461c-bf2c-e6ff18c0d3ea tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:13:46.139591 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-1efeae5c-bb5c-461c-bf2c-e6ff18c0d3ea tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:13:46.149359 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-1efeae5c-bb5c-461c-bf2c-e6ff18c0d3ea tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1219 microversion: 2.1 time: 0.165623 Nov 23 13:13:46.149946 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 782/1557] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:13:45 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1219 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:13:47.170989 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-5b514e6d-a3f3-4ee0-a01e-3c507e630c7c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:13:47.171881 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-5b514e6d-a3f3-4ee0-a01e-3c507e630c7c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:13:47.184610 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5b514e6d-a3f3-4ee0-a01e-3c507e630c7c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:13:47.185363 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5b514e6d-a3f3-4ee0-a01e-3c507e630c7c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:13:47.186630 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5b514e6d-a3f3-4ee0-a01e-3c507e630c7c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:13:47.187349 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5b514e6d-a3f3-4ee0-a01e-3c507e630c7c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:13:47.305654 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-5b514e6d-a3f3-4ee0-a01e-3c507e630c7c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:13:47.315812 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-5b514e6d-a3f3-4ee0-a01e-3c507e630c7c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1219 microversion: 2.1 time: 0.151335 Nov 23 13:13:47.316407 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 776/1558] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:13:47 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1219 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:13:48.337309 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-55d97762-1bff-46fe-8b86-21a6703bf0c2 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:13:48.338296 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-55d97762-1bff-46fe-8b86-21a6703bf0c2 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:13:48.351207 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-55d97762-1bff-46fe-8b86-21a6703bf0c2 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:13:48.351958 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-55d97762-1bff-46fe-8b86-21a6703bf0c2 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:13:48.353248 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-55d97762-1bff-46fe-8b86-21a6703bf0c2 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:13:48.353964 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-55d97762-1bff-46fe-8b86-21a6703bf0c2 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:13:48.482572 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-55d97762-1bff-46fe-8b86-21a6703bf0c2 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:13:48.496429 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-55d97762-1bff-46fe-8b86-21a6703bf0c2 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1219 microversion: 2.1 time: 0.165066 Nov 23 13:13:48.497281 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 783/1559] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:13:48 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1219 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:13:49.518849 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-4c0ebce8-cfd6-4eae-b978-b4036bc874aa tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:13:49.519891 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-4c0ebce8-cfd6-4eae-b978-b4036bc874aa tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:13:49.532741 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4c0ebce8-cfd6-4eae-b978-b4036bc874aa tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:13:49.533589 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4c0ebce8-cfd6-4eae-b978-b4036bc874aa tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:13:49.534462 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4c0ebce8-cfd6-4eae-b978-b4036bc874aa tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:13:49.534891 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4c0ebce8-cfd6-4eae-b978-b4036bc874aa tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:13:49.653326 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-4c0ebce8-cfd6-4eae-b978-b4036bc874aa tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:13:49.665839 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-4c0ebce8-cfd6-4eae-b978-b4036bc874aa tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1219 microversion: 2.1 time: 0.153559 Nov 23 13:13:49.666705 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 777/1560] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:13:49 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1219 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:13:50.331742 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 13:13:50.332811 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: Tue Nov 23 13:13:50 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 23 13:13:50.690844 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-c5d8fc1d-9de5-4732-8886-68f88809361c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:13:50.691711 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-c5d8fc1d-9de5-4732-8886-68f88809361c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:13:50.704210 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c5d8fc1d-9de5-4732-8886-68f88809361c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:13:50.705014 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c5d8fc1d-9de5-4732-8886-68f88809361c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:13:50.706005 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c5d8fc1d-9de5-4732-8886-68f88809361c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:13:50.706439 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c5d8fc1d-9de5-4732-8886-68f88809361c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:13:50.826275 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-c5d8fc1d-9de5-4732-8886-68f88809361c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:13:50.835261 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-c5d8fc1d-9de5-4732-8886-68f88809361c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1219 microversion: 2.1 time: 0.151091 Nov 23 13:13:50.835820 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 784/1561] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:13:50 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1219 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:13:51.852436 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-18706ed1-a248-496c-81f6-d8832efaef6e tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:13:51.853042 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-18706ed1-a248-496c-81f6-d8832efaef6e tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:13:51.860988 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-18706ed1-a248-496c-81f6-d8832efaef6e tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:13:51.861761 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-18706ed1-a248-496c-81f6-d8832efaef6e tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:13:51.862732 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-18706ed1-a248-496c-81f6-d8832efaef6e tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:13:51.863166 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-18706ed1-a248-496c-81f6-d8832efaef6e tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:13:51.980969 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-18706ed1-a248-496c-81f6-d8832efaef6e tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:13:51.991672 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-18706ed1-a248-496c-81f6-d8832efaef6e tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1219 microversion: 2.1 time: 0.142841 Nov 23 13:13:51.992270 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 778/1562] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:13:51 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1219 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:13:53.012091 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-62fdf7c1-09d5-4bf6-968f-8e47d56e3d48 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:13:53.013047 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-62fdf7c1-09d5-4bf6-968f-8e47d56e3d48 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:13:53.024623 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-62fdf7c1-09d5-4bf6-968f-8e47d56e3d48 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:13:53.025320 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-62fdf7c1-09d5-4bf6-968f-8e47d56e3d48 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:13:53.026563 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-62fdf7c1-09d5-4bf6-968f-8e47d56e3d48 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:13:53.027243 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-62fdf7c1-09d5-4bf6-968f-8e47d56e3d48 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:13:53.159138 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-62fdf7c1-09d5-4bf6-968f-8e47d56e3d48 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:13:53.167601 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-62fdf7c1-09d5-4bf6-968f-8e47d56e3d48 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1219 microversion: 2.1 time: 0.161325 Nov 23 13:13:53.168225 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 785/1563] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:13:53 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1219 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:13:54.192799 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-bd1932cf-18d4-4232-9fcc-5727e83aca01 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:13:54.193509 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-bd1932cf-18d4-4232-9fcc-5727e83aca01 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:13:54.205832 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-bd1932cf-18d4-4232-9fcc-5727e83aca01 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:13:54.206280 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-bd1932cf-18d4-4232-9fcc-5727e83aca01 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:13:54.207059 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-bd1932cf-18d4-4232-9fcc-5727e83aca01 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:13:54.207490 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-bd1932cf-18d4-4232-9fcc-5727e83aca01 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:13:54.329854 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-bd1932cf-18d4-4232-9fcc-5727e83aca01 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:13:54.338511 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-bd1932cf-18d4-4232-9fcc-5727e83aca01 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1219 microversion: 2.1 time: 0.152224 Nov 23 13:13:54.339130 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 779/1564] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:13:54 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1219 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:13:55.361694 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-a96750c1-f2c3-4f4a-b413-e9eec4cddfd5 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:13:55.362403 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-a96750c1-f2c3-4f4a-b413-e9eec4cddfd5 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:13:55.372194 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a96750c1-f2c3-4f4a-b413-e9eec4cddfd5 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:13:55.372745 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a96750c1-f2c3-4f4a-b413-e9eec4cddfd5 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:13:55.373642 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a96750c1-f2c3-4f4a-b413-e9eec4cddfd5 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:13:55.374144 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a96750c1-f2c3-4f4a-b413-e9eec4cddfd5 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:13:55.500001 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-a96750c1-f2c3-4f4a-b413-e9eec4cddfd5 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:13:55.509696 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-a96750c1-f2c3-4f4a-b413-e9eec4cddfd5 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1219 microversion: 2.1 time: 0.152491 Nov 23 13:13:55.510234 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 786/1565] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:13:55 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1219 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:13:56.530898 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-a1c189c7-1150-4275-9ee2-c3659c55e856 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:13:56.531837 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-a1c189c7-1150-4275-9ee2-c3659c55e856 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:13:56.544832 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a1c189c7-1150-4275-9ee2-c3659c55e856 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:13:56.545623 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a1c189c7-1150-4275-9ee2-c3659c55e856 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:13:56.547135 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a1c189c7-1150-4275-9ee2-c3659c55e856 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:13:56.547859 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a1c189c7-1150-4275-9ee2-c3659c55e856 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:13:56.672668 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-a1c189c7-1150-4275-9ee2-c3659c55e856 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:13:56.681933 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-a1c189c7-1150-4275-9ee2-c3659c55e856 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1219 microversion: 2.1 time: 0.157502 Nov 23 13:13:56.682509 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 780/1566] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:13:56 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1219 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:13:57.703754 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-d743c2b5-d381-438c-8643-19ccc2a8f5c4 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:13:57.704698 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-d743c2b5-d381-438c-8643-19ccc2a8f5c4 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:13:57.717189 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d743c2b5-d381-438c-8643-19ccc2a8f5c4 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:13:57.717941 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d743c2b5-d381-438c-8643-19ccc2a8f5c4 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:13:57.719253 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d743c2b5-d381-438c-8643-19ccc2a8f5c4 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:13:57.719968 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d743c2b5-d381-438c-8643-19ccc2a8f5c4 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:13:57.837859 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-d743c2b5-d381-438c-8643-19ccc2a8f5c4 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:13:57.846097 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-d743c2b5-d381-438c-8643-19ccc2a8f5c4 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1219 microversion: 2.1 time: 0.148975 Nov 23 13:13:57.846709 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 787/1567] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:13:57 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1219 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:13:58.863642 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-a0721ff1-2c24-4037-867d-6ff5084b02b2 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:13:58.864396 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-a0721ff1-2c24-4037-867d-6ff5084b02b2 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:13:58.873182 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a0721ff1-2c24-4037-867d-6ff5084b02b2 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:13:58.873182 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a0721ff1-2c24-4037-867d-6ff5084b02b2 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:13:58.873854 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a0721ff1-2c24-4037-867d-6ff5084b02b2 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:13:58.874284 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a0721ff1-2c24-4037-867d-6ff5084b02b2 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:13:58.991763 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-a0721ff1-2c24-4037-867d-6ff5084b02b2 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:13:59.004677 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-a0721ff1-2c24-4037-867d-6ff5084b02b2 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1219 microversion: 2.1 time: 0.145278 Nov 23 13:13:59.005259 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 781/1568] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:13:58 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1219 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:14:00.021958 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-d88e8255-49f7-481e-b4a6-5c216ac54201 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:14:00.022616 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-d88e8255-49f7-481e-b4a6-5c216ac54201 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:14:00.030589 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d88e8255-49f7-481e-b4a6-5c216ac54201 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:14:00.031040 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d88e8255-49f7-481e-b4a6-5c216ac54201 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:14:00.031803 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d88e8255-49f7-481e-b4a6-5c216ac54201 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:14:00.032230 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d88e8255-49f7-481e-b4a6-5c216ac54201 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:14:00.153368 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-d88e8255-49f7-481e-b4a6-5c216ac54201 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:14:00.166368 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-d88e8255-49f7-481e-b4a6-5c216ac54201 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1219 microversion: 2.1 time: 0.148003 Nov 23 13:14:00.167192 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 788/1569] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:14:00 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1219 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:14:01.187209 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-8f07855e-f764-4d83-92ee-8b2a0d7094cb tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:14:01.188073 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-8f07855e-f764-4d83-92ee-8b2a0d7094cb tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:14:01.197447 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8f07855e-f764-4d83-92ee-8b2a0d7094cb tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:14:01.197912 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8f07855e-f764-4d83-92ee-8b2a0d7094cb tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:14:01.198692 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8f07855e-f764-4d83-92ee-8b2a0d7094cb tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:14:01.199157 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8f07855e-f764-4d83-92ee-8b2a0d7094cb tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:14:01.320123 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-8f07855e-f764-4d83-92ee-8b2a0d7094cb tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:14:01.333293 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-8f07855e-f764-4d83-92ee-8b2a0d7094cb tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1219 microversion: 2.1 time: 0.152018 Nov 23 13:14:01.333942 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 782/1570] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:14:01 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1219 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:14:02.359648 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-83e45c41-759d-4abc-a9d0-e374c6038b18 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:14:02.360619 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-83e45c41-759d-4abc-a9d0-e374c6038b18 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:14:02.369954 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-83e45c41-759d-4abc-a9d0-e374c6038b18 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:14:02.370397 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-83e45c41-759d-4abc-a9d0-e374c6038b18 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:14:02.371152 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-83e45c41-759d-4abc-a9d0-e374c6038b18 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:14:02.371580 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-83e45c41-759d-4abc-a9d0-e374c6038b18 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:14:02.490260 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-83e45c41-759d-4abc-a9d0-e374c6038b18 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:14:02.499438 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-83e45c41-759d-4abc-a9d0-e374c6038b18 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1219 microversion: 2.1 time: 0.146065 Nov 23 13:14:02.500014 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 789/1571] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:14:02 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1219 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:14:03.520897 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-1141e460-1488-40d7-9824-3abb0524d35d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:14:03.522185 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-1141e460-1488-40d7-9824-3abb0524d35d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:14:03.535057 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-1141e460-1488-40d7-9824-3abb0524d35d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:14:03.535781 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-1141e460-1488-40d7-9824-3abb0524d35d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:14:03.537146 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-1141e460-1488-40d7-9824-3abb0524d35d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:14:03.537670 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-1141e460-1488-40d7-9824-3abb0524d35d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:14:03.668542 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-1141e460-1488-40d7-9824-3abb0524d35d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:14:03.681254 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-1141e460-1488-40d7-9824-3abb0524d35d tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1219 microversion: 2.1 time: 0.166483 Nov 23 13:14:03.682023 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 783/1572] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:14:03 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1219 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:14:04.706706 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-30a9b89a-8a06-4977-9e65-8107794142bd tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:14:04.707722 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-30a9b89a-8a06-4977-9e65-8107794142bd tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:14:04.716086 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-30a9b89a-8a06-4977-9e65-8107794142bd tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:14:04.716568 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-30a9b89a-8a06-4977-9e65-8107794142bd tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:14:04.717338 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-30a9b89a-8a06-4977-9e65-8107794142bd tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:14:04.717771 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-30a9b89a-8a06-4977-9e65-8107794142bd tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:14:04.844623 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-30a9b89a-8a06-4977-9e65-8107794142bd tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:14:04.853436 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-30a9b89a-8a06-4977-9e65-8107794142bd tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1219 microversion: 2.1 time: 0.153369 Nov 23 13:14:04.854050 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 790/1573] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:14:04 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1219 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:14:05.871140 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-d8b537cc-da6c-4ce8-a74f-0dc42ddf0199 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:14:05.871747 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-d8b537cc-da6c-4ce8-a74f-0dc42ddf0199 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:14:05.882703 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d8b537cc-da6c-4ce8-a74f-0dc42ddf0199 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:14:05.883149 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d8b537cc-da6c-4ce8-a74f-0dc42ddf0199 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:14:05.883914 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d8b537cc-da6c-4ce8-a74f-0dc42ddf0199 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:14:05.884382 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d8b537cc-da6c-4ce8-a74f-0dc42ddf0199 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:14:06.084275 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-d8b537cc-da6c-4ce8-a74f-0dc42ddf0199 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:14:06.092969 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-d8b537cc-da6c-4ce8-a74f-0dc42ddf0199 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1219 microversion: 2.1 time: 0.225762 Nov 23 13:14:06.093540 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 784/1574] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:14:05 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1219 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:14:07.119786 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-13222a63-7c51-4f92-8aeb-11a1cbea902c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:14:07.120797 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-13222a63-7c51-4f92-8aeb-11a1cbea902c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:14:07.132362 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-13222a63-7c51-4f92-8aeb-11a1cbea902c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:14:07.132768 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-13222a63-7c51-4f92-8aeb-11a1cbea902c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:14:07.133521 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-13222a63-7c51-4f92-8aeb-11a1cbea902c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:14:07.133945 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-13222a63-7c51-4f92-8aeb-11a1cbea902c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:14:07.260599 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-13222a63-7c51-4f92-8aeb-11a1cbea902c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:14:07.269415 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-13222a63-7c51-4f92-8aeb-11a1cbea902c tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1219 microversion: 2.1 time: 0.156295 Nov 23 13:14:07.272203 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 791/1575] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:14:07 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1219 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:14:08.292686 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-38436dff-db34-4f76-aaf1-84e7dba52e17 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:14:08.293614 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-38436dff-db34-4f76-aaf1-84e7dba52e17 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:14:08.305099 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-38436dff-db34-4f76-aaf1-84e7dba52e17 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:14:08.305519 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-38436dff-db34-4f76-aaf1-84e7dba52e17 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:14:08.306313 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-38436dff-db34-4f76-aaf1-84e7dba52e17 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:14:08.306743 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-38436dff-db34-4f76-aaf1-84e7dba52e17 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:14:08.428549 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-38436dff-db34-4f76-aaf1-84e7dba52e17 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:14:08.437433 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-38436dff-db34-4f76-aaf1-84e7dba52e17 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1219 microversion: 2.1 time: 0.151168 Nov 23 13:14:08.438014 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 785/1576] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:14:08 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1219 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:14:09.463507 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-8f8e5ad5-3a69-463b-bfaf-e43bbbb620e6 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:14:09.464534 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-8f8e5ad5-3a69-463b-bfaf-e43bbbb620e6 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:14:09.476830 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8f8e5ad5-3a69-463b-bfaf-e43bbbb620e6 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:14:09.477684 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8f8e5ad5-3a69-463b-bfaf-e43bbbb620e6 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:14:09.479248 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8f8e5ad5-3a69-463b-bfaf-e43bbbb620e6 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:14:09.479715 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8f8e5ad5-3a69-463b-bfaf-e43bbbb620e6 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:14:09.607382 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-8f8e5ad5-3a69-463b-bfaf-e43bbbb620e6 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:14:09.620899 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-8f8e5ad5-3a69-463b-bfaf-e43bbbb620e6 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1219 microversion: 2.1 time: 0.163389 Nov 23 13:14:09.621802 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 792/1577] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:14:09 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1219 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:14:10.647125 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-bbc6fc50-8685-4d5f-87f8-377a68b4df69 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:14:10.648093 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-bbc6fc50-8685-4d5f-87f8-377a68b4df69 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:14:10.656599 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-bbc6fc50-8685-4d5f-87f8-377a68b4df69 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:14:10.657040 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-bbc6fc50-8685-4d5f-87f8-377a68b4df69 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:14:10.657802 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-bbc6fc50-8685-4d5f-87f8-377a68b4df69 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:14:10.658229 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-bbc6fc50-8685-4d5f-87f8-377a68b4df69 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:14:10.783039 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-bbc6fc50-8685-4d5f-87f8-377a68b4df69 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:14:10.794731 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-bbc6fc50-8685-4d5f-87f8-377a68b4df69 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1219 microversion: 2.1 time: 0.154083 Nov 23 13:14:10.795297 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 786/1578] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:14:10 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1219 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:14:11.812057 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-5303e52d-732c-49eb-817e-04f1d2b7a2f7 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:14:11.812756 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-5303e52d-732c-49eb-817e-04f1d2b7a2f7 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:14:11.820647 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5303e52d-732c-49eb-817e-04f1d2b7a2f7 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:14:11.821092 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5303e52d-732c-49eb-817e-04f1d2b7a2f7 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:14:11.821928 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5303e52d-732c-49eb-817e-04f1d2b7a2f7 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:14:11.822351 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5303e52d-732c-49eb-817e-04f1d2b7a2f7 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:14:11.944892 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-5303e52d-732c-49eb-817e-04f1d2b7a2f7 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:14:11.958221 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-5303e52d-732c-49eb-817e-04f1d2b7a2f7 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1219 microversion: 2.1 time: 0.149745 Nov 23 13:14:11.959109 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 793/1579] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:14:11 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1219 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:14:12.982130 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-8378a34f-3660-4ca1-aa48-c29e565a4ae4 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:14:12.983039 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-8378a34f-3660-4ca1-aa48-c29e565a4ae4 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:14:12.995460 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8378a34f-3660-4ca1-aa48-c29e565a4ae4 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:14:12.995926 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8378a34f-3660-4ca1-aa48-c29e565a4ae4 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:14:12.996718 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8378a34f-3660-4ca1-aa48-c29e565a4ae4 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:14:12.997145 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8378a34f-3660-4ca1-aa48-c29e565a4ae4 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:14:13.119545 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-8378a34f-3660-4ca1-aa48-c29e565a4ae4 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:14:13.134176 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-8378a34f-3660-4ca1-aa48-c29e565a4ae4 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1219 microversion: 2.1 time: 0.158404 Nov 23 13:14:13.134681 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 787/1580] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:14:12 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1219 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:14:14.153670 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-551d722d-71b4-4f8a-83b2-0b0369c1acd5 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:14:14.154316 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-551d722d-71b4-4f8a-83b2-0b0369c1acd5 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:14:14.163294 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-551d722d-71b4-4f8a-83b2-0b0369c1acd5 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:14:14.163795 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-551d722d-71b4-4f8a-83b2-0b0369c1acd5 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:14:14.164687 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-551d722d-71b4-4f8a-83b2-0b0369c1acd5 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:14:14.165308 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-551d722d-71b4-4f8a-83b2-0b0369c1acd5 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:14:14.285076 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-551d722d-71b4-4f8a-83b2-0b0369c1acd5 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:14:14.298766 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-551d722d-71b4-4f8a-83b2-0b0369c1acd5 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1219 microversion: 2.1 time: 0.149772 Nov 23 13:14:14.299557 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 794/1581] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:14:14 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1219 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:14:15.322063 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-93ba18af-7794-4901-974e-5be2c5906aa4 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:14:15.322820 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-93ba18af-7794-4901-974e-5be2c5906aa4 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:14:15.330577 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-93ba18af-7794-4901-974e-5be2c5906aa4 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:14:15.331028 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-93ba18af-7794-4901-974e-5be2c5906aa4 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:14:15.331791 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-93ba18af-7794-4901-974e-5be2c5906aa4 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:14:15.332222 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-93ba18af-7794-4901-974e-5be2c5906aa4 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:14:15.444907 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-93ba18af-7794-4901-974e-5be2c5906aa4 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:14:15.454373 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-93ba18af-7794-4901-974e-5be2c5906aa4 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1219 microversion: 2.1 time: 0.138390 Nov 23 13:14:15.454968 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 788/1582] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:14:15 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1219 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:14:16.475191 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-629d99ba-251f-465e-97b0-e6c3fea55f92 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:14:16.476190 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-629d99ba-251f-465e-97b0-e6c3fea55f92 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:14:16.488961 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-629d99ba-251f-465e-97b0-e6c3fea55f92 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:14:16.489708 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-629d99ba-251f-465e-97b0-e6c3fea55f92 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:14:16.491378 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-629d99ba-251f-465e-97b0-e6c3fea55f92 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:14:16.492086 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-629d99ba-251f-465e-97b0-e6c3fea55f92 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:14:16.617035 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-629d99ba-251f-465e-97b0-e6c3fea55f92 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:14:16.625474 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-629d99ba-251f-465e-97b0-e6c3fea55f92 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1219 microversion: 2.1 time: 0.156446 Nov 23 13:14:16.626034 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 795/1583] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:14:16 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1219 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:14:17.646509 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-8fa2afbf-334b-44b9-a781-11981897fb41 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:14:17.647370 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-8fa2afbf-334b-44b9-a781-11981897fb41 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:14:17.659578 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8fa2afbf-334b-44b9-a781-11981897fb41 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:14:17.660301 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8fa2afbf-334b-44b9-a781-11981897fb41 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:14:17.661580 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8fa2afbf-334b-44b9-a781-11981897fb41 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:14:17.662323 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8fa2afbf-334b-44b9-a781-11981897fb41 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:14:17.787662 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-8fa2afbf-334b-44b9-a781-11981897fb41 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:14:17.796398 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-8fa2afbf-334b-44b9-a781-11981897fb41 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1219 microversion: 2.1 time: 0.156194 Nov 23 13:14:17.796972 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 789/1584] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:14:17 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1219 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:14:18.813638 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-4eafc548-fe25-40ed-aa64-4c23cde78b83 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:14:18.814305 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-4eafc548-fe25-40ed-aa64-4c23cde78b83 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:14:18.823942 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-4eafc548-fe25-40ed-aa64-4c23cde78b83 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:14:18.824614 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-4eafc548-fe25-40ed-aa64-4c23cde78b83 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:14:18.825483 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-4eafc548-fe25-40ed-aa64-4c23cde78b83 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:14:18.825948 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-4eafc548-fe25-40ed-aa64-4c23cde78b83 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:14:19.014889 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-4eafc548-fe25-40ed-aa64-4c23cde78b83 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:14:19.027083 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-4eafc548-fe25-40ed-aa64-4c23cde78b83 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1219 microversion: 2.1 time: 0.217357 Nov 23 13:14:19.027664 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 796/1585] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:14:18 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1219 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:14:20.048477 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-8798a4b7-875c-4c5f-84db-5f59510723b0 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:14:20.049350 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-8798a4b7-875c-4c5f-84db-5f59510723b0 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:14:20.061872 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8798a4b7-875c-4c5f-84db-5f59510723b0 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:14:20.062614 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8798a4b7-875c-4c5f-84db-5f59510723b0 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:14:20.064107 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8798a4b7-875c-4c5f-84db-5f59510723b0 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:14:20.065002 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8798a4b7-875c-4c5f-84db-5f59510723b0 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:14:20.183011 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-8798a4b7-875c-4c5f-84db-5f59510723b0 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:14:20.192273 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-8798a4b7-875c-4c5f-84db-5f59510723b0 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1219 microversion: 2.1 time: 0.150559 Nov 23 13:14:20.192891 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 790/1586] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:14:20 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1219 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:14:21.214160 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-369e6e96-e2ef-461b-856d-7c1686e9eb67 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:14:21.215084 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-369e6e96-e2ef-461b-856d-7c1686e9eb67 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:14:21.227570 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-369e6e96-e2ef-461b-856d-7c1686e9eb67 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:14:21.228313 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-369e6e96-e2ef-461b-856d-7c1686e9eb67 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:14:21.229632 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-369e6e96-e2ef-461b-856d-7c1686e9eb67 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:14:21.230343 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-369e6e96-e2ef-461b-856d-7c1686e9eb67 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:14:21.354933 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-369e6e96-e2ef-461b-856d-7c1686e9eb67 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:14:21.363815 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-369e6e96-e2ef-461b-856d-7c1686e9eb67 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1219 microversion: 2.1 time: 0.156126 Nov 23 13:14:21.364402 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 797/1587] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:14:21 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1219 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:14:22.392989 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-73c61b0c-bd4a-4d31-95ac-84fcc2824263 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:14:22.393976 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-73c61b0c-bd4a-4d31-95ac-84fcc2824263 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:14:22.405744 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-73c61b0c-bd4a-4d31-95ac-84fcc2824263 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:14:22.406350 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-73c61b0c-bd4a-4d31-95ac-84fcc2824263 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:14:22.407203 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-73c61b0c-bd4a-4d31-95ac-84fcc2824263 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:14:22.407626 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-73c61b0c-bd4a-4d31-95ac-84fcc2824263 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:14:22.531018 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-73c61b0c-bd4a-4d31-95ac-84fcc2824263 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:14:22.542078 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-73c61b0c-bd4a-4d31-95ac-84fcc2824263 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1219 microversion: 2.1 time: 0.155839 Nov 23 13:14:22.542715 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 791/1588] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:14:22 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1219 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:14:23.567301 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-915cc724-cd96-4fc8-8153-d9ed2b1b62ff tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:14:23.568228 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-915cc724-cd96-4fc8-8153-d9ed2b1b62ff tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:14:23.579021 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-915cc724-cd96-4fc8-8153-d9ed2b1b62ff tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:14:23.579469 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-915cc724-cd96-4fc8-8153-d9ed2b1b62ff tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:14:23.580227 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-915cc724-cd96-4fc8-8153-d9ed2b1b62ff tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:14:23.580693 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-915cc724-cd96-4fc8-8153-d9ed2b1b62ff tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:14:23.763528 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-915cc724-cd96-4fc8-8153-d9ed2b1b62ff tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:14:23.772486 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-915cc724-cd96-4fc8-8153-d9ed2b1b62ff tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1219 microversion: 2.1 time: 0.211451 Nov 23 13:14:23.773045 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 798/1589] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:14:23 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1219 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:14:24.793410 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-bd1e965a-aef0-4b84-b662-4e71dfb8bf25 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:14:24.794731 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-bd1e965a-aef0-4b84-b662-4e71dfb8bf25 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:14:24.807337 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-bd1e965a-aef0-4b84-b662-4e71dfb8bf25 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:14:24.808085 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-bd1e965a-aef0-4b84-b662-4e71dfb8bf25 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:14:24.809744 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-bd1e965a-aef0-4b84-b662-4e71dfb8bf25 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:14:24.810062 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-bd1e965a-aef0-4b84-b662-4e71dfb8bf25 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:14:24.981722 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-bd1e965a-aef0-4b84-b662-4e71dfb8bf25 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:14:24.991351 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-bd1e965a-aef0-4b84-b662-4e71dfb8bf25 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1219 microversion: 2.1 time: 0.204327 Nov 23 13:14:24.991966 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 792/1590] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:14:24 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1219 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:14:26.013075 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-1c67a35e-019d-42c0-8031-4503a141e310 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:14:26.013826 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-1c67a35e-019d-42c0-8031-4503a141e310 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:14:26.021750 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1c67a35e-019d-42c0-8031-4503a141e310 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:14:26.022187 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1c67a35e-019d-42c0-8031-4503a141e310 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:14:26.022977 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1c67a35e-019d-42c0-8031-4503a141e310 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:14:26.023397 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1c67a35e-019d-42c0-8031-4503a141e310 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:14:26.140169 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-1c67a35e-019d-42c0-8031-4503a141e310 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:14:26.153901 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-1c67a35e-019d-42c0-8031-4503a141e310 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1219 microversion: 2.1 time: 0.146716 Nov 23 13:14:26.154460 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 799/1591] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:14:26 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1219 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:14:27.171689 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-102018da-97ed-47ec-b3e6-f9f373c7d150 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:14:27.172314 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-102018da-97ed-47ec-b3e6-f9f373c7d150 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:14:27.179919 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-102018da-97ed-47ec-b3e6-f9f373c7d150 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:14:27.180373 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-102018da-97ed-47ec-b3e6-f9f373c7d150 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:14:27.181145 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-102018da-97ed-47ec-b3e6-f9f373c7d150 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:14:27.181563 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-102018da-97ed-47ec-b3e6-f9f373c7d150 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:14:27.303316 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-102018da-97ed-47ec-b3e6-f9f373c7d150 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:14:27.314979 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-102018da-97ed-47ec-b3e6-f9f373c7d150 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1219 microversion: 2.1 time: 0.146926 Nov 23 13:14:27.315847 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 793/1592] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:14:27 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1219 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:14:27.910471 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 13:14:27.911255 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: Tue Nov 23 13:14:27 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 23 13:14:28.336506 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-301f408c-a072-44c9-9ae3-4af196d1b986 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:14:28.337501 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-301f408c-a072-44c9-9ae3-4af196d1b986 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:14:28.346614 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-301f408c-a072-44c9-9ae3-4af196d1b986 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:14:28.347088 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-301f408c-a072-44c9-9ae3-4af196d1b986 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:14:28.347842 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-301f408c-a072-44c9-9ae3-4af196d1b986 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:14:28.348271 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-301f408c-a072-44c9-9ae3-4af196d1b986 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:14:28.475411 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-301f408c-a072-44c9-9ae3-4af196d1b986 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:14:28.488647 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-301f408c-a072-44c9-9ae3-4af196d1b986 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1219 microversion: 2.1 time: 0.158176 Nov 23 13:14:28.489557 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 800/1593] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:14:28 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1219 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:14:28.529660 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 13:14:28.530444 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: Tue Nov 23 13:14:28 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 23 13:14:29.510434 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-b82a02a0-69b9-4952-b618-8462ebf0b306 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:14:29.511419 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-b82a02a0-69b9-4952-b618-8462ebf0b306 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:14:29.520278 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b82a02a0-69b9-4952-b618-8462ebf0b306 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:14:29.520762 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b82a02a0-69b9-4952-b618-8462ebf0b306 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:14:29.521516 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b82a02a0-69b9-4952-b618-8462ebf0b306 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:14:29.521947 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b82a02a0-69b9-4952-b618-8462ebf0b306 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:14:29.634213 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-b82a02a0-69b9-4952-b618-8462ebf0b306 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:14:29.642990 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-b82a02a0-69b9-4952-b618-8462ebf0b306 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1219 microversion: 2.1 time: 0.138887 Nov 23 13:14:29.643556 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 794/1594] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:14:29 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1219 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:14:30.664305 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-a42934c9-58af-4d20-b8c3-0b9ea0c8a7da tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:14:30.665240 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-a42934c9-58af-4d20-b8c3-0b9ea0c8a7da tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:14:30.677827 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a42934c9-58af-4d20-b8c3-0b9ea0c8a7da tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:14:30.678527 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a42934c9-58af-4d20-b8c3-0b9ea0c8a7da tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:14:30.679779 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a42934c9-58af-4d20-b8c3-0b9ea0c8a7da tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:14:30.680542 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a42934c9-58af-4d20-b8c3-0b9ea0c8a7da tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:14:30.808269 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-a42934c9-58af-4d20-b8c3-0b9ea0c8a7da tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:14:30.817293 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-a42934c9-58af-4d20-b8c3-0b9ea0c8a7da tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1219 microversion: 2.1 time: 0.159200 Nov 23 13:14:30.817826 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 801/1595] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:14:30 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1219 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:14:31.834288 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-36d7ca46-6ece-4f25-a655-8efcf08836c9 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:14:31.834903 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-36d7ca46-6ece-4f25-a655-8efcf08836c9 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:14:31.843381 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-36d7ca46-6ece-4f25-a655-8efcf08836c9 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:14:31.843827 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-36d7ca46-6ece-4f25-a655-8efcf08836c9 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:14:31.844628 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-36d7ca46-6ece-4f25-a655-8efcf08836c9 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:14:31.845056 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-36d7ca46-6ece-4f25-a655-8efcf08836c9 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:14:32.129594 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-36d7ca46-6ece-4f25-a655-8efcf08836c9 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:14:32.143696 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-36d7ca46-6ece-4f25-a655-8efcf08836c9 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1219 microversion: 2.1 time: 0.312938 Nov 23 13:14:32.144661 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 795/1596] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:14:31 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1219 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:14:33.165574 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-e1532b42-1bfd-4657-8a3d-e268031b9507 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:14:33.166190 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-e1532b42-1bfd-4657-8a3d-e268031b9507 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:14:33.173993 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e1532b42-1bfd-4657-8a3d-e268031b9507 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:14:33.174437 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e1532b42-1bfd-4657-8a3d-e268031b9507 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:14:33.175202 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e1532b42-1bfd-4657-8a3d-e268031b9507 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:14:33.175633 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e1532b42-1bfd-4657-8a3d-e268031b9507 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:14:33.289781 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-e1532b42-1bfd-4657-8a3d-e268031b9507 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:14:33.298336 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-e1532b42-1bfd-4657-8a3d-e268031b9507 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1219 microversion: 2.1 time: 0.136695 Nov 23 13:14:33.298905 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 802/1597] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:14:33 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1219 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:14:34.315955 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-7135463b-f23c-4070-ac08-fbe807edbb14 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:14:34.316646 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-7135463b-f23c-4070-ac08-fbe807edbb14 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:14:34.324187 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-7135463b-f23c-4070-ac08-fbe807edbb14 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:14:34.324711 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-7135463b-f23c-4070-ac08-fbe807edbb14 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:14:34.325553 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-7135463b-f23c-4070-ac08-fbe807edbb14 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:14:34.326041 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-7135463b-f23c-4070-ac08-fbe807edbb14 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:14:34.447755 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-7135463b-f23c-4070-ac08-fbe807edbb14 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:14:34.461589 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-7135463b-f23c-4070-ac08-fbe807edbb14 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1219 microversion: 2.1 time: 0.149106 Nov 23 13:14:34.462506 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 796/1598] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:14:34 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1219 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:14:35.480619 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-2c8a63fd-f8cf-4c4f-8d92-4a3965831025 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:14:35.481204 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-2c8a63fd-f8cf-4c4f-8d92-4a3965831025 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:14:35.489408 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2c8a63fd-f8cf-4c4f-8d92-4a3965831025 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:14:35.489799 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2c8a63fd-f8cf-4c4f-8d92-4a3965831025 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:14:35.490903 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2c8a63fd-f8cf-4c4f-8d92-4a3965831025 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:14:35.491328 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2c8a63fd-f8cf-4c4f-8d92-4a3965831025 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:14:35.561335 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2c8a63fd-f8cf-4c4f-8d92-4a3965831025 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:14:35.561860 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2c8a63fd-f8cf-4c4f-8d92-4a3965831025 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:14:35.562285 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.objects.instance [None req-2c8a63fd-f8cf-4c4f-8d92-4a3965831025 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lazy-loading 'fault' on Instance uuid 5a3c40e3-d194-4953-be2a-355e3cd882d7 {{(pid=100974) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 23 13:14:35.622650 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-2c8a63fd-f8cf-4c4f-8d92-4a3965831025 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f010313d3e4875994e8537e8c9c558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a76cd93551c243ffac2329a86c7fce12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:14:35.631455 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-2c8a63fd-f8cf-4c4f-8d92-4a3965831025 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 200 len: 1313 microversion: 2.1 time: 0.154824 Nov 23 13:14:35.632043 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 803/1599] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:14:35 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:14:36.655116 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-1377bcdb-b4ae-4460-ac1d-9ec476e61583 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:14:36.656295 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-1377bcdb-b4ae-4460-ac1d-9ec476e61583 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] [instance: 5a3c40e3-d194-4953-be2a-355e3cd882d7] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:14:36.664326 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-1377bcdb-b4ae-4460-ac1d-9ec476e61583 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:14:36.664772 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-1377bcdb-b4ae-4460-ac1d-9ec476e61583 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:14:36.665536 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-1377bcdb-b4ae-4460-ac1d-9ec476e61583 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:14:36.665965 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-1377bcdb-b4ae-4460-ac1d-9ec476e61583 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:14:36.715101 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.wsgi [None req-1377bcdb-b4ae-4460-ac1d-9ec476e61583 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] HTTP exception thrown: Instance 5a3c40e3-d194-4953-be2a-355e3cd882d7 could not be found. Nov 23 13:14:36.715695 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-1377bcdb-b4ae-4460-ac1d-9ec476e61583 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Returning 404 to user: Instance 5a3c40e3-d194-4953-be2a-355e3cd882d7 could not be found. {{(pid=100973) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Nov 23 13:14:36.716529 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-1377bcdb-b4ae-4460-ac1d-9ec476e61583 tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7" status: 404 len: 111 microversion: 2.1 time: 0.068404 Nov 23 13:14:36.717070 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 797/1600] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:14:36 2021] GET /compute/v2.1/servers/5a3c40e3-d194-4953-be2a-355e3cd882d7 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 13:14:36.962955 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-c80c7206-26d0-4652-832d-19205648a61f tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] Calling method '.version_select at 0x7f1870237790>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:14:36.987040 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-c80c7206-26d0-4652-832d-19205648a61f tempest-TestShelveInstance-1383780828 tempest-TestShelveInstance-1383780828-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-984203030" status: 202 len: 0 microversion: 2.1 time: 0.027767 Nov 23 13:14:36.987609 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 804/1601] 10.222.0.60 () {58 vars in 1250 bytes} [Tue Nov 23 13:14:36 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-984203030 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:14:45.248122 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 13:14:45.248665 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: Tue Nov 23 13:14:45 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 23 13:15:23.676222 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-f681f271-27ad-44e9-b603-c06c0ce559da tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:15:23.677456 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-f681f271-27ad-44e9-b603-c06c0ce559da tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:15:23.685294 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f681f271-27ad-44e9-b603-c06c0ce559da tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:15:23.685742 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f681f271-27ad-44e9-b603-c06c0ce559da tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:15:23.686492 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f681f271-27ad-44e9-b603-c06c0ce559da tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:15:23.687177 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f681f271-27ad-44e9-b603-c06c0ce559da tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:15:23.756185 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-f681f271-27ad-44e9-b603-c06c0ce559da tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Going to try to terminate instance {{(pid=100973) delete /opt/stack/nova/nova/compute/api.py:2562}} Nov 23 13:15:23.884734 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-f681f271-27ad-44e9-b603-c06c0ce559da tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "DELETE /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 204 len: 0 microversion: 2.1 time: 0.211969 Nov 23 13:15:23.885326 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 798/1602] 10.222.0.60 () {58 vars in 1238 bytes} [Tue Nov 23 13:15:23 2021] DELETE /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 23 13:15:23.891259 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a7b7a666-a1ad-48b3-bbff-ac4178364592] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 23 13:15:23.894879 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-1886e5f0-0414-4eda-a2f7-079c4f6ac814 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:15:23.895493 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-1886e5f0-0414-4eda-a2f7-079c4f6ac814 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:15:23.903738 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1886e5f0-0414-4eda-a2f7-079c4f6ac814 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:15:23.904172 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1886e5f0-0414-4eda-a2f7-079c4f6ac814 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:15:23.904958 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1886e5f0-0414-4eda-a2f7-079c4f6ac814 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:15:23.905384 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1886e5f0-0414-4eda-a2f7-079c4f6ac814 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:15:24.123433 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-1886e5f0-0414-4eda-a2f7-079c4f6ac814 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:15:24.137527 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-1886e5f0-0414-4eda-a2f7-079c4f6ac814 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1598 microversion: 2.1 time: 0.247067 Nov 23 13:15:24.137933 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 805/1603] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:15:23 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1598 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:15:25.156249 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-5d49173f-24ec-4ed4-b1e9-41ca8d9f6662 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:15:25.157224 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-5d49173f-24ec-4ed4-b1e9-41ca8d9f6662 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:15:25.166049 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5d49173f-24ec-4ed4-b1e9-41ca8d9f6662 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:15:25.166487 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5d49173f-24ec-4ed4-b1e9-41ca8d9f6662 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:15:25.167274 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5d49173f-24ec-4ed4-b1e9-41ca8d9f6662 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:15:25.167702 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5d49173f-24ec-4ed4-b1e9-41ca8d9f6662 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:15:25.388620 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-5d49173f-24ec-4ed4-b1e9-41ca8d9f6662 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:15:25.397433 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-5d49173f-24ec-4ed4-b1e9-41ca8d9f6662 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1598 microversion: 2.1 time: 0.246192 Nov 23 13:15:25.397994 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 799/1604] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:15:25 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1598 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:15:25.916363 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [req-018979b8-bf66-4544-abbb-d098214469f1 req-b7c0d54c-e6b7-419c-a7dc-a60a39aca34a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74e06412-022d-4ece-920d-1cba08639d76", "name": "network-vif-deleted", "tag": "2f280c1a-d79b-4581-bd2b-add5ec70ac56"}]} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:15:25.917836 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 13:15:25.917836 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: warnings.warn(msg) Nov 23 13:15:25.940997 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [req-018979b8-bf66-4544-abbb-d098214469f1 req-b7c0d54c-e6b7-419c-a7dc-a60a39aca34a service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:15:25.941723 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [req-018979b8-bf66-4544-abbb-d098214469f1 req-b7c0d54c-e6b7-419c-a7dc-a60a39aca34a service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:15:25.959667 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.compute.server_external_events [req-018979b8-bf66-4544-abbb-d098214469f1 req-b7c0d54c-e6b7-419c-a7dc-a60a39aca34a service nova] Creating event network-vif-deleted:2f280c1a-d79b-4581-bd2b-add5ec70ac56 for instance 74e06412-022d-4ece-920d-1cba08639d76 on hv-cinder-81888 Nov 23 13:15:25.964668 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [req-018979b8-bf66-4544-abbb-d098214469f1 req-b7c0d54c-e6b7-419c-a7dc-a60a39aca34a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052051 Nov 23 13:15:25.966661 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 806/1605] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Nov 23 13:15:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 13:15:26.415011 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-faa30e3d-c0ba-4964-bf08-ceb00c1acd8f tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:15:26.415592 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-faa30e3d-c0ba-4964-bf08-ceb00c1acd8f tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:15:26.424052 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-faa30e3d-c0ba-4964-bf08-ceb00c1acd8f tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:15:26.424538 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-faa30e3d-c0ba-4964-bf08-ceb00c1acd8f tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:15:26.425309 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-faa30e3d-c0ba-4964-bf08-ceb00c1acd8f tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:15:26.426013 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-faa30e3d-c0ba-4964-bf08-ceb00c1acd8f tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:15:26.541647 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-faa30e3d-c0ba-4964-bf08-ceb00c1acd8f tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:15:26.550769 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-faa30e3d-c0ba-4964-bf08-ceb00c1acd8f tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1388 microversion: 2.1 time: 0.139614 Nov 23 13:15:26.551308 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 800/1606] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:15:26 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1388 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:15:27.567886 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-bda1d8f2-0eab-448c-bad3-8a22232079e4 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:15:27.568865 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-bda1d8f2-0eab-448c-bad3-8a22232079e4 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:15:27.572281 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO oslo.messaging._drivers.impl_rabbit [-] [a7b7a666-a1ad-48b3-bbff-ac4178364592] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 50260. Nov 23 13:15:27.579172 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-bda1d8f2-0eab-448c-bad3-8a22232079e4 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:15:27.579621 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-bda1d8f2-0eab-448c-bad3-8a22232079e4 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:15:27.580465 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-bda1d8f2-0eab-448c-bad3-8a22232079e4 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:15:27.580894 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-bda1d8f2-0eab-448c-bad3-8a22232079e4 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:15:27.721888 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-bda1d8f2-0eab-448c-bad3-8a22232079e4 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:15:27.731241 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-bda1d8f2-0eab-448c-bad3-8a22232079e4 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1388 microversion: 2.1 time: 0.167494 Nov 23 13:15:27.731927 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 807/1607] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:15:27 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1388 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:15:28.753108 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-be1693f7-8615-4ff7-bf9d-02a324e241a1 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:15:28.754060 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-be1693f7-8615-4ff7-bf9d-02a324e241a1 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:15:28.765032 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-be1693f7-8615-4ff7-bf9d-02a324e241a1 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:15:28.765469 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-be1693f7-8615-4ff7-bf9d-02a324e241a1 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:15:28.766239 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-be1693f7-8615-4ff7-bf9d-02a324e241a1 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:15:28.766658 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-be1693f7-8615-4ff7-bf9d-02a324e241a1 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:15:28.885138 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-be1693f7-8615-4ff7-bf9d-02a324e241a1 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:15:28.894654 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-be1693f7-8615-4ff7-bf9d-02a324e241a1 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1388 microversion: 2.1 time: 0.148321 Nov 23 13:15:28.895245 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 801/1608] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:15:28 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1388 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:15:29.912385 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-3c03b800-94ef-40be-8b73-9ca704706688 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:15:29.912996 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-3c03b800-94ef-40be-8b73-9ca704706688 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:15:29.920825 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3c03b800-94ef-40be-8b73-9ca704706688 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:15:29.921328 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3c03b800-94ef-40be-8b73-9ca704706688 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:15:29.922085 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3c03b800-94ef-40be-8b73-9ca704706688 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:15:29.922513 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3c03b800-94ef-40be-8b73-9ca704706688 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:15:30.045420 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-3c03b800-94ef-40be-8b73-9ca704706688 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:15:30.059463 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-3c03b800-94ef-40be-8b73-9ca704706688 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1388 microversion: 2.1 time: 0.150723 Nov 23 13:15:30.060046 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 808/1609] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:15:29 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1388 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:15:31.077364 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-6f6efc6a-8b77-44bd-a464-9f9e354689f1 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:15:31.078046 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-6f6efc6a-8b77-44bd-a464-9f9e354689f1 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:15:31.086747 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6f6efc6a-8b77-44bd-a464-9f9e354689f1 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:15:31.087246 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6f6efc6a-8b77-44bd-a464-9f9e354689f1 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:15:31.088109 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6f6efc6a-8b77-44bd-a464-9f9e354689f1 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:15:31.088621 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6f6efc6a-8b77-44bd-a464-9f9e354689f1 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:15:31.209537 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-6f6efc6a-8b77-44bd-a464-9f9e354689f1 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:15:31.223313 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-6f6efc6a-8b77-44bd-a464-9f9e354689f1 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1388 microversion: 2.1 time: 0.150133 Nov 23 13:15:31.224126 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 802/1610] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:15:31 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1388 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:15:32.245198 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-d145e730-e4f4-4db1-bad4-af59ae455405 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:15:32.246104 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-d145e730-e4f4-4db1-bad4-af59ae455405 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:15:32.254691 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d145e730-e4f4-4db1-bad4-af59ae455405 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:15:32.255143 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d145e730-e4f4-4db1-bad4-af59ae455405 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:15:32.255918 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d145e730-e4f4-4db1-bad4-af59ae455405 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:15:32.256385 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d145e730-e4f4-4db1-bad4-af59ae455405 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:15:32.370453 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-d145e730-e4f4-4db1-bad4-af59ae455405 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:15:32.379518 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-d145e730-e4f4-4db1-bad4-af59ae455405 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1388 microversion: 2.1 time: 0.141204 Nov 23 13:15:32.380075 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 809/1611] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:15:32 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1388 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:15:33.395930 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-07d85f88-f1d2-4ec3-ac57-2d91f731996a tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:15:33.396524 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-07d85f88-f1d2-4ec3-ac57-2d91f731996a tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:15:33.404264 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-07d85f88-f1d2-4ec3-ac57-2d91f731996a tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:15:33.404699 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-07d85f88-f1d2-4ec3-ac57-2d91f731996a tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:15:33.405534 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-07d85f88-f1d2-4ec3-ac57-2d91f731996a tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:15:33.405984 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-07d85f88-f1d2-4ec3-ac57-2d91f731996a tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:15:33.621591 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-07d85f88-f1d2-4ec3-ac57-2d91f731996a tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:15:33.630887 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-07d85f88-f1d2-4ec3-ac57-2d91f731996a tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1388 microversion: 2.1 time: 0.238664 Nov 23 13:15:33.631498 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 803/1612] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:15:33 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1388 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:15:34.647807 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-b271067c-fc8d-4020-94bc-8264fc8f9bce tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:15:34.648522 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-b271067c-fc8d-4020-94bc-8264fc8f9bce tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:15:34.656101 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b271067c-fc8d-4020-94bc-8264fc8f9bce tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:15:34.656578 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b271067c-fc8d-4020-94bc-8264fc8f9bce tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:15:34.657328 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b271067c-fc8d-4020-94bc-8264fc8f9bce tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:15:34.657754 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b271067c-fc8d-4020-94bc-8264fc8f9bce tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:15:34.780574 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-b271067c-fc8d-4020-94bc-8264fc8f9bce tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:15:34.789666 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-b271067c-fc8d-4020-94bc-8264fc8f9bce tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1388 microversion: 2.1 time: 0.145523 Nov 23 13:15:34.790270 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 810/1613] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:15:34 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1388 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:15:35.806842 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-b1a0af89-19fa-47da-92a4-fda078df4883 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:15:35.807464 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-b1a0af89-19fa-47da-92a4-fda078df4883 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:15:35.810787 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8c3a1481-9693-4499-8478-a55e09a5b02f] AMQP server on 10.222.0.60:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Nov 23 13:15:35.816222 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b1a0af89-19fa-47da-92a4-fda078df4883 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:15:35.816706 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b1a0af89-19fa-47da-92a4-fda078df4883 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:15:35.817496 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b1a0af89-19fa-47da-92a4-fda078df4883 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:15:35.817922 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b1a0af89-19fa-47da-92a4-fda078df4883 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:15:35.931823 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-b1a0af89-19fa-47da-92a4-fda078df4883 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:15:35.940854 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-b1a0af89-19fa-47da-92a4-fda078df4883 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1388 microversion: 2.1 time: 0.137543 Nov 23 13:15:35.941833 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 804/1614] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:15:35 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1388 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:15:36.958360 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-cf047601-4bc4-41c2-a175-fe32483f9a4b tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:15:36.958886 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-cf047601-4bc4-41c2-a175-fe32483f9a4b tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:15:36.968890 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-cf047601-4bc4-41c2-a175-fe32483f9a4b tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:15:36.969490 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-cf047601-4bc4-41c2-a175-fe32483f9a4b tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:15:36.970706 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-cf047601-4bc4-41c2-a175-fe32483f9a4b tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:15:36.971371 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-cf047601-4bc4-41c2-a175-fe32483f9a4b tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:15:37.091135 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-cf047601-4bc4-41c2-a175-fe32483f9a4b tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:15:37.099911 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-cf047601-4bc4-41c2-a175-fe32483f9a4b tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1388 microversion: 2.1 time: 0.145599 Nov 23 13:15:37.100513 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 811/1615] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:15:36 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1388 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:15:38.117905 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-08cd216a-0d78-44e1-bef1-7cfca0e36cf4 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:15:38.118522 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-08cd216a-0d78-44e1-bef1-7cfca0e36cf4 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:15:38.142768 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO oslo.messaging._drivers.impl_rabbit [-] [8c3a1481-9693-4499-8478-a55e09a5b02f] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 50358. Nov 23 13:15:38.145034 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-08cd216a-0d78-44e1-bef1-7cfca0e36cf4 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:15:38.145485 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-08cd216a-0d78-44e1-bef1-7cfca0e36cf4 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:15:38.146249 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-08cd216a-0d78-44e1-bef1-7cfca0e36cf4 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:15:38.146672 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-08cd216a-0d78-44e1-bef1-7cfca0e36cf4 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:15:38.257627 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-08cd216a-0d78-44e1-bef1-7cfca0e36cf4 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:15:38.266522 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-08cd216a-0d78-44e1-bef1-7cfca0e36cf4 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1388 microversion: 2.1 time: 0.152893 Nov 23 13:15:38.267007 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 805/1616] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:15:38 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1388 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:15:39.288854 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-c1635f3e-4767-47e9-a1cc-67af3981c68d tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:15:39.289891 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-c1635f3e-4767-47e9-a1cc-67af3981c68d tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:15:39.300544 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c1635f3e-4767-47e9-a1cc-67af3981c68d tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:15:39.301010 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c1635f3e-4767-47e9-a1cc-67af3981c68d tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:15:39.301767 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c1635f3e-4767-47e9-a1cc-67af3981c68d tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:15:39.302197 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c1635f3e-4767-47e9-a1cc-67af3981c68d tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:15:39.425930 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-c1635f3e-4767-47e9-a1cc-67af3981c68d tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:15:39.434782 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-c1635f3e-4767-47e9-a1cc-67af3981c68d tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1388 microversion: 2.1 time: 0.152605 Nov 23 13:15:39.435346 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 812/1617] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:15:39 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1388 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:15:40.458320 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-45444d5a-68f4-45a2-a788-fb301a993a66 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:15:40.459323 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-45444d5a-68f4-45a2-a788-fb301a993a66 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:15:40.471034 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-45444d5a-68f4-45a2-a788-fb301a993a66 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:15:40.471482 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-45444d5a-68f4-45a2-a788-fb301a993a66 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:15:40.472269 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-45444d5a-68f4-45a2-a788-fb301a993a66 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:15:40.472720 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-45444d5a-68f4-45a2-a788-fb301a993a66 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:15:40.608484 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-45444d5a-68f4-45a2-a788-fb301a993a66 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:15:40.618786 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-45444d5a-68f4-45a2-a788-fb301a993a66 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1388 microversion: 2.1 time: 0.169281 Nov 23 13:15:40.619518 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 806/1618] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:15:40 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1388 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:15:41.637412 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-98779334-c10a-41f8-b6c7-e88ea12247e0 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:15:41.638042 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-98779334-c10a-41f8-b6c7-e88ea12247e0 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:15:41.646249 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-98779334-c10a-41f8-b6c7-e88ea12247e0 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:15:41.646688 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-98779334-c10a-41f8-b6c7-e88ea12247e0 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:15:41.647533 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-98779334-c10a-41f8-b6c7-e88ea12247e0 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:15:41.647869 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-98779334-c10a-41f8-b6c7-e88ea12247e0 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:15:41.759650 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-98779334-c10a-41f8-b6c7-e88ea12247e0 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:15:41.768417 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-98779334-c10a-41f8-b6c7-e88ea12247e0 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1388 microversion: 2.1 time: 0.134830 Nov 23 13:15:41.768945 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 813/1619] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:15:41 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1388 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:15:42.785531 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-aea52a9a-fd63-4957-b1eb-55721d8da37d tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:15:42.786114 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-aea52a9a-fd63-4957-b1eb-55721d8da37d tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:15:42.793897 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-aea52a9a-fd63-4957-b1eb-55721d8da37d tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:15:42.794324 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-aea52a9a-fd63-4957-b1eb-55721d8da37d tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:15:42.795323 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-aea52a9a-fd63-4957-b1eb-55721d8da37d tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:15:42.795729 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-aea52a9a-fd63-4957-b1eb-55721d8da37d tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:15:42.912604 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-aea52a9a-fd63-4957-b1eb-55721d8da37d tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:15:42.924723 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-aea52a9a-fd63-4957-b1eb-55721d8da37d tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1388 microversion: 2.1 time: 0.143022 Nov 23 13:15:42.925278 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 807/1620] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:15:42 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1388 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:15:43.941666 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-2e185c04-092d-4808-acda-90ae390f94a5 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:15:43.942238 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-2e185c04-092d-4808-acda-90ae390f94a5 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:15:43.949798 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2e185c04-092d-4808-acda-90ae390f94a5 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:15:43.950246 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2e185c04-092d-4808-acda-90ae390f94a5 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:15:43.950993 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2e185c04-092d-4808-acda-90ae390f94a5 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:15:43.951406 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2e185c04-092d-4808-acda-90ae390f94a5 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:15:44.079822 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-2e185c04-092d-4808-acda-90ae390f94a5 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:15:44.089207 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-2e185c04-092d-4808-acda-90ae390f94a5 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1388 microversion: 2.1 time: 0.151300 Nov 23 13:15:44.089802 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 814/1621] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:15:43 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1388 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:15:45.106329 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-fecebf3e-a96e-4e11-bb7a-22d52143ed96 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:15:45.106924 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-fecebf3e-a96e-4e11-bb7a-22d52143ed96 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:15:45.115444 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-fecebf3e-a96e-4e11-bb7a-22d52143ed96 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:15:45.115914 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-fecebf3e-a96e-4e11-bb7a-22d52143ed96 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:15:45.116709 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-fecebf3e-a96e-4e11-bb7a-22d52143ed96 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:15:45.117141 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-fecebf3e-a96e-4e11-bb7a-22d52143ed96 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:15:45.241561 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-fecebf3e-a96e-4e11-bb7a-22d52143ed96 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:15:45.254481 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-fecebf3e-a96e-4e11-bb7a-22d52143ed96 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1388 microversion: 2.1 time: 0.151920 Nov 23 13:15:45.254992 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 808/1622] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:15:45 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1388 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:15:46.278341 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-b763f1e7-bdb5-4b6f-a57e-a40b4768282e tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:15:46.279311 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-b763f1e7-bdb5-4b6f-a57e-a40b4768282e tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:15:46.290005 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b763f1e7-bdb5-4b6f-a57e-a40b4768282e tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:15:46.290454 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b763f1e7-bdb5-4b6f-a57e-a40b4768282e tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:15:46.291219 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b763f1e7-bdb5-4b6f-a57e-a40b4768282e tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:15:46.291658 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b763f1e7-bdb5-4b6f-a57e-a40b4768282e tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:15:46.407973 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-b763f1e7-bdb5-4b6f-a57e-a40b4768282e tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:15:46.417206 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-b763f1e7-bdb5-4b6f-a57e-a40b4768282e tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1388 microversion: 2.1 time: 0.145312 Nov 23 13:15:46.417777 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 815/1623] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:15:46 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1388 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:15:47.434758 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-d6fd0535-ff71-417a-9619-53adfeb3496a tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:15:47.435251 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-d6fd0535-ff71-417a-9619-53adfeb3496a tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:15:47.443142 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d6fd0535-ff71-417a-9619-53adfeb3496a tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:15:47.443542 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d6fd0535-ff71-417a-9619-53adfeb3496a tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:15:47.444374 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d6fd0535-ff71-417a-9619-53adfeb3496a tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:15:47.444792 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d6fd0535-ff71-417a-9619-53adfeb3496a tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:15:47.566489 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-d6fd0535-ff71-417a-9619-53adfeb3496a tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:15:47.579909 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-d6fd0535-ff71-417a-9619-53adfeb3496a tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1388 microversion: 2.1 time: 0.148811 Nov 23 13:15:47.580824 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 809/1624] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:15:47 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1388 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:15:48.602357 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-6a0a2f7c-ce35-485a-9d5c-550e300fa767 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:15:48.603018 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-6a0a2f7c-ce35-485a-9d5c-550e300fa767 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:15:48.612015 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-6a0a2f7c-ce35-485a-9d5c-550e300fa767 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:15:48.612653 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-6a0a2f7c-ce35-485a-9d5c-550e300fa767 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:15:48.613570 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-6a0a2f7c-ce35-485a-9d5c-550e300fa767 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:15:48.614457 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-6a0a2f7c-ce35-485a-9d5c-550e300fa767 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:15:48.734650 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-6a0a2f7c-ce35-485a-9d5c-550e300fa767 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:15:48.746388 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-6a0a2f7c-ce35-485a-9d5c-550e300fa767 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1388 microversion: 2.1 time: 0.150180 Nov 23 13:15:48.746987 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 816/1625] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:15:48 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1388 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:15:49.767536 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-ffadb37b-0596-4b1d-8086-46a24ed540d8 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:15:49.768464 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-ffadb37b-0596-4b1d-8086-46a24ed540d8 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:15:49.777908 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ffadb37b-0596-4b1d-8086-46a24ed540d8 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:15:49.778362 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ffadb37b-0596-4b1d-8086-46a24ed540d8 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:15:49.779128 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ffadb37b-0596-4b1d-8086-46a24ed540d8 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:15:49.779556 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ffadb37b-0596-4b1d-8086-46a24ed540d8 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:15:49.895238 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-ffadb37b-0596-4b1d-8086-46a24ed540d8 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:15:49.908139 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-ffadb37b-0596-4b1d-8086-46a24ed540d8 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1388 microversion: 2.1 time: 0.146781 Nov 23 13:15:49.908869 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 810/1626] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:15:49 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1388 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:15:50.929127 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-314e4b32-c7de-4625-ad54-1daf04af79e7 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:15:50.930211 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-314e4b32-c7de-4625-ad54-1daf04af79e7 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:15:50.942577 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-314e4b32-c7de-4625-ad54-1daf04af79e7 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:15:50.943326 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-314e4b32-c7de-4625-ad54-1daf04af79e7 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:15:50.944708 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-314e4b32-c7de-4625-ad54-1daf04af79e7 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:15:50.945142 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-314e4b32-c7de-4625-ad54-1daf04af79e7 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:15:51.064666 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-314e4b32-c7de-4625-ad54-1daf04af79e7 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:15:51.074146 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-314e4b32-c7de-4625-ad54-1daf04af79e7 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1388 microversion: 2.1 time: 0.151396 Nov 23 13:15:51.074716 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 817/1627] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:15:50 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1388 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:15:52.096578 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-1f1e4164-da2a-40f1-88e1-5d23219ab455 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:15:52.098111 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-1f1e4164-da2a-40f1-88e1-5d23219ab455 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:15:52.108957 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-1f1e4164-da2a-40f1-88e1-5d23219ab455 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:15:52.109408 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-1f1e4164-da2a-40f1-88e1-5d23219ab455 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:15:52.110164 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-1f1e4164-da2a-40f1-88e1-5d23219ab455 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:15:52.110903 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-1f1e4164-da2a-40f1-88e1-5d23219ab455 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:15:52.222641 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-1f1e4164-da2a-40f1-88e1-5d23219ab455 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:15:52.233580 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-1f1e4164-da2a-40f1-88e1-5d23219ab455 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1388 microversion: 2.1 time: 0.144611 Nov 23 13:15:52.234179 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 811/1628] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:15:52 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1388 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:15:53.253216 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-fb85e683-bc46-4734-a444-a6f4cb886058 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:15:53.253828 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-fb85e683-bc46-4734-a444-a6f4cb886058 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:15:53.261537 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-fb85e683-bc46-4734-a444-a6f4cb886058 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:15:53.261976 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-fb85e683-bc46-4734-a444-a6f4cb886058 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:15:53.262735 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-fb85e683-bc46-4734-a444-a6f4cb886058 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:15:53.263155 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-fb85e683-bc46-4734-a444-a6f4cb886058 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:15:53.446423 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-fb85e683-bc46-4734-a444-a6f4cb886058 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:15:53.455407 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-fb85e683-bc46-4734-a444-a6f4cb886058 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1388 microversion: 2.1 time: 0.205898 Nov 23 13:15:53.456083 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 818/1629] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:15:53 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1388 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:15:54.473250 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-5e442c22-7894-4313-ac5a-1a499630ca16 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:15:54.473892 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-5e442c22-7894-4313-ac5a-1a499630ca16 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:15:54.482334 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5e442c22-7894-4313-ac5a-1a499630ca16 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:15:54.482781 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5e442c22-7894-4313-ac5a-1a499630ca16 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:15:54.483571 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5e442c22-7894-4313-ac5a-1a499630ca16 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:15:54.483994 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5e442c22-7894-4313-ac5a-1a499630ca16 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:15:54.604835 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-5e442c22-7894-4313-ac5a-1a499630ca16 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:15:54.614501 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-5e442c22-7894-4313-ac5a-1a499630ca16 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1388 microversion: 2.1 time: 0.144652 Nov 23 13:15:54.615126 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 812/1630] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:15:54 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1388 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:15:55.635925 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-156bc966-964d-485f-9187-93ebd907647a tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:15:55.636648 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-156bc966-964d-485f-9187-93ebd907647a tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:15:55.647843 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-156bc966-964d-485f-9187-93ebd907647a tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:15:55.648394 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-156bc966-964d-485f-9187-93ebd907647a tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:15:55.649383 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-156bc966-964d-485f-9187-93ebd907647a tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:15:55.649806 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-156bc966-964d-485f-9187-93ebd907647a tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:15:55.770580 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-156bc966-964d-485f-9187-93ebd907647a tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:15:55.779691 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-156bc966-964d-485f-9187-93ebd907647a tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1388 microversion: 2.1 time: 0.152542 Nov 23 13:15:55.780264 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 819/1631] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:15:55 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1388 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:15:56.796579 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-0ec6a8e9-4f5c-4980-8566-cd0796c30920 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:15:56.797172 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-0ec6a8e9-4f5c-4980-8566-cd0796c30920 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:15:56.804929 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0ec6a8e9-4f5c-4980-8566-cd0796c30920 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:15:56.805617 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0ec6a8e9-4f5c-4980-8566-cd0796c30920 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:15:56.806368 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0ec6a8e9-4f5c-4980-8566-cd0796c30920 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:15:56.807021 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0ec6a8e9-4f5c-4980-8566-cd0796c30920 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:15:56.922789 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-0ec6a8e9-4f5c-4980-8566-cd0796c30920 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:15:56.934128 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-0ec6a8e9-4f5c-4980-8566-cd0796c30920 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1388 microversion: 2.1 time: 0.141457 Nov 23 13:15:56.934697 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 813/1632] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:15:56 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1388 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:15:57.959048 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-9cbd4f6d-668d-4806-999d-fea836a38bd0 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:15:57.959672 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-9cbd4f6d-668d-4806-999d-fea836a38bd0 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:15:57.968122 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-9cbd4f6d-668d-4806-999d-fea836a38bd0 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:15:57.968610 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-9cbd4f6d-668d-4806-999d-fea836a38bd0 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:15:57.969389 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-9cbd4f6d-668d-4806-999d-fea836a38bd0 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:15:57.969831 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-9cbd4f6d-668d-4806-999d-fea836a38bd0 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:15:58.238012 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-9cbd4f6d-668d-4806-999d-fea836a38bd0 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:15:58.251997 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-9cbd4f6d-668d-4806-999d-fea836a38bd0 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1388 microversion: 2.1 time: 0.298613 Nov 23 13:15:58.252767 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 820/1633] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:15:57 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1388 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:15:59.274726 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-e036187c-86ed-46b9-899c-812b7c004936 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:15:59.275286 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-e036187c-86ed-46b9-899c-812b7c004936 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:15:59.283127 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e036187c-86ed-46b9-899c-812b7c004936 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:15:59.283578 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e036187c-86ed-46b9-899c-812b7c004936 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:15:59.284382 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e036187c-86ed-46b9-899c-812b7c004936 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:15:59.284815 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e036187c-86ed-46b9-899c-812b7c004936 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:15:59.413883 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-e036187c-86ed-46b9-899c-812b7c004936 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:15:59.423081 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-e036187c-86ed-46b9-899c-812b7c004936 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1388 microversion: 2.1 time: 0.154534 Nov 23 13:15:59.423984 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 814/1634] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:15:59 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1388 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:16:00.444102 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-5af7945a-8fa2-47f4-a431-444a4db6d795 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:16:00.445268 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-5af7945a-8fa2-47f4-a431-444a4db6d795 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:16:00.454796 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5af7945a-8fa2-47f4-a431-444a4db6d795 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:16:00.455243 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5af7945a-8fa2-47f4-a431-444a4db6d795 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:16:00.456008 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5af7945a-8fa2-47f4-a431-444a4db6d795 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:16:00.456489 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5af7945a-8fa2-47f4-a431-444a4db6d795 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:16:00.569865 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-5af7945a-8fa2-47f4-a431-444a4db6d795 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:16:00.578715 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-5af7945a-8fa2-47f4-a431-444a4db6d795 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1388 microversion: 2.1 time: 0.141178 Nov 23 13:16:00.579259 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 821/1635] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:16:00 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1388 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:16:01.594796 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-6becf921-1a57-48ee-8dfb-2f2d2a7ebb01 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:16:01.595448 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-6becf921-1a57-48ee-8dfb-2f2d2a7ebb01 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:16:01.603551 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6becf921-1a57-48ee-8dfb-2f2d2a7ebb01 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:16:01.603996 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6becf921-1a57-48ee-8dfb-2f2d2a7ebb01 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:16:01.604796 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6becf921-1a57-48ee-8dfb-2f2d2a7ebb01 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:16:01.605230 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6becf921-1a57-48ee-8dfb-2f2d2a7ebb01 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:16:01.726025 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-6becf921-1a57-48ee-8dfb-2f2d2a7ebb01 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:16:01.740516 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-6becf921-1a57-48ee-8dfb-2f2d2a7ebb01 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1388 microversion: 2.1 time: 0.149108 Nov 23 13:16:01.741373 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 815/1636] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:16:01 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1388 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:16:02.757870 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-0583d5e3-a49c-45bc-a898-b0388458c6df tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:16:02.758672 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-0583d5e3-a49c-45bc-a898-b0388458c6df tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:16:02.766395 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0583d5e3-a49c-45bc-a898-b0388458c6df tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:16:02.766866 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0583d5e3-a49c-45bc-a898-b0388458c6df tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:16:02.767631 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0583d5e3-a49c-45bc-a898-b0388458c6df tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:16:02.768070 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0583d5e3-a49c-45bc-a898-b0388458c6df tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:16:02.881219 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-0583d5e3-a49c-45bc-a898-b0388458c6df tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:16:02.890296 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-0583d5e3-a49c-45bc-a898-b0388458c6df tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1388 microversion: 2.1 time: 0.136342 Nov 23 13:16:02.890866 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 822/1637] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:16:02 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1388 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:16:03.914826 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-451a155d-9b76-48c7-a10c-5887ce30508e tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:16:03.915448 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-451a155d-9b76-48c7-a10c-5887ce30508e tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:16:03.927017 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-451a155d-9b76-48c7-a10c-5887ce30508e tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:16:03.927671 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-451a155d-9b76-48c7-a10c-5887ce30508e tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:16:03.928814 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-451a155d-9b76-48c7-a10c-5887ce30508e tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:16:03.929435 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-451a155d-9b76-48c7-a10c-5887ce30508e tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:16:04.046522 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-451a155d-9b76-48c7-a10c-5887ce30508e tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:16:04.058990 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-451a155d-9b76-48c7-a10c-5887ce30508e tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1388 microversion: 2.1 time: 0.149784 Nov 23 13:16:04.059554 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 816/1638] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:16:03 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1388 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:16:05.005584 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 13:16:05.006258 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: Tue Nov 23 13:16:05 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 23 13:16:05.079147 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-31859cd3-3358-46b1-a85a-3b7809c6dfed tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:16:05.080094 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-31859cd3-3358-46b1-a85a-3b7809c6dfed tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:16:05.091786 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-31859cd3-3358-46b1-a85a-3b7809c6dfed tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:16:05.092541 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-31859cd3-3358-46b1-a85a-3b7809c6dfed tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:16:05.093714 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-31859cd3-3358-46b1-a85a-3b7809c6dfed tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:16:05.094377 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-31859cd3-3358-46b1-a85a-3b7809c6dfed tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:16:05.219286 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-31859cd3-3358-46b1-a85a-3b7809c6dfed tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:16:05.233783 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-31859cd3-3358-46b1-a85a-3b7809c6dfed tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1388 microversion: 2.1 time: 0.159993 Nov 23 13:16:05.234547 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 823/1639] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:16:05 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1388 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:16:06.255583 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-e8088a0b-8747-4f6c-b647-ff7b558f8a36 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:16:06.256273 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-e8088a0b-8747-4f6c-b647-ff7b558f8a36 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:16:06.264926 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e8088a0b-8747-4f6c-b647-ff7b558f8a36 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:16:06.265377 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e8088a0b-8747-4f6c-b647-ff7b558f8a36 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:16:06.266143 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e8088a0b-8747-4f6c-b647-ff7b558f8a36 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:16:06.266571 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e8088a0b-8747-4f6c-b647-ff7b558f8a36 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:16:06.389536 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-e8088a0b-8747-4f6c-b647-ff7b558f8a36 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:16:06.403910 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-e8088a0b-8747-4f6c-b647-ff7b558f8a36 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1388 microversion: 2.1 time: 0.152355 Nov 23 13:16:06.404815 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 817/1640] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:16:06 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1388 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:16:07.426375 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-52d73da8-87e2-493b-b6e2-19a130b954ff tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:16:07.427006 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-52d73da8-87e2-493b-b6e2-19a130b954ff tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:16:07.436831 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-52d73da8-87e2-493b-b6e2-19a130b954ff tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:16:07.438587 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-52d73da8-87e2-493b-b6e2-19a130b954ff tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:16:07.440516 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-52d73da8-87e2-493b-b6e2-19a130b954ff tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:16:07.440953 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-52d73da8-87e2-493b-b6e2-19a130b954ff tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:16:07.569233 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-52d73da8-87e2-493b-b6e2-19a130b954ff tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:16:07.583509 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-52d73da8-87e2-493b-b6e2-19a130b954ff tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1388 microversion: 2.1 time: 0.160719 Nov 23 13:16:07.584300 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 824/1641] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:16:07 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1388 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:16:08.605629 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-5063eb6a-dbfa-405f-9add-ae2680071c7c tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:16:08.606246 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-5063eb6a-dbfa-405f-9add-ae2680071c7c tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:16:08.615036 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5063eb6a-dbfa-405f-9add-ae2680071c7c tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:16:08.615483 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5063eb6a-dbfa-405f-9add-ae2680071c7c tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:16:08.616264 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5063eb6a-dbfa-405f-9add-ae2680071c7c tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:16:08.616718 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5063eb6a-dbfa-405f-9add-ae2680071c7c tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:16:08.736496 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-5063eb6a-dbfa-405f-9add-ae2680071c7c tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:16:08.750212 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-5063eb6a-dbfa-405f-9add-ae2680071c7c tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1388 microversion: 2.1 time: 0.151603 Nov 23 13:16:08.750963 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 818/1642] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:16:08 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1388 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:16:09.775303 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-325e3768-4894-499d-be3c-16991e057ae2 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:16:09.776221 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-325e3768-4894-499d-be3c-16991e057ae2 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:16:09.785367 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-325e3768-4894-499d-be3c-16991e057ae2 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:16:09.785828 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-325e3768-4894-499d-be3c-16991e057ae2 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:16:09.786599 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-325e3768-4894-499d-be3c-16991e057ae2 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:16:09.787034 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-325e3768-4894-499d-be3c-16991e057ae2 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:16:09.901508 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-325e3768-4894-499d-be3c-16991e057ae2 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:16:09.910416 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-325e3768-4894-499d-be3c-16991e057ae2 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1388 microversion: 2.1 time: 0.141561 Nov 23 13:16:09.910974 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 825/1643] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:16:09 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1388 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:16:10.927184 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-fd10a4a4-7a05-428f-bccb-9d96be48042b tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:16:10.927805 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-fd10a4a4-7a05-428f-bccb-9d96be48042b tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:16:10.935748 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-fd10a4a4-7a05-428f-bccb-9d96be48042b tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:16:10.936201 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-fd10a4a4-7a05-428f-bccb-9d96be48042b tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:16:10.936995 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-fd10a4a4-7a05-428f-bccb-9d96be48042b tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:16:10.937412 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-fd10a4a4-7a05-428f-bccb-9d96be48042b tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:16:11.060373 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-fd10a4a4-7a05-428f-bccb-9d96be48042b tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:16:11.069536 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-fd10a4a4-7a05-428f-bccb-9d96be48042b tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1388 microversion: 2.1 time: 0.146150 Nov 23 13:16:11.070116 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 819/1644] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:16:10 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1388 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:16:12.090817 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-1e1052bf-d0b0-4b93-89aa-f4152bfe7d54 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:16:12.091830 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-1e1052bf-d0b0-4b93-89aa-f4152bfe7d54 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:16:12.099729 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1e1052bf-d0b0-4b93-89aa-f4152bfe7d54 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:16:12.100178 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1e1052bf-d0b0-4b93-89aa-f4152bfe7d54 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:16:12.100980 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1e1052bf-d0b0-4b93-89aa-f4152bfe7d54 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:16:12.101403 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1e1052bf-d0b0-4b93-89aa-f4152bfe7d54 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:16:12.224851 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-1e1052bf-d0b0-4b93-89aa-f4152bfe7d54 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:16:12.234859 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-1e1052bf-d0b0-4b93-89aa-f4152bfe7d54 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1388 microversion: 2.1 time: 0.150318 Nov 23 13:16:12.235446 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 826/1645] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:16:12 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1388 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:16:13.256195 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-7e20d217-8a60-4a0b-b3c8-93b8d0ccf1ac tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:16:13.257124 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-7e20d217-8a60-4a0b-b3c8-93b8d0ccf1ac tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:16:13.268388 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-7e20d217-8a60-4a0b-b3c8-93b8d0ccf1ac tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:16:13.268969 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-7e20d217-8a60-4a0b-b3c8-93b8d0ccf1ac tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:16:13.269751 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-7e20d217-8a60-4a0b-b3c8-93b8d0ccf1ac tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:16:13.270176 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-7e20d217-8a60-4a0b-b3c8-93b8d0ccf1ac tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:16:13.389404 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-7e20d217-8a60-4a0b-b3c8-93b8d0ccf1ac tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:16:13.398352 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-7e20d217-8a60-4a0b-b3c8-93b8d0ccf1ac tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1388 microversion: 2.1 time: 0.148716 Nov 23 13:16:13.398916 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 820/1646] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:16:13 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1388 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:16:14.415560 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-476348cf-60a0-41cb-8255-15337c35ba38 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:16:14.416344 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-476348cf-60a0-41cb-8255-15337c35ba38 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:16:14.424351 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-476348cf-60a0-41cb-8255-15337c35ba38 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:16:14.424810 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-476348cf-60a0-41cb-8255-15337c35ba38 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:16:14.425564 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-476348cf-60a0-41cb-8255-15337c35ba38 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:16:14.425991 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-476348cf-60a0-41cb-8255-15337c35ba38 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:16:14.537144 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-476348cf-60a0-41cb-8255-15337c35ba38 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:16:14.546367 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-476348cf-60a0-41cb-8255-15337c35ba38 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1388 microversion: 2.1 time: 0.134477 Nov 23 13:16:14.546945 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 827/1647] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:16:14 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1388 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:16:15.563450 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-fcb84347-8e0e-4ef7-af44-d71883dbff46 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:16:15.564141 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-fcb84347-8e0e-4ef7-af44-d71883dbff46 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:16:15.571767 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-fcb84347-8e0e-4ef7-af44-d71883dbff46 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:16:15.572207 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-fcb84347-8e0e-4ef7-af44-d71883dbff46 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:16:15.573009 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-fcb84347-8e0e-4ef7-af44-d71883dbff46 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:16:15.573438 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-fcb84347-8e0e-4ef7-af44-d71883dbff46 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:16:15.690614 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-fcb84347-8e0e-4ef7-af44-d71883dbff46 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:16:15.699417 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-fcb84347-8e0e-4ef7-af44-d71883dbff46 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1388 microversion: 2.1 time: 0.140213 Nov 23 13:16:15.699976 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 821/1648] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:16:15 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1388 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 13:16:16.715420 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-43909329-97a0-4326-8ae7-10159cfa543a tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:16:16.715976 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-43909329-97a0-4326-8ae7-10159cfa543a tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:16:16.723539 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-43909329-97a0-4326-8ae7-10159cfa543a tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:16:16.723985 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-43909329-97a0-4326-8ae7-10159cfa543a tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:16:16.724812 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-43909329-97a0-4326-8ae7-10159cfa543a tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:16:16.725280 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-43909329-97a0-4326-8ae7-10159cfa543a tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:16:16.838346 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-43909329-97a0-4326-8ae7-10159cfa543a tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:16:16.847343 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-43909329-97a0-4326-8ae7-10159cfa543a tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1388 microversion: 2.1 time: 0.135677 Nov 23 13:16:16.847885 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 828/1649] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:16:16 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1388 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:16:17.865130 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-f15cdbd1-c9c2-4121-9dad-473a742d7a94 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:16:17.865729 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-f15cdbd1-c9c2-4121-9dad-473a742d7a94 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:16:17.873563 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f15cdbd1-c9c2-4121-9dad-473a742d7a94 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:16:17.874014 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f15cdbd1-c9c2-4121-9dad-473a742d7a94 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:16:17.874798 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f15cdbd1-c9c2-4121-9dad-473a742d7a94 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:16:17.875228 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f15cdbd1-c9c2-4121-9dad-473a742d7a94 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:16:17.998546 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-f15cdbd1-c9c2-4121-9dad-473a742d7a94 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:16:18.008028 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-f15cdbd1-c9c2-4121-9dad-473a742d7a94 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1388 microversion: 2.1 time: 0.147194 Nov 23 13:16:18.008628 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 822/1650] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:16:17 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1388 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:16:19.026341 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-d27d8a59-004f-4e8c-b6ea-2b8a2d1939ac tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:16:19.027428 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-d27d8a59-004f-4e8c-b6ea-2b8a2d1939ac tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:16:19.034786 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d27d8a59-004f-4e8c-b6ea-2b8a2d1939ac tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:16:19.035224 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d27d8a59-004f-4e8c-b6ea-2b8a2d1939ac tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:16:19.036035 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d27d8a59-004f-4e8c-b6ea-2b8a2d1939ac tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:16:19.036450 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d27d8a59-004f-4e8c-b6ea-2b8a2d1939ac tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:16:19.172557 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-d27d8a59-004f-4e8c-b6ea-2b8a2d1939ac tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:16:19.181668 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-d27d8a59-004f-4e8c-b6ea-2b8a2d1939ac tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1388 microversion: 2.1 time: 0.159137 Nov 23 13:16:19.182245 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 829/1651] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:16:19 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1388 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:16:20.202452 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-4d29cb84-9951-441c-81cd-6fa71f1d35ff tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:16:20.203261 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-4d29cb84-9951-441c-81cd-6fa71f1d35ff tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:16:20.215820 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4d29cb84-9951-441c-81cd-6fa71f1d35ff tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:16:20.216617 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4d29cb84-9951-441c-81cd-6fa71f1d35ff tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:16:20.217868 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4d29cb84-9951-441c-81cd-6fa71f1d35ff tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:16:20.218575 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4d29cb84-9951-441c-81cd-6fa71f1d35ff tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:16:20.335052 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-4d29cb84-9951-441c-81cd-6fa71f1d35ff tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:16:20.347484 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-4d29cb84-9951-441c-81cd-6fa71f1d35ff tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1388 microversion: 2.1 time: 0.151426 Nov 23 13:16:20.348041 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 823/1652] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:16:20 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1388 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:16:21.369045 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-10c3e1f9-ceed-432f-8f6d-80f8b5ad3a12 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:16:21.370025 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-10c3e1f9-ceed-432f-8f6d-80f8b5ad3a12 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:16:21.382509 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-10c3e1f9-ceed-432f-8f6d-80f8b5ad3a12 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:16:21.383240 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-10c3e1f9-ceed-432f-8f6d-80f8b5ad3a12 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:16:21.384536 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-10c3e1f9-ceed-432f-8f6d-80f8b5ad3a12 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:16:21.385239 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-10c3e1f9-ceed-432f-8f6d-80f8b5ad3a12 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:16:21.500844 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-10c3e1f9-ceed-432f-8f6d-80f8b5ad3a12 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:16:21.510466 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-10c3e1f9-ceed-432f-8f6d-80f8b5ad3a12 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1388 microversion: 2.1 time: 0.147998 Nov 23 13:16:21.511027 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 830/1653] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:16:21 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1388 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:16:22.533521 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-e4bc1a13-cce9-4ab7-812c-62fa669a6e5b tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:16:22.534321 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-e4bc1a13-cce9-4ab7-812c-62fa669a6e5b tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:16:22.542403 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e4bc1a13-cce9-4ab7-812c-62fa669a6e5b tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:16:22.542852 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e4bc1a13-cce9-4ab7-812c-62fa669a6e5b tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:16:22.543611 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e4bc1a13-cce9-4ab7-812c-62fa669a6e5b tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:16:22.544039 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e4bc1a13-cce9-4ab7-812c-62fa669a6e5b tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:16:22.660937 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-e4bc1a13-cce9-4ab7-812c-62fa669a6e5b tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:16:22.669494 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-e4bc1a13-cce9-4ab7-812c-62fa669a6e5b tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1388 microversion: 2.1 time: 0.142287 Nov 23 13:16:22.670057 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 824/1654] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:16:22 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1388 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:16:23.690668 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-c845a219-d19b-4e92-8945-d60964e8a65c tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:16:23.691306 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-c845a219-d19b-4e92-8945-d60964e8a65c tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:16:23.699339 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c845a219-d19b-4e92-8945-d60964e8a65c tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:16:23.699793 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c845a219-d19b-4e92-8945-d60964e8a65c tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:16:23.700599 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c845a219-d19b-4e92-8945-d60964e8a65c tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:16:23.701027 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c845a219-d19b-4e92-8945-d60964e8a65c tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:16:23.814480 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-c845a219-d19b-4e92-8945-d60964e8a65c tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:16:23.823761 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-c845a219-d19b-4e92-8945-d60964e8a65c tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1388 microversion: 2.1 time: 0.139459 Nov 23 13:16:23.824354 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 831/1655] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:16:23 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1388 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:16:24.841211 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-51e2f463-dbd2-4dd2-aec5-0c9af49e7903 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:16:24.841778 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-51e2f463-dbd2-4dd2-aec5-0c9af49e7903 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:16:24.850108 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-51e2f463-dbd2-4dd2-aec5-0c9af49e7903 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:16:24.850577 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-51e2f463-dbd2-4dd2-aec5-0c9af49e7903 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:16:24.851351 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-51e2f463-dbd2-4dd2-aec5-0c9af49e7903 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:16:24.851779 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-51e2f463-dbd2-4dd2-aec5-0c9af49e7903 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:16:24.970297 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-51e2f463-dbd2-4dd2-aec5-0c9af49e7903 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:16:24.984731 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-51e2f463-dbd2-4dd2-aec5-0c9af49e7903 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1388 microversion: 2.1 time: 0.146935 Nov 23 13:16:24.985563 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 825/1656] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:16:24 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1388 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:16:26.003415 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-743c723a-0d23-4193-832e-ad63f315c2c0 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:16:26.004068 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-743c723a-0d23-4193-832e-ad63f315c2c0 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:16:26.011668 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-743c723a-0d23-4193-832e-ad63f315c2c0 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:16:26.012118 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-743c723a-0d23-4193-832e-ad63f315c2c0 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:16:26.012919 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-743c723a-0d23-4193-832e-ad63f315c2c0 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:16:26.013319 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-743c723a-0d23-4193-832e-ad63f315c2c0 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:16:26.137841 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-743c723a-0d23-4193-832e-ad63f315c2c0 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:16:26.152311 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-743c723a-0d23-4193-832e-ad63f315c2c0 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1388 microversion: 2.1 time: 0.152903 Nov 23 13:16:26.153448 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 832/1657] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:16:25 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1388 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:16:27.171504 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-5191dd32-ea1a-4ae0-a41c-234f2d1292f4 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:16:27.172054 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-5191dd32-ea1a-4ae0-a41c-234f2d1292f4 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:16:27.180030 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5191dd32-ea1a-4ae0-a41c-234f2d1292f4 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:16:27.180513 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5191dd32-ea1a-4ae0-a41c-234f2d1292f4 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:16:27.181281 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5191dd32-ea1a-4ae0-a41c-234f2d1292f4 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:16:27.181712 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5191dd32-ea1a-4ae0-a41c-234f2d1292f4 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:16:27.295783 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-5191dd32-ea1a-4ae0-a41c-234f2d1292f4 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:16:27.310363 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-5191dd32-ea1a-4ae0-a41c-234f2d1292f4 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1388 microversion: 2.1 time: 0.142422 Nov 23 13:16:27.311111 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 826/1658] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:16:27 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1388 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:16:28.336126 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-28183b76-62c4-45c5-830e-a0ae50bfe70c tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:16:28.337183 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-28183b76-62c4-45c5-830e-a0ae50bfe70c tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:16:28.348578 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-28183b76-62c4-45c5-830e-a0ae50bfe70c tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:16:28.349027 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-28183b76-62c4-45c5-830e-a0ae50bfe70c tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:16:28.349789 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-28183b76-62c4-45c5-830e-a0ae50bfe70c tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:16:28.350217 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-28183b76-62c4-45c5-830e-a0ae50bfe70c tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:16:28.466214 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-28183b76-62c4-45c5-830e-a0ae50bfe70c tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:16:28.475158 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-28183b76-62c4-45c5-830e-a0ae50bfe70c tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1388 microversion: 2.1 time: 0.145303 Nov 23 13:16:28.475684 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 833/1659] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:16:28 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1388 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:16:29.496753 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-262dd427-29a4-43a7-a44b-0ee92cb937ca tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:16:29.497674 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-262dd427-29a4-43a7-a44b-0ee92cb937ca tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:16:29.510418 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-262dd427-29a4-43a7-a44b-0ee92cb937ca tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:16:29.511160 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-262dd427-29a4-43a7-a44b-0ee92cb937ca tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:16:29.512469 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-262dd427-29a4-43a7-a44b-0ee92cb937ca tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:16:29.513190 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-262dd427-29a4-43a7-a44b-0ee92cb937ca tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:16:29.639233 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-262dd427-29a4-43a7-a44b-0ee92cb937ca tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:16:29.651062 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-262dd427-29a4-43a7-a44b-0ee92cb937ca tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1388 microversion: 2.1 time: 0.160521 Nov 23 13:16:29.651965 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 827/1660] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:16:29 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1388 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:16:30.675250 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-d29f3704-c519-467d-95a0-982d8c756751 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:16:30.676275 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-d29f3704-c519-467d-95a0-982d8c756751 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:16:30.688627 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d29f3704-c519-467d-95a0-982d8c756751 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:16:30.689394 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d29f3704-c519-467d-95a0-982d8c756751 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:16:30.690896 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d29f3704-c519-467d-95a0-982d8c756751 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:16:30.691342 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d29f3704-c519-467d-95a0-982d8c756751 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:16:30.814312 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-d29f3704-c519-467d-95a0-982d8c756751 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:16:30.824033 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-d29f3704-c519-467d-95a0-982d8c756751 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1388 microversion: 2.1 time: 0.155240 Nov 23 13:16:30.824766 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 834/1661] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:16:30 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1388 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:16:31.841916 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-a4252da8-4d65-4b92-965e-14fec0adc4be tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:16:31.842613 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-a4252da8-4d65-4b92-965e-14fec0adc4be tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:16:31.851765 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a4252da8-4d65-4b92-965e-14fec0adc4be tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:16:31.852693 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a4252da8-4d65-4b92-965e-14fec0adc4be tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:16:31.853425 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a4252da8-4d65-4b92-965e-14fec0adc4be tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:16:31.854269 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a4252da8-4d65-4b92-965e-14fec0adc4be tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:16:31.970329 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-a4252da8-4d65-4b92-965e-14fec0adc4be tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:16:31.979717 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-a4252da8-4d65-4b92-965e-14fec0adc4be tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1388 microversion: 2.1 time: 0.141650 Nov 23 13:16:31.980296 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 828/1662] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:16:31 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1388 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:16:32.997892 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-12c616ab-dc0a-48a1-9092-c3c0d813087e tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:16:32.998549 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-12c616ab-dc0a-48a1-9092-c3c0d813087e tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:16:33.007016 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-12c616ab-dc0a-48a1-9092-c3c0d813087e tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:16:33.007457 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-12c616ab-dc0a-48a1-9092-c3c0d813087e tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:16:33.008208 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-12c616ab-dc0a-48a1-9092-c3c0d813087e tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:16:33.008663 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-12c616ab-dc0a-48a1-9092-c3c0d813087e tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:16:33.127749 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-12c616ab-dc0a-48a1-9092-c3c0d813087e tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:16:33.137001 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-12c616ab-dc0a-48a1-9092-c3c0d813087e tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1388 microversion: 2.1 time: 0.143327 Nov 23 13:16:33.137617 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 835/1663] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:16:32 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1388 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:16:34.158786 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-1c1a3e56-d3c4-4d12-a74c-fb1c21e67dfc tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:16:34.159810 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-1c1a3e56-d3c4-4d12-a74c-fb1c21e67dfc tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:16:34.168356 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-1c1a3e56-d3c4-4d12-a74c-fb1c21e67dfc tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:16:34.168809 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-1c1a3e56-d3c4-4d12-a74c-fb1c21e67dfc tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:16:34.169581 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-1c1a3e56-d3c4-4d12-a74c-fb1c21e67dfc tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:16:34.170019 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-1c1a3e56-d3c4-4d12-a74c-fb1c21e67dfc tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:16:34.282089 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-1c1a3e56-d3c4-4d12-a74c-fb1c21e67dfc tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:16:34.291205 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-1c1a3e56-d3c4-4d12-a74c-fb1c21e67dfc tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1388 microversion: 2.1 time: 0.138999 Nov 23 13:16:34.291750 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 829/1664] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:16:34 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1388 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:16:35.308067 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-939690f7-ca88-476e-8861-95b84f9f369b tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:16:35.308702 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-939690f7-ca88-476e-8861-95b84f9f369b tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:16:35.316618 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-939690f7-ca88-476e-8861-95b84f9f369b tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:16:35.317063 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-939690f7-ca88-476e-8861-95b84f9f369b tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:16:35.317887 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-939690f7-ca88-476e-8861-95b84f9f369b tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:16:35.318315 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-939690f7-ca88-476e-8861-95b84f9f369b tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:16:35.430647 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-939690f7-ca88-476e-8861-95b84f9f369b tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:16:35.439714 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-939690f7-ca88-476e-8861-95b84f9f369b tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1388 microversion: 2.1 time: 0.135278 Nov 23 13:16:35.440265 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 836/1665] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:16:35 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1388 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:16:36.459194 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-bdf1b4d6-4818-464a-ab5e-b92df8f29fed tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:16:36.459784 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-bdf1b4d6-4818-464a-ab5e-b92df8f29fed tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:16:36.467636 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-bdf1b4d6-4818-464a-ab5e-b92df8f29fed tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:16:36.468084 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-bdf1b4d6-4818-464a-ab5e-b92df8f29fed tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:16:36.468883 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-bdf1b4d6-4818-464a-ab5e-b92df8f29fed tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:16:36.469316 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-bdf1b4d6-4818-464a-ab5e-b92df8f29fed tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:16:36.586610 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-bdf1b4d6-4818-464a-ab5e-b92df8f29fed tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:16:36.595628 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-bdf1b4d6-4818-464a-ab5e-b92df8f29fed tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1388 microversion: 2.1 time: 0.141174 Nov 23 13:16:36.596163 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 830/1666] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:16:36 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1388 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:16:37.612497 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-aa373c64-2396-43e4-a49e-4310b6229efa tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:16:37.613600 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-aa373c64-2396-43e4-a49e-4310b6229efa tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:16:37.621496 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-aa373c64-2396-43e4-a49e-4310b6229efa tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:16:37.621941 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-aa373c64-2396-43e4-a49e-4310b6229efa tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:16:37.622738 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-aa373c64-2396-43e4-a49e-4310b6229efa tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:16:37.623160 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-aa373c64-2396-43e4-a49e-4310b6229efa tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:16:37.754976 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-aa373c64-2396-43e4-a49e-4310b6229efa tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:16:37.768541 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-aa373c64-2396-43e4-a49e-4310b6229efa tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1388 microversion: 2.1 time: 0.159533 Nov 23 13:16:37.769412 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 837/1667] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:16:37 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1388 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:16:38.791295 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-b8e79c4d-fec8-4686-bedc-19590b6577c2 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:16:38.791966 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-b8e79c4d-fec8-4686-bedc-19590b6577c2 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:16:38.799549 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b8e79c4d-fec8-4686-bedc-19590b6577c2 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:16:38.800005 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b8e79c4d-fec8-4686-bedc-19590b6577c2 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:16:38.800831 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b8e79c4d-fec8-4686-bedc-19590b6577c2 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:16:38.801266 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b8e79c4d-fec8-4686-bedc-19590b6577c2 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:16:38.922352 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-b8e79c4d-fec8-4686-bedc-19590b6577c2 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:16:38.935976 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-b8e79c4d-fec8-4686-bedc-19590b6577c2 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1388 microversion: 2.1 time: 0.151716 Nov 23 13:16:38.936805 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 831/1668] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:16:38 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1388 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:16:39.954058 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-cd2afa6b-c1ea-4f62-9e41-f7992af3bb00 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:16:39.954610 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-cd2afa6b-c1ea-4f62-9e41-f7992af3bb00 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:16:39.962362 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-cd2afa6b-c1ea-4f62-9e41-f7992af3bb00 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:16:39.962812 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-cd2afa6b-c1ea-4f62-9e41-f7992af3bb00 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:16:39.963560 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-cd2afa6b-c1ea-4f62-9e41-f7992af3bb00 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:16:39.963989 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-cd2afa6b-c1ea-4f62-9e41-f7992af3bb00 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:16:40.084330 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-cd2afa6b-c1ea-4f62-9e41-f7992af3bb00 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:16:40.093106 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-cd2afa6b-c1ea-4f62-9e41-f7992af3bb00 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1388 microversion: 2.1 time: 0.142842 Nov 23 13:16:40.093640 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 838/1669] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:16:39 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1388 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:16:41.117087 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-7ca54def-fc9c-406b-94ba-5ee81064dc1b tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:16:41.117733 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-7ca54def-fc9c-406b-94ba-5ee81064dc1b tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:16:41.130586 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-7ca54def-fc9c-406b-94ba-5ee81064dc1b tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:16:41.131053 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-7ca54def-fc9c-406b-94ba-5ee81064dc1b tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:16:41.131807 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-7ca54def-fc9c-406b-94ba-5ee81064dc1b tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:16:41.132278 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-7ca54def-fc9c-406b-94ba-5ee81064dc1b tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:16:41.246088 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-7ca54def-fc9c-406b-94ba-5ee81064dc1b tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:16:41.255000 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-7ca54def-fc9c-406b-94ba-5ee81064dc1b tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1388 microversion: 2.1 time: 0.145263 Nov 23 13:16:41.256961 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 832/1670] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:16:41 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1388 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:16:42.274662 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-eb03b10e-ff4c-4415-af2b-fc5fd6b1df2f tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:16:42.275296 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-eb03b10e-ff4c-4415-af2b-fc5fd6b1df2f tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:16:42.284220 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-eb03b10e-ff4c-4415-af2b-fc5fd6b1df2f tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:16:42.284703 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-eb03b10e-ff4c-4415-af2b-fc5fd6b1df2f tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:16:42.285473 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-eb03b10e-ff4c-4415-af2b-fc5fd6b1df2f tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:16:42.285902 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-eb03b10e-ff4c-4415-af2b-fc5fd6b1df2f tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:16:42.407954 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-eb03b10e-ff4c-4415-af2b-fc5fd6b1df2f tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:16:42.417481 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-eb03b10e-ff4c-4415-af2b-fc5fd6b1df2f tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1388 microversion: 2.1 time: 0.146882 Nov 23 13:16:42.418051 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 839/1671] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:16:42 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1388 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:16:43.438848 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-981a34c2-50be-471a-a054-46a69ca0ca51 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:16:43.439852 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-981a34c2-50be-471a-a054-46a69ca0ca51 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:16:43.449334 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-981a34c2-50be-471a-a054-46a69ca0ca51 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:16:43.449782 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-981a34c2-50be-471a-a054-46a69ca0ca51 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:16:43.450541 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-981a34c2-50be-471a-a054-46a69ca0ca51 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:16:43.450969 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-981a34c2-50be-471a-a054-46a69ca0ca51 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:16:43.569068 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-981a34c2-50be-471a-a054-46a69ca0ca51 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:16:43.582242 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-981a34c2-50be-471a-a054-46a69ca0ca51 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1388 microversion: 2.1 time: 0.149776 Nov 23 13:16:43.583461 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 833/1672] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:16:43 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1388 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:16:44.599989 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-5bf587a6-f6e2-4a56-8d63-b81e15c04e3e tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:16:44.600624 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-5bf587a6-f6e2-4a56-8d63-b81e15c04e3e tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:16:44.608529 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5bf587a6-f6e2-4a56-8d63-b81e15c04e3e tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:16:44.608981 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5bf587a6-f6e2-4a56-8d63-b81e15c04e3e tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:16:44.609743 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5bf587a6-f6e2-4a56-8d63-b81e15c04e3e tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:16:44.610171 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5bf587a6-f6e2-4a56-8d63-b81e15c04e3e tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:16:44.725392 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-5bf587a6-f6e2-4a56-8d63-b81e15c04e3e tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:16:44.734634 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-5bf587a6-f6e2-4a56-8d63-b81e15c04e3e tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1388 microversion: 2.1 time: 0.138603 Nov 23 13:16:44.735243 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 840/1673] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:16:44 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1388 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:16:45.756503 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-f2e3f2e4-1255-409e-9c07-be322deecc3c tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:16:45.757542 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-f2e3f2e4-1255-409e-9c07-be322deecc3c tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:16:45.769726 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f2e3f2e4-1255-409e-9c07-be322deecc3c tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:16:45.770482 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f2e3f2e4-1255-409e-9c07-be322deecc3c tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:16:45.771621 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f2e3f2e4-1255-409e-9c07-be322deecc3c tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:16:45.772058 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f2e3f2e4-1255-409e-9c07-be322deecc3c tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:16:45.888981 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-f2e3f2e4-1255-409e-9c07-be322deecc3c tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:16:45.897937 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-f2e3f2e4-1255-409e-9c07-be322deecc3c tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1388 microversion: 2.1 time: 0.147813 Nov 23 13:16:45.898610 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 834/1674] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:16:45 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1388 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:16:46.916935 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-7fbf6f17-5f02-4c9c-8003-85f1e0ba7d9f tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:16:46.917857 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-7fbf6f17-5f02-4c9c-8003-85f1e0ba7d9f tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:16:46.929930 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7fbf6f17-5f02-4c9c-8003-85f1e0ba7d9f tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:16:46.930621 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7fbf6f17-5f02-4c9c-8003-85f1e0ba7d9f tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:16:46.931850 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7fbf6f17-5f02-4c9c-8003-85f1e0ba7d9f tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:16:46.932665 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7fbf6f17-5f02-4c9c-8003-85f1e0ba7d9f tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:16:47.051654 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-7fbf6f17-5f02-4c9c-8003-85f1e0ba7d9f tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:16:47.060206 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-7fbf6f17-5f02-4c9c-8003-85f1e0ba7d9f tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1388 microversion: 2.1 time: 0.149073 Nov 23 13:16:47.060811 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 841/1675] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:16:46 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1388 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:16:48.081369 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-96def1fe-ab87-40f8-ac99-a066e6c4d413 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:16:48.082205 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-96def1fe-ab87-40f8-ac99-a066e6c4d413 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:16:48.090478 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-96def1fe-ab87-40f8-ac99-a066e6c4d413 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:16:48.090929 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-96def1fe-ab87-40f8-ac99-a066e6c4d413 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:16:48.091706 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-96def1fe-ab87-40f8-ac99-a066e6c4d413 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:16:48.092142 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-96def1fe-ab87-40f8-ac99-a066e6c4d413 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:16:48.207320 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-96def1fe-ab87-40f8-ac99-a066e6c4d413 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:16:48.216291 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-96def1fe-ab87-40f8-ac99-a066e6c4d413 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1388 microversion: 2.1 time: 0.141363 Nov 23 13:16:48.216823 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 835/1676] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:16:48 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1388 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:16:49.233384 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-bf31cf84-03c0-47b9-8f74-4274757397e0 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:16:49.233995 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-bf31cf84-03c0-47b9-8f74-4274757397e0 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:16:49.242629 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-bf31cf84-03c0-47b9-8f74-4274757397e0 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:16:49.243056 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-bf31cf84-03c0-47b9-8f74-4274757397e0 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:16:49.243865 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-bf31cf84-03c0-47b9-8f74-4274757397e0 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:16:49.244307 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-bf31cf84-03c0-47b9-8f74-4274757397e0 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:16:49.363585 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-bf31cf84-03c0-47b9-8f74-4274757397e0 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:16:49.377889 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-bf31cf84-03c0-47b9-8f74-4274757397e0 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1388 microversion: 2.1 time: 0.148154 Nov 23 13:16:49.378842 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 842/1677] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:16:49 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1388 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:16:50.395105 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-414d472d-3635-40db-acd1-773b73277674 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:16:50.395849 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-414d472d-3635-40db-acd1-773b73277674 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:16:50.403582 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-414d472d-3635-40db-acd1-773b73277674 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:16:50.404035 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-414d472d-3635-40db-acd1-773b73277674 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:16:50.404839 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-414d472d-3635-40db-acd1-773b73277674 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:16:50.405276 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-414d472d-3635-40db-acd1-773b73277674 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:16:50.611726 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-414d472d-3635-40db-acd1-773b73277674 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:16:50.627408 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-414d472d-3635-40db-acd1-773b73277674 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1388 microversion: 2.1 time: 0.235857 Nov 23 13:16:50.628341 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 836/1678] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:16:50 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1388 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:16:51.649426 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-8511ca2e-118d-4e30-b883-5c01cbb1ed0e tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:16:51.650388 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-8511ca2e-118d-4e30-b883-5c01cbb1ed0e tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:16:51.662505 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8511ca2e-118d-4e30-b883-5c01cbb1ed0e tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:16:51.662891 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8511ca2e-118d-4e30-b883-5c01cbb1ed0e tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:16:51.663656 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8511ca2e-118d-4e30-b883-5c01cbb1ed0e tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:16:51.664084 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8511ca2e-118d-4e30-b883-5c01cbb1ed0e tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:16:51.789050 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-8511ca2e-118d-4e30-b883-5c01cbb1ed0e tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:16:51.799252 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-8511ca2e-118d-4e30-b883-5c01cbb1ed0e tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1388 microversion: 2.1 time: 0.156262 Nov 23 13:16:51.808741 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 843/1679] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:16:51 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1388 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:16:52.816606 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-810602a2-578f-4b69-841a-6b90513ea49d tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:16:52.817207 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-810602a2-578f-4b69-841a-6b90513ea49d tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:16:52.825153 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-810602a2-578f-4b69-841a-6b90513ea49d tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:16:52.825603 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-810602a2-578f-4b69-841a-6b90513ea49d tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:16:52.826379 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-810602a2-578f-4b69-841a-6b90513ea49d tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:16:52.826809 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-810602a2-578f-4b69-841a-6b90513ea49d tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:16:52.948138 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-810602a2-578f-4b69-841a-6b90513ea49d tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:16:52.960887 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-810602a2-578f-4b69-841a-6b90513ea49d tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1388 microversion: 2.1 time: 0.147944 Nov 23 13:16:52.961657 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 837/1680] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:16:52 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1388 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:16:53.982225 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-e4314fcf-0024-40b0-86b6-57af109f9806 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:16:53.983116 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-e4314fcf-0024-40b0-86b6-57af109f9806 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:16:53.994775 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e4314fcf-0024-40b0-86b6-57af109f9806 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:16:53.995824 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e4314fcf-0024-40b0-86b6-57af109f9806 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:16:53.996073 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e4314fcf-0024-40b0-86b6-57af109f9806 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:16:53.996390 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e4314fcf-0024-40b0-86b6-57af109f9806 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:16:54.114556 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-e4314fcf-0024-40b0-86b6-57af109f9806 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:16:54.124446 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-e4314fcf-0024-40b0-86b6-57af109f9806 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1388 microversion: 2.1 time: 0.148891 Nov 23 13:16:54.124978 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 844/1681] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:16:53 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1388 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:16:55.141910 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-a681c237-0d9c-4f8b-83c2-13ab2142a1de tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:16:55.142607 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-a681c237-0d9c-4f8b-83c2-13ab2142a1de tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:16:55.150651 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a681c237-0d9c-4f8b-83c2-13ab2142a1de tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:16:55.151098 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a681c237-0d9c-4f8b-83c2-13ab2142a1de tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:16:55.151838 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a681c237-0d9c-4f8b-83c2-13ab2142a1de tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:16:55.152320 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a681c237-0d9c-4f8b-83c2-13ab2142a1de tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:16:55.277999 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-a681c237-0d9c-4f8b-83c2-13ab2142a1de tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:16:55.290434 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-a681c237-0d9c-4f8b-83c2-13ab2142a1de tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1388 microversion: 2.1 time: 0.152431 Nov 23 13:16:55.291013 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 838/1682] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:16:55 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1388 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:16:56.308075 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-59684db0-f81f-435b-acf5-b213251e3dae tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:16:56.308690 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-59684db0-f81f-435b-acf5-b213251e3dae tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:16:56.316549 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-59684db0-f81f-435b-acf5-b213251e3dae tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:16:56.316988 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-59684db0-f81f-435b-acf5-b213251e3dae tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:16:56.317750 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-59684db0-f81f-435b-acf5-b213251e3dae tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:16:56.318167 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-59684db0-f81f-435b-acf5-b213251e3dae tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:16:56.436680 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-59684db0-f81f-435b-acf5-b213251e3dae tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:16:56.449617 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-59684db0-f81f-435b-acf5-b213251e3dae tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1388 microversion: 2.1 time: 0.145087 Nov 23 13:16:56.450520 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 845/1683] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:16:56 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1388 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:16:57.468749 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-84c638f7-7c50-4dac-aa46-cf65f61aaca7 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:16:57.469359 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-84c638f7-7c50-4dac-aa46-cf65f61aaca7 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:16:57.477140 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-84c638f7-7c50-4dac-aa46-cf65f61aaca7 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:16:57.477591 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-84c638f7-7c50-4dac-aa46-cf65f61aaca7 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:16:57.478362 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-84c638f7-7c50-4dac-aa46-cf65f61aaca7 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:16:57.478795 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-84c638f7-7c50-4dac-aa46-cf65f61aaca7 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:16:57.594674 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-84c638f7-7c50-4dac-aa46-cf65f61aaca7 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:16:57.604871 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-84c638f7-7c50-4dac-aa46-cf65f61aaca7 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1388 microversion: 2.1 time: 0.139926 Nov 23 13:16:57.605444 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 839/1684] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:16:57 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1388 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:16:58.627175 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-ee54b934-331d-4a73-acc1-a8989cc76a92 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:16:58.628157 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-ee54b934-331d-4a73-acc1-a8989cc76a92 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:16:58.644459 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ee54b934-331d-4a73-acc1-a8989cc76a92 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:16:58.645268 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ee54b934-331d-4a73-acc1-a8989cc76a92 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:16:58.646592 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ee54b934-331d-4a73-acc1-a8989cc76a92 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:16:58.647472 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ee54b934-331d-4a73-acc1-a8989cc76a92 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:16:58.770910 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-ee54b934-331d-4a73-acc1-a8989cc76a92 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:16:58.780220 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-ee54b934-331d-4a73-acc1-a8989cc76a92 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1388 microversion: 2.1 time: 0.159710 Nov 23 13:16:58.780840 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 846/1685] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:16:58 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1388 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:16:59.802970 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-6d531725-396e-46bc-9a98-c94f0f4030e8 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:16:59.803644 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-6d531725-396e-46bc-9a98-c94f0f4030e8 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:16:59.812280 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6d531725-396e-46bc-9a98-c94f0f4030e8 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:16:59.812836 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6d531725-396e-46bc-9a98-c94f0f4030e8 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:16:59.813525 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6d531725-396e-46bc-9a98-c94f0f4030e8 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:16:59.814087 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6d531725-396e-46bc-9a98-c94f0f4030e8 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:16:59.931552 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-6d531725-396e-46bc-9a98-c94f0f4030e8 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:16:59.941021 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-6d531725-396e-46bc-9a98-c94f0f4030e8 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1388 microversion: 2.1 time: 0.146065 Nov 23 13:16:59.941590 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 840/1686] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:16:59 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1388 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:17:00.964849 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-41c52112-a102-495c-bd8e-885ed9454289 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:17:00.965937 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-41c52112-a102-495c-bd8e-885ed9454289 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:17:00.979389 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-41c52112-a102-495c-bd8e-885ed9454289 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:17:00.980044 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-41c52112-a102-495c-bd8e-885ed9454289 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:17:00.981301 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-41c52112-a102-495c-bd8e-885ed9454289 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:17:00.981983 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-41c52112-a102-495c-bd8e-885ed9454289 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:17:01.135979 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-41c52112-a102-495c-bd8e-885ed9454289 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:17:01.147317 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-41c52112-a102-495c-bd8e-885ed9454289 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1388 microversion: 2.1 time: 0.186520 Nov 23 13:17:01.148138 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 847/1687] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:17:00 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1388 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:17:02.176636 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-7c18a396-3da6-4f20-8e89-ca4cb46fabe5 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:17:02.177656 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-7c18a396-3da6-4f20-8e89-ca4cb46fabe5 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:17:02.186573 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-7c18a396-3da6-4f20-8e89-ca4cb46fabe5 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:17:02.187021 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-7c18a396-3da6-4f20-8e89-ca4cb46fabe5 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:17:02.187790 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-7c18a396-3da6-4f20-8e89-ca4cb46fabe5 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:17:02.188221 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-7c18a396-3da6-4f20-8e89-ca4cb46fabe5 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:17:02.309963 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-7c18a396-3da6-4f20-8e89-ca4cb46fabe5 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:17:02.323930 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-7c18a396-3da6-4f20-8e89-ca4cb46fabe5 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1388 microversion: 2.1 time: 0.153305 Nov 23 13:17:02.324805 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 841/1688] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:17:02 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1388 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:17:03.344930 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-e31f4a2b-3f5d-4a5a-9b79-7223ae4f8e17 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:17:03.345924 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-e31f4a2b-3f5d-4a5a-9b79-7223ae4f8e17 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:17:03.356727 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e31f4a2b-3f5d-4a5a-9b79-7223ae4f8e17 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:17:03.357168 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e31f4a2b-3f5d-4a5a-9b79-7223ae4f8e17 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:17:03.357947 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e31f4a2b-3f5d-4a5a-9b79-7223ae4f8e17 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:17:03.358371 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e31f4a2b-3f5d-4a5a-9b79-7223ae4f8e17 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:17:03.477088 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-e31f4a2b-3f5d-4a5a-9b79-7223ae4f8e17 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:17:03.485997 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-e31f4a2b-3f5d-4a5a-9b79-7223ae4f8e17 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1388 microversion: 2.1 time: 0.147294 Nov 23 13:17:03.486560 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 848/1689] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:17:03 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1388 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:17:04.507434 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-7a438c0c-c596-41f1-8803-f717268649c0 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:17:04.508537 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-7a438c0c-c596-41f1-8803-f717268649c0 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:17:04.521260 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-7a438c0c-c596-41f1-8803-f717268649c0 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:17:04.521897 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-7a438c0c-c596-41f1-8803-f717268649c0 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:17:04.523471 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-7a438c0c-c596-41f1-8803-f717268649c0 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:17:04.523979 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-7a438c0c-c596-41f1-8803-f717268649c0 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:17:04.645791 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-7a438c0c-c596-41f1-8803-f717268649c0 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:17:04.655043 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-7a438c0c-c596-41f1-8803-f717268649c0 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1388 microversion: 2.1 time: 0.154038 Nov 23 13:17:04.655611 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 842/1690] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:17:04 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1388 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:17:05.678365 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-47e9642e-6e80-41b5-b8a0-b1e2a84d44e8 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:17:05.680022 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-47e9642e-6e80-41b5-b8a0-b1e2a84d44e8 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:17:05.693537 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-47e9642e-6e80-41b5-b8a0-b1e2a84d44e8 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:17:05.694285 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-47e9642e-6e80-41b5-b8a0-b1e2a84d44e8 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:17:05.695628 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-47e9642e-6e80-41b5-b8a0-b1e2a84d44e8 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:17:05.696089 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-47e9642e-6e80-41b5-b8a0-b1e2a84d44e8 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:17:05.822563 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-47e9642e-6e80-41b5-b8a0-b1e2a84d44e8 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:17:05.833596 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-47e9642e-6e80-41b5-b8a0-b1e2a84d44e8 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1388 microversion: 2.1 time: 0.163713 Nov 23 13:17:05.842748 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 849/1691] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:17:05 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1388 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:17:06.855821 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-f2e0c868-2756-4ff7-b641-5ba910fdcbea tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:17:06.856461 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-f2e0c868-2756-4ff7-b641-5ba910fdcbea tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:17:06.864637 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f2e0c868-2756-4ff7-b641-5ba910fdcbea tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:17:06.865090 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f2e0c868-2756-4ff7-b641-5ba910fdcbea tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:17:06.865857 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f2e0c868-2756-4ff7-b641-5ba910fdcbea tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:17:06.866296 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f2e0c868-2756-4ff7-b641-5ba910fdcbea tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:17:06.990673 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-f2e0c868-2756-4ff7-b641-5ba910fdcbea tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:17:06.999903 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-f2e0c868-2756-4ff7-b641-5ba910fdcbea tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1388 microversion: 2.1 time: 0.147881 Nov 23 13:17:07.000594 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 843/1692] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:17:06 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1388 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:17:08.020861 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-a8a43c0c-667f-4fe8-b2f0-f299a07ea99c tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:17:08.021808 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-a8a43c0c-667f-4fe8-b2f0-f299a07ea99c tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:17:08.034458 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a8a43c0c-667f-4fe8-b2f0-f299a07ea99c tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:17:08.035196 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a8a43c0c-667f-4fe8-b2f0-f299a07ea99c tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:17:08.036504 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a8a43c0c-667f-4fe8-b2f0-f299a07ea99c tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:17:08.037206 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a8a43c0c-667f-4fe8-b2f0-f299a07ea99c tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:17:08.155082 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-a8a43c0c-667f-4fe8-b2f0-f299a07ea99c tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:17:08.163810 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-a8a43c0c-667f-4fe8-b2f0-f299a07ea99c tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1388 microversion: 2.1 time: 0.149287 Nov 23 13:17:08.164393 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 850/1693] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:17:08 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1388 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:17:09.187022 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-3ac49b68-e307-4336-933e-e90168c66af1 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:17:09.187651 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-3ac49b68-e307-4336-933e-e90168c66af1 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:17:09.195429 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-3ac49b68-e307-4336-933e-e90168c66af1 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:17:09.195880 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-3ac49b68-e307-4336-933e-e90168c66af1 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:17:09.196684 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-3ac49b68-e307-4336-933e-e90168c66af1 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:17:09.197261 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-3ac49b68-e307-4336-933e-e90168c66af1 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:17:09.309739 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-3ac49b68-e307-4336-933e-e90168c66af1 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:17:09.319667 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-3ac49b68-e307-4336-933e-e90168c66af1 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1388 microversion: 2.1 time: 0.136687 Nov 23 13:17:09.320261 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 844/1694] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:17:09 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1388 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:17:10.337155 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-3a5aab8e-5490-4fb2-903e-b1446913b704 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:17:10.337767 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-3a5aab8e-5490-4fb2-903e-b1446913b704 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:17:10.345543 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3a5aab8e-5490-4fb2-903e-b1446913b704 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:17:10.345998 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3a5aab8e-5490-4fb2-903e-b1446913b704 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:17:10.346762 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3a5aab8e-5490-4fb2-903e-b1446913b704 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:17:10.347195 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3a5aab8e-5490-4fb2-903e-b1446913b704 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:17:10.364146 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 13:17:10.369417 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: Tue Nov 23 13:17:10 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 (ip 10.222.0.60) !!! Nov 23 13:17:10.471798 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-3a5aab8e-5490-4fb2-903e-b1446913b704 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:17:10.485272 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-3a5aab8e-5490-4fb2-903e-b1446913b704 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1388 microversion: 2.1 time: 0.151853 Nov 23 13:17:10.486074 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 851/1695] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:17:10 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1388 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:17:11.510208 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-166e9553-7d03-4ea2-b4dc-8628d026b533 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:17:11.510981 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-166e9553-7d03-4ea2-b4dc-8628d026b533 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:17:11.519243 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-166e9553-7d03-4ea2-b4dc-8628d026b533 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:17:11.519694 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-166e9553-7d03-4ea2-b4dc-8628d026b533 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:17:11.520506 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-166e9553-7d03-4ea2-b4dc-8628d026b533 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:17:11.520936 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-166e9553-7d03-4ea2-b4dc-8628d026b533 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:17:11.642574 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-166e9553-7d03-4ea2-b4dc-8628d026b533 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:17:11.651740 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-166e9553-7d03-4ea2-b4dc-8628d026b533 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1388 microversion: 2.1 time: 0.147941 Nov 23 13:17:11.652373 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 845/1696] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:17:11 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1388 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:17:12.672538 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-69aded55-79cf-456e-aee6-1de9b863c0ba tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:17:12.673471 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-69aded55-79cf-456e-aee6-1de9b863c0ba tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:17:12.685074 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-69aded55-79cf-456e-aee6-1de9b863c0ba tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:17:12.685519 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-69aded55-79cf-456e-aee6-1de9b863c0ba tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:17:12.686277 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-69aded55-79cf-456e-aee6-1de9b863c0ba tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:17:12.686703 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-69aded55-79cf-456e-aee6-1de9b863c0ba tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:17:12.812498 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-69aded55-79cf-456e-aee6-1de9b863c0ba tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:17:12.815912 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-69aded55-79cf-456e-aee6-1de9b863c0ba tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1388 microversion: 2.1 time: 0.149554 Nov 23 13:17:12.816641 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 852/1697] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:17:12 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1388 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:17:13.832797 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-7e441c28-f43b-42ba-af4b-bbf9f6eb8afd tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:17:13.833389 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-7e441c28-f43b-42ba-af4b-bbf9f6eb8afd tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:17:13.841337 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-7e441c28-f43b-42ba-af4b-bbf9f6eb8afd tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:17:13.841768 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-7e441c28-f43b-42ba-af4b-bbf9f6eb8afd tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:17:13.842521 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-7e441c28-f43b-42ba-af4b-bbf9f6eb8afd tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:17:13.843177 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-7e441c28-f43b-42ba-af4b-bbf9f6eb8afd tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:17:13.963197 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-7e441c28-f43b-42ba-af4b-bbf9f6eb8afd tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:17:13.977807 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-7e441c28-f43b-42ba-af4b-bbf9f6eb8afd tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1388 microversion: 2.1 time: 0.148680 Nov 23 13:17:13.978704 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 846/1698] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:17:13 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1388 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:17:14.996915 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-fc726062-b5f8-41ed-a099-1ab7c16e7c19 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:17:14.997516 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-fc726062-b5f8-41ed-a099-1ab7c16e7c19 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:17:15.005138 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-fc726062-b5f8-41ed-a099-1ab7c16e7c19 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:17:15.005580 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-fc726062-b5f8-41ed-a099-1ab7c16e7c19 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:17:15.006358 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-fc726062-b5f8-41ed-a099-1ab7c16e7c19 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:17:15.006757 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-fc726062-b5f8-41ed-a099-1ab7c16e7c19 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:17:15.133774 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-fc726062-b5f8-41ed-a099-1ab7c16e7c19 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:17:15.147625 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-fc726062-b5f8-41ed-a099-1ab7c16e7c19 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1388 microversion: 2.1 time: 0.154867 Nov 23 13:17:15.148574 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 853/1699] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:17:14 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1388 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:17:16.166570 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-3b956527-abcc-4c66-a638-a17c330421de tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:17:16.167205 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-3b956527-abcc-4c66-a638-a17c330421de tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:17:16.175557 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-3b956527-abcc-4c66-a638-a17c330421de tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:17:16.176175 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-3b956527-abcc-4c66-a638-a17c330421de tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:17:16.176869 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-3b956527-abcc-4c66-a638-a17c330421de tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:17:16.177296 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-3b956527-abcc-4c66-a638-a17c330421de tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:17:16.292027 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-3b956527-abcc-4c66-a638-a17c330421de tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:17:16.300981 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-3b956527-abcc-4c66-a638-a17c330421de tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1388 microversion: 2.1 time: 0.138405 Nov 23 13:17:16.301549 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 847/1700] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:17:16 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1388 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:17:17.318693 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-39320780-f64a-49fb-ac2a-e6f8f2518d40 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:17:17.319451 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-39320780-f64a-49fb-ac2a-e6f8f2518d40 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:17:17.328717 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-39320780-f64a-49fb-ac2a-e6f8f2518d40 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:17:17.329390 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-39320780-f64a-49fb-ac2a-e6f8f2518d40 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:17:17.330192 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-39320780-f64a-49fb-ac2a-e6f8f2518d40 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:17:17.330671 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-39320780-f64a-49fb-ac2a-e6f8f2518d40 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:17:17.449805 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-39320780-f64a-49fb-ac2a-e6f8f2518d40 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:17:17.458631 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-39320780-f64a-49fb-ac2a-e6f8f2518d40 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1388 microversion: 2.1 time: 0.144396 Nov 23 13:17:17.459187 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 854/1701] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:17:17 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1388 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:17:18.480765 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-d3c7bc45-06c2-4229-b4d0-cd7f337081b1 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:17:18.482131 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-d3c7bc45-06c2-4229-b4d0-cd7f337081b1 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:17:18.493474 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d3c7bc45-06c2-4229-b4d0-cd7f337081b1 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:17:18.494192 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d3c7bc45-06c2-4229-b4d0-cd7f337081b1 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:17:18.495461 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d3c7bc45-06c2-4229-b4d0-cd7f337081b1 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:17:18.496194 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d3c7bc45-06c2-4229-b4d0-cd7f337081b1 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:17:18.631115 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-d3c7bc45-06c2-4229-b4d0-cd7f337081b1 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:17:18.640707 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-d3c7bc45-06c2-4229-b4d0-cd7f337081b1 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1388 microversion: 2.1 time: 0.166587 Nov 23 13:17:18.641473 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 848/1702] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:17:18 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1388 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:17:19.659806 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-9e5f5576-59d2-449a-aba3-3b2948a85f83 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:17:19.660419 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-9e5f5576-59d2-449a-aba3-3b2948a85f83 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:17:19.668503 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-9e5f5576-59d2-449a-aba3-3b2948a85f83 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:17:19.668926 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-9e5f5576-59d2-449a-aba3-3b2948a85f83 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:17:19.669717 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-9e5f5576-59d2-449a-aba3-3b2948a85f83 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:17:19.670176 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-9e5f5576-59d2-449a-aba3-3b2948a85f83 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:17:19.784705 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-9e5f5576-59d2-449a-aba3-3b2948a85f83 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:17:19.793736 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-9e5f5576-59d2-449a-aba3-3b2948a85f83 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1388 microversion: 2.1 time: 0.139578 Nov 23 13:17:19.794673 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 855/1703] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:17:19 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1388 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:17:20.811913 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-1e65b41b-aae5-4d5e-a77b-fcac8ae2e1a1 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:17:20.812541 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-1e65b41b-aae5-4d5e-a77b-fcac8ae2e1a1 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:17:20.820156 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-1e65b41b-aae5-4d5e-a77b-fcac8ae2e1a1 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:17:20.820632 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-1e65b41b-aae5-4d5e-a77b-fcac8ae2e1a1 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:17:20.821391 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-1e65b41b-aae5-4d5e-a77b-fcac8ae2e1a1 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:17:20.821805 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-1e65b41b-aae5-4d5e-a77b-fcac8ae2e1a1 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:17:20.949652 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-1e65b41b-aae5-4d5e-a77b-fcac8ae2e1a1 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:17:20.963227 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-1e65b41b-aae5-4d5e-a77b-fcac8ae2e1a1 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1388 microversion: 2.1 time: 0.155388 Nov 23 13:17:20.963959 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 849/1704] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:17:20 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1388 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:17:21.983141 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-53d2779e-0507-4e20-94b2-ce3cbc7707d4 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:17:21.983932 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-53d2779e-0507-4e20-94b2-ce3cbc7707d4 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:17:21.992671 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-53d2779e-0507-4e20-94b2-ce3cbc7707d4 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:17:21.993119 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-53d2779e-0507-4e20-94b2-ce3cbc7707d4 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:17:21.993959 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-53d2779e-0507-4e20-94b2-ce3cbc7707d4 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:17:21.994412 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-53d2779e-0507-4e20-94b2-ce3cbc7707d4 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:17:22.116895 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-53d2779e-0507-4e20-94b2-ce3cbc7707d4 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:17:22.130257 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-53d2779e-0507-4e20-94b2-ce3cbc7707d4 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1388 microversion: 2.1 time: 0.150703 Nov 23 13:17:22.130989 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 856/1705] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:17:21 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1388 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:17:23.152697 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-83010add-c3bf-4c52-8076-3e3b3828db39 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:17:23.153335 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-83010add-c3bf-4c52-8076-3e3b3828db39 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:17:23.160710 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-83010add-c3bf-4c52-8076-3e3b3828db39 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:17:23.161130 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-83010add-c3bf-4c52-8076-3e3b3828db39 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:17:23.161929 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-83010add-c3bf-4c52-8076-3e3b3828db39 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:17:23.162356 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-83010add-c3bf-4c52-8076-3e3b3828db39 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:17:23.276498 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-83010add-c3bf-4c52-8076-3e3b3828db39 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:17:23.287808 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-83010add-c3bf-4c52-8076-3e3b3828db39 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1388 microversion: 2.1 time: 0.140905 Nov 23 13:17:23.288677 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 850/1706] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:17:23 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1388 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:17:24.308874 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-3410d1bc-9306-498e-a6ea-905b176384da tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:17:24.309944 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-3410d1bc-9306-498e-a6ea-905b176384da tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:17:24.322250 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3410d1bc-9306-498e-a6ea-905b176384da tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:17:24.322912 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3410d1bc-9306-498e-a6ea-905b176384da tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:17:24.324087 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3410d1bc-9306-498e-a6ea-905b176384da tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:17:24.324844 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3410d1bc-9306-498e-a6ea-905b176384da tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:17:24.447487 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-3410d1bc-9306-498e-a6ea-905b176384da tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:17:24.457506 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-3410d1bc-9306-498e-a6ea-905b176384da tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1388 microversion: 2.1 time: 0.154855 Nov 23 13:17:24.458171 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 857/1707] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:17:24 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1388 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:17:25.474522 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-dff675bc-b6b2-419e-9b01-6d91faa1ee41 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:17:25.475131 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-dff675bc-b6b2-419e-9b01-6d91faa1ee41 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:17:25.483470 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-dff675bc-b6b2-419e-9b01-6d91faa1ee41 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:17:25.483943 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-dff675bc-b6b2-419e-9b01-6d91faa1ee41 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:17:25.484731 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-dff675bc-b6b2-419e-9b01-6d91faa1ee41 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:17:25.485237 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-dff675bc-b6b2-419e-9b01-6d91faa1ee41 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:17:25.602864 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-dff675bc-b6b2-419e-9b01-6d91faa1ee41 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:17:25.617824 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-dff675bc-b6b2-419e-9b01-6d91faa1ee41 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1388 microversion: 2.1 time: 0.146846 Nov 23 13:17:25.618677 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 851/1708] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:17:25 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1388 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:17:26.635149 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-1c12bbb6-936e-49cd-a845-de294f8bcae0 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:17:26.635768 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-1c12bbb6-936e-49cd-a845-de294f8bcae0 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:17:26.643622 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1c12bbb6-936e-49cd-a845-de294f8bcae0 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:17:26.644000 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1c12bbb6-936e-49cd-a845-de294f8bcae0 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:17:26.644850 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1c12bbb6-936e-49cd-a845-de294f8bcae0 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:17:26.645278 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1c12bbb6-936e-49cd-a845-de294f8bcae0 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:17:26.716023 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1c12bbb6-936e-49cd-a845-de294f8bcae0 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:17:26.716479 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1c12bbb6-936e-49cd-a845-de294f8bcae0 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:17:26.716931 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.objects.instance [None req-1c12bbb6-936e-49cd-a845-de294f8bcae0 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lazy-loading 'fault' on Instance uuid 74e06412-022d-4ece-920d-1cba08639d76 {{(pid=100974) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 23 13:17:26.789365 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-1c12bbb6-936e-49cd-a845-de294f8bcae0 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10dad24cdfa4e128b19e01548066a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13128fc1ba014300bfb802722969331f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:17:26.806058 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-1c12bbb6-936e-49cd-a845-de294f8bcae0 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 200 len: 1482 microversion: 2.1 time: 0.174726 Nov 23 13:17:26.813168 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 858/1709] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:17:26 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 1482 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:17:27.833835 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-2918fc87-9e82-4a01-ab17-4cb4fbd2a75a tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:17:27.834480 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-2918fc87-9e82-4a01-ab17-4cb4fbd2a75a tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] [instance: 74e06412-022d-4ece-920d-1cba08639d76] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:17:27.842402 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-2918fc87-9e82-4a01-ab17-4cb4fbd2a75a tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:17:27.842852 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-2918fc87-9e82-4a01-ab17-4cb4fbd2a75a tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:17:27.843623 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-2918fc87-9e82-4a01-ab17-4cb4fbd2a75a tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:17:27.844049 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-2918fc87-9e82-4a01-ab17-4cb4fbd2a75a tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:17:27.924003 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.wsgi [None req-2918fc87-9e82-4a01-ab17-4cb4fbd2a75a tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] HTTP exception thrown: Instance 74e06412-022d-4ece-920d-1cba08639d76 could not be found. Nov 23 13:17:27.925101 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-2918fc87-9e82-4a01-ab17-4cb4fbd2a75a tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Returning 404 to user: Instance 74e06412-022d-4ece-920d-1cba08639d76 could not be found. {{(pid=100973) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Nov 23 13:17:27.926435 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-2918fc87-9e82-4a01-ab17-4cb4fbd2a75a tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76" status: 404 len: 111 microversion: 2.1 time: 0.098344 Nov 23 13:17:27.927357 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 852/1710] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:17:27 2021] GET /compute/v2.1/servers/74e06412-022d-4ece-920d-1cba08639d76 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 13:17:27.937732 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-2f3d5286-3022-4965-9340-d3587237e543 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] Calling method '.version_select at 0x7f18704e6790>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:17:27.959216 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-2f3d5286-3022-4965-9340-d3587237e543 tempest-TestMinimumBasicScenario-2033036040 tempest-TestMinimumBasicScenario-2033036040-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1807990828" status: 202 len: 0 microversion: 2.1 time: 0.025483 Nov 23 13:17:27.959846 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 859/1711] 10.222.0.60 () {58 vars in 1271 bytes} [Tue Nov 23 13:17:27 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1807990828 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:17:47.932762 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 13:17:47.934537 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: Tue Nov 23 13:17:47 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 23 13:17:48.558488 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 13:17:48.559034 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: Tue Nov 23 13:17:48 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 23 13:18:05.268627 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 13:18:05.269293 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: Tue Nov 23 13:18:05 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 23 13:18:08.275402 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-1cf1fae6-beab-4603-9f33-f92567b7dbb4 tempest-TestVolumeBootPattern-744547849 tempest-TestVolumeBootPattern-744547849-project] Calling method '.version_select at 0x7f18703ac9d0>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:18:08.302235 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-1cf1fae6-beab-4603-9f33-f92567b7dbb4 tempest-TestVolumeBootPattern-744547849 tempest-TestVolumeBootPattern-744547849-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2045982548" status: 202 len: 0 microversion: 2.1 time: 0.030972 Nov 23 13:18:08.302912 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 853/1712] 10.222.0.60 () {58 vars in 1262 bytes} [Tue Nov 23 13:18:08 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2045982548 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:18:12.210226 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 13:18:12.211082 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: Tue Nov 23 13:18:12 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 23 13:18:33.031922 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a7b7a666-a1ad-48b3-bbff-ac4178364592] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 23 13:18:33.035405 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-ab490fa4-2e61-4656-afca-04f55124eab6 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:18:33.035908 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-ab490fa4-2e61-4656-afca-04f55124eab6 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:18:33.044879 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ab490fa4-2e61-4656-afca-04f55124eab6 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:18:33.045336 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ab490fa4-2e61-4656-afca-04f55124eab6 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:18:33.046144 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ab490fa4-2e61-4656-afca-04f55124eab6 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:18:33.046555 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ab490fa4-2e61-4656-afca-04f55124eab6 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:18:33.114256 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-ab490fa4-2e61-4656-afca-04f55124eab6 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Going to try to terminate instance {{(pid=100974) delete /opt/stack/nova/nova/compute/api.py:2562}} Nov 23 13:18:33.245604 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-ab490fa4-2e61-4656-afca-04f55124eab6 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "DELETE /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 204 len: 0 microversion: 2.20 time: 0.214842 Nov 23 13:18:33.246270 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 860/1713] 10.222.0.60 () {60 vars in 1279 bytes} [Tue Nov 23 13:18:33 2021] DELETE /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 23 13:18:33.255055 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-6dfeb135-0881-4592-995c-380c128503ae tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:18:33.255694 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-6dfeb135-0881-4592-995c-380c128503ae tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:18:33.263594 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6dfeb135-0881-4592-995c-380c128503ae tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:18:33.264042 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6dfeb135-0881-4592-995c-380c128503ae tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:18:33.264856 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6dfeb135-0881-4592-995c-380c128503ae tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:18:33.265290 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6dfeb135-0881-4592-995c-380c128503ae tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:18:33.481931 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-6dfeb135-0881-4592-995c-380c128503ae tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:18:33.492707 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-6dfeb135-0881-4592-995c-380c128503ae tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:18:33.496567 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-6dfeb135-0881-4592-995c-380c128503ae tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:18:33.496567 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-6dfeb135-0881-4592-995c-380c128503ae tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1801 microversion: 2.20 time: 0.245001 Nov 23 13:18:33.497246 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 854/1714] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:18:33 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1801 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:18:33.509966 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-1e29d628-d6a3-4f7f-a176-3c52a5c929ae tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:18:33.510711 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-1e29d628-d6a3-4f7f-a176-3c52a5c929ae tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] [instance: f6d81116-5b48-433f-8c7e-88f2a9687167] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:18:33.518403 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1e29d628-d6a3-4f7f-a176-3c52a5c929ae tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:18:33.518845 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1e29d628-d6a3-4f7f-a176-3c52a5c929ae tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:18:33.519628 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1e29d628-d6a3-4f7f-a176-3c52a5c929ae tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:18:33.520058 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1e29d628-d6a3-4f7f-a176-3c52a5c929ae tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:18:33.583223 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-1e29d628-d6a3-4f7f-a176-3c52a5c929ae tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] [instance: f6d81116-5b48-433f-8c7e-88f2a9687167] Going to try to terminate instance {{(pid=100974) delete /opt/stack/nova/nova/compute/api.py:2562}} Nov 23 13:18:33.701979 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-1e29d628-d6a3-4f7f-a176-3c52a5c929ae tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] 10.222.0.60 "DELETE /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167" status: 204 len: 0 microversion: 2.1 time: 0.195797 Nov 23 13:18:33.702587 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 861/1715] 10.222.0.60 () {58 vars in 1238 bytes} [Tue Nov 23 13:18:33 2021] DELETE /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 23 13:18:33.711678 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-ff0301ee-74a0-468c-af5a-44c623174218 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:18:33.712298 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-ff0301ee-74a0-468c-af5a-44c623174218 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] [instance: f6d81116-5b48-433f-8c7e-88f2a9687167] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:18:33.720081 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ff0301ee-74a0-468c-af5a-44c623174218 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:18:33.720556 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ff0301ee-74a0-468c-af5a-44c623174218 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:18:33.721333 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ff0301ee-74a0-468c-af5a-44c623174218 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:18:33.721762 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ff0301ee-74a0-468c-af5a-44c623174218 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:18:33.933605 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-ff0301ee-74a0-468c-af5a-44c623174218 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb8e090f8ae4a2381c9b82a8090f112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90112b6f3d31421a8ee18cbe7d6b0537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:18:33.942964 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-ff0301ee-74a0-468c-af5a-44c623174218 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] 10.222.0.60 "GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167" status: 200 len: 1560 microversion: 2.1 time: 0.235820 Nov 23 13:18:33.943546 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 855/1716] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:18:33 2021] GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167 => generated 1560 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:18:34.519696 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-cce7ba01-6019-40b2-82c3-a8b6b2754a76 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:18:34.520552 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-cce7ba01-6019-40b2-82c3-a8b6b2754a76 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:18:34.541266 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-cce7ba01-6019-40b2-82c3-a8b6b2754a76 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:18:34.541702 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-cce7ba01-6019-40b2-82c3-a8b6b2754a76 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:18:34.542945 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-cce7ba01-6019-40b2-82c3-a8b6b2754a76 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:18:34.542945 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-cce7ba01-6019-40b2-82c3-a8b6b2754a76 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:18:34.584920 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO oslo.messaging._drivers.impl_rabbit [-] [a7b7a666-a1ad-48b3-bbff-ac4178364592] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 51672. Nov 23 13:18:34.961216 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-d9c8c2cf-6324-46b0-83be-b0cd7f12e2ab tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:18:34.961857 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-d9c8c2cf-6324-46b0-83be-b0cd7f12e2ab tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] [instance: f6d81116-5b48-433f-8c7e-88f2a9687167] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:18:34.969578 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d9c8c2cf-6324-46b0-83be-b0cd7f12e2ab tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:18:34.970038 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d9c8c2cf-6324-46b0-83be-b0cd7f12e2ab tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:18:34.970828 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d9c8c2cf-6324-46b0-83be-b0cd7f12e2ab tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:18:34.971252 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d9c8c2cf-6324-46b0-83be-b0cd7f12e2ab tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:18:35.043774 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-cce7ba01-6019-40b2-82c3-a8b6b2754a76 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:18:35.055577 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-cce7ba01-6019-40b2-82c3-a8b6b2754a76 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:18:35.057541 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-cce7ba01-6019-40b2-82c3-a8b6b2754a76 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:18:35.058749 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-cce7ba01-6019-40b2-82c3-a8b6b2754a76 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1801 microversion: 2.20 time: 0.543478 Nov 23 13:18:35.059535 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 862/1717] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:18:34 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1801 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:18:35.195760 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-d9c8c2cf-6324-46b0-83be-b0cd7f12e2ab tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb8e090f8ae4a2381c9b82a8090f112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90112b6f3d31421a8ee18cbe7d6b0537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:18:35.207005 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-d9c8c2cf-6324-46b0-83be-b0cd7f12e2ab tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] 10.222.0.60 "GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167" status: 200 len: 1560 microversion: 2.1 time: 0.248806 Nov 23 13:18:35.207287 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 856/1718] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:18:34 2021] GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167 => generated 1560 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 13:18:36.079618 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-a35944e0-984d-4550-9e20-e2b43005ff83 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:18:36.080408 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-a35944e0-984d-4550-9e20-e2b43005ff83 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:18:36.088744 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a35944e0-984d-4550-9e20-e2b43005ff83 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:18:36.089501 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a35944e0-984d-4550-9e20-e2b43005ff83 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:18:36.090276 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a35944e0-984d-4550-9e20-e2b43005ff83 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:18:36.090697 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a35944e0-984d-4550-9e20-e2b43005ff83 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:18:36.224385 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-dddb60a5-b039-45b5-b53e-6b990fd71e4d tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:18:36.225031 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-dddb60a5-b039-45b5-b53e-6b990fd71e4d tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] [instance: f6d81116-5b48-433f-8c7e-88f2a9687167] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:18:36.233274 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-dddb60a5-b039-45b5-b53e-6b990fd71e4d tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:18:36.233711 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-dddb60a5-b039-45b5-b53e-6b990fd71e4d tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:18:36.234543 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-dddb60a5-b039-45b5-b53e-6b990fd71e4d tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:18:36.234954 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-dddb60a5-b039-45b5-b53e-6b990fd71e4d tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:18:36.318932 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-a35944e0-984d-4550-9e20-e2b43005ff83 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:18:36.338920 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-a35944e0-984d-4550-9e20-e2b43005ff83 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:18:36.340733 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-a35944e0-984d-4550-9e20-e2b43005ff83 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:18:36.341901 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-a35944e0-984d-4550-9e20-e2b43005ff83 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1733 microversion: 2.20 time: 0.266241 Nov 23 13:18:36.342466 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 863/1719] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:18:36 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1733 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:18:36.469386 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-dddb60a5-b039-45b5-b53e-6b990fd71e4d tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb8e090f8ae4a2381c9b82a8090f112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90112b6f3d31421a8ee18cbe7d6b0537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:18:36.480042 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-dddb60a5-b039-45b5-b53e-6b990fd71e4d tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] 10.222.0.60 "GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167" status: 200 len: 1560 microversion: 2.1 time: 0.259542 Nov 23 13:18:36.480651 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 857/1720] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:18:36 2021] GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167 => generated 1560 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:18:36.950995 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [req-552fe9e1-52d5-4c97-b038-e9894123747f req-b2c87205-eb9e-44af-a792-dcbc20a3b046 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9c21729-a176-4e26-9074-f5f0bfc0ce20", "name": "network-vif-deleted", "tag": "acc6c8bf-82a2-4f88-b12e-f6a39d6ce970"}]} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:18:36.952983 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 13:18:36.952983 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: warnings.warn(msg) Nov 23 13:18:36.963733 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [req-552fe9e1-52d5-4c97-b038-e9894123747f req-b2c87205-eb9e-44af-a792-dcbc20a3b046 service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:18:36.964483 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [req-552fe9e1-52d5-4c97-b038-e9894123747f req-b2c87205-eb9e-44af-a792-dcbc20a3b046 service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:18:36.982699 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.compute.server_external_events [req-552fe9e1-52d5-4c97-b038-e9894123747f req-b2c87205-eb9e-44af-a792-dcbc20a3b046 service nova] Creating event network-vif-deleted:acc6c8bf-82a2-4f88-b12e-f6a39d6ce970 for instance b9c21729-a176-4e26-9074-f5f0bfc0ce20 on hv-cinder-81888 Nov 23 13:18:36.988340 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [req-552fe9e1-52d5-4c97-b038-e9894123747f req-b2c87205-eb9e-44af-a792-dcbc20a3b046 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.285048 Nov 23 13:18:36.989216 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 864/1721] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Nov 23 13:18:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 13:18:37.362320 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-d6f99bb1-0bba-4152-a057-ff44ea8c2920 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:18:37.362993 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-d6f99bb1-0bba-4152-a057-ff44ea8c2920 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:18:37.372735 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d6f99bb1-0bba-4152-a057-ff44ea8c2920 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:18:37.373167 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d6f99bb1-0bba-4152-a057-ff44ea8c2920 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:18:37.373943 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d6f99bb1-0bba-4152-a057-ff44ea8c2920 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:18:37.374363 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d6f99bb1-0bba-4152-a057-ff44ea8c2920 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:18:37.499261 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-67f87934-1bcc-4001-b20c-40a9d2f17a2e tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:18:37.499953 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-67f87934-1bcc-4001-b20c-40a9d2f17a2e tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] [instance: f6d81116-5b48-433f-8c7e-88f2a9687167] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:18:37.518394 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-67f87934-1bcc-4001-b20c-40a9d2f17a2e tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:18:37.519180 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-67f87934-1bcc-4001-b20c-40a9d2f17a2e tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:18:37.520172 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-67f87934-1bcc-4001-b20c-40a9d2f17a2e tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:18:37.520795 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-67f87934-1bcc-4001-b20c-40a9d2f17a2e tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:18:37.613328 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-d6f99bb1-0bba-4152-a057-ff44ea8c2920 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:18:37.623769 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-d6f99bb1-0bba-4152-a057-ff44ea8c2920 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:18:37.625414 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-d6f99bb1-0bba-4152-a057-ff44ea8c2920 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:18:37.626685 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-d6f99bb1-0bba-4152-a057-ff44ea8c2920 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1443 microversion: 2.20 time: 0.268578 Nov 23 13:18:37.627478 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 858/1722] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:18:37 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1443 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:18:37.668496 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-67f87934-1bcc-4001-b20c-40a9d2f17a2e tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb8e090f8ae4a2381c9b82a8090f112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90112b6f3d31421a8ee18cbe7d6b0537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:18:37.677969 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-67f87934-1bcc-4001-b20c-40a9d2f17a2e tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] 10.222.0.60 "GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167" status: 200 len: 1350 microversion: 2.1 time: 0.182772 Nov 23 13:18:37.679089 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 865/1723] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:18:37 2021] GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167 => generated 1350 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 13:18:38.647673 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-206ba179-f743-468c-97a3-1a8047ad23bb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:18:38.648385 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-206ba179-f743-468c-97a3-1a8047ad23bb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:18:38.651574 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8c3a1481-9693-4499-8478-a55e09a5b02f] AMQP server on 10.222.0.60:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 23 13:18:38.656976 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-206ba179-f743-468c-97a3-1a8047ad23bb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:18:38.657412 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-206ba179-f743-468c-97a3-1a8047ad23bb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:18:38.658176 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-206ba179-f743-468c-97a3-1a8047ad23bb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:18:38.658602 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-206ba179-f743-468c-97a3-1a8047ad23bb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:18:38.696939 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-19f04366-9395-4023-8c73-49b57a725550 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:18:38.697707 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-19f04366-9395-4023-8c73-49b57a725550 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] [instance: f6d81116-5b48-433f-8c7e-88f2a9687167] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:18:38.705705 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-19f04366-9395-4023-8c73-49b57a725550 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:18:38.706215 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-19f04366-9395-4023-8c73-49b57a725550 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:18:38.706908 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-19f04366-9395-4023-8c73-49b57a725550 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:18:38.707338 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-19f04366-9395-4023-8c73-49b57a725550 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:18:38.791179 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-206ba179-f743-468c-97a3-1a8047ad23bb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:18:38.801694 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-206ba179-f743-468c-97a3-1a8047ad23bb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:18:38.805350 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-206ba179-f743-468c-97a3-1a8047ad23bb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:18:38.805350 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-206ba179-f743-468c-97a3-1a8047ad23bb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1443 microversion: 2.20 time: 0.161228 Nov 23 13:18:38.805821 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 859/1724] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:18:38 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1443 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:18:38.831250 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-19f04366-9395-4023-8c73-49b57a725550 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb8e090f8ae4a2381c9b82a8090f112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90112b6f3d31421a8ee18cbe7d6b0537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:18:38.841444 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-19f04366-9395-4023-8c73-49b57a725550 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] 10.222.0.60 "GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167" status: 200 len: 1350 microversion: 2.1 time: 0.148425 Nov 23 13:18:38.842033 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 866/1725] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:18:38 2021] GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167 => generated 1350 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:18:39.003464 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [req-b916c5a4-8bef-47a7-81bf-5a0e34079718 req-6c025e15-ae30-4a69-87b1-f01c71e04951 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6d81116-5b48-433f-8c7e-88f2a9687167", "name": "network-vif-deleted", "tag": "387ca8eb-21e0-4037-8ccb-e97d8f90b3e2"}]} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:18:39.005079 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 13:18:39.005079 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: warnings.warn(msg) Nov 23 13:18:39.014446 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [req-b916c5a4-8bef-47a7-81bf-5a0e34079718 req-6c025e15-ae30-4a69-87b1-f01c71e04951 service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:18:39.014867 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [req-b916c5a4-8bef-47a7-81bf-5a0e34079718 req-6c025e15-ae30-4a69-87b1-f01c71e04951 service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:18:39.032059 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.compute.server_external_events [req-b916c5a4-8bef-47a7-81bf-5a0e34079718 req-6c025e15-ae30-4a69-87b1-f01c71e04951 service nova] Creating event network-vif-deleted:387ca8eb-21e0-4037-8ccb-e97d8f90b3e2 for instance f6d81116-5b48-433f-8c7e-88f2a9687167 on hv-cinder-81888 Nov 23 13:18:39.038859 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [req-b916c5a4-8bef-47a7-81bf-5a0e34079718 req-6c025e15-ae30-4a69-87b1-f01c71e04951 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038902 Nov 23 13:18:39.039453 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 860/1726] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Nov 23 13:18:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 13:18:39.823988 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-d6fa3803-7ef3-41e5-993d-ec19aa4d2413 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:18:39.824674 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-d6fa3803-7ef3-41e5-993d-ec19aa4d2413 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:18:39.832367 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d6fa3803-7ef3-41e5-993d-ec19aa4d2413 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:18:39.832817 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d6fa3803-7ef3-41e5-993d-ec19aa4d2413 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:18:39.833595 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d6fa3803-7ef3-41e5-993d-ec19aa4d2413 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:18:39.834022 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d6fa3803-7ef3-41e5-993d-ec19aa4d2413 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:18:39.870259 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-ba9075d2-6a89-43ef-98f9-8647c6e41e8f tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:18:39.871166 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-ba9075d2-6a89-43ef-98f9-8647c6e41e8f tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] [instance: f6d81116-5b48-433f-8c7e-88f2a9687167] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:18:39.879964 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ba9075d2-6a89-43ef-98f9-8647c6e41e8f tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:18:39.880521 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ba9075d2-6a89-43ef-98f9-8647c6e41e8f tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:18:39.881479 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ba9075d2-6a89-43ef-98f9-8647c6e41e8f tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:18:39.881994 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ba9075d2-6a89-43ef-98f9-8647c6e41e8f tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:18:39.917065 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO oslo.messaging._drivers.impl_rabbit [-] [8c3a1481-9693-4499-8478-a55e09a5b02f] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 51700. Nov 23 13:18:39.989002 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-d6fa3803-7ef3-41e5-993d-ec19aa4d2413 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:18:39.999808 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-d6fa3803-7ef3-41e5-993d-ec19aa4d2413 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:18:40.001853 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-d6fa3803-7ef3-41e5-993d-ec19aa4d2413 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:18:40.002589 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-ba9075d2-6a89-43ef-98f9-8647c6e41e8f tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb8e090f8ae4a2381c9b82a8090f112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90112b6f3d31421a8ee18cbe7d6b0537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:18:40.003041 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-d6fa3803-7ef3-41e5-993d-ec19aa4d2413 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1443 microversion: 2.20 time: 0.183239 Nov 23 13:18:40.003649 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 867/1727] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:18:39 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1443 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:18:40.012657 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-ba9075d2-6a89-43ef-98f9-8647c6e41e8f tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] 10.222.0.60 "GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167" status: 200 len: 1350 microversion: 2.1 time: 0.157126 Nov 23 13:18:40.014201 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 861/1728] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:18:39 2021] GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167 => generated 1350 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:18:41.023387 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-fa742fa6-3e03-4d1c-bd74-f0c5b18f9134 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:18:41.024041 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-fa742fa6-3e03-4d1c-bd74-f0c5b18f9134 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:18:41.030032 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-0d88f52e-467e-469b-961c-d95f77667ae5 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:18:41.030619 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-0d88f52e-467e-469b-961c-d95f77667ae5 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] [instance: f6d81116-5b48-433f-8c7e-88f2a9687167] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:18:41.032417 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-fa742fa6-3e03-4d1c-bd74-f0c5b18f9134 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:18:41.032869 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-fa742fa6-3e03-4d1c-bd74-f0c5b18f9134 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:18:41.033643 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-fa742fa6-3e03-4d1c-bd74-f0c5b18f9134 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:18:41.034075 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-fa742fa6-3e03-4d1c-bd74-f0c5b18f9134 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:18:41.038393 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0d88f52e-467e-469b-961c-d95f77667ae5 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:18:41.038822 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0d88f52e-467e-469b-961c-d95f77667ae5 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:18:41.039584 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0d88f52e-467e-469b-961c-d95f77667ae5 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:18:41.040063 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0d88f52e-467e-469b-961c-d95f77667ae5 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:18:41.161707 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-fa742fa6-3e03-4d1c-bd74-f0c5b18f9134 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:18:41.166047 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-0d88f52e-467e-469b-961c-d95f77667ae5 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb8e090f8ae4a2381c9b82a8090f112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90112b6f3d31421a8ee18cbe7d6b0537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:18:41.172349 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-fa742fa6-3e03-4d1c-bd74-f0c5b18f9134 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:18:41.174471 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-fa742fa6-3e03-4d1c-bd74-f0c5b18f9134 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:18:41.175773 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-0d88f52e-467e-469b-961c-d95f77667ae5 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] 10.222.0.60 "GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167" status: 200 len: 1350 microversion: 2.1 time: 0.149534 Nov 23 13:18:41.176154 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-fa742fa6-3e03-4d1c-bd74-f0c5b18f9134 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1443 microversion: 2.20 time: 0.157275 Nov 23 13:18:41.176359 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 862/1729] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:18:41 2021] GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167 => generated 1350 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:18:41.176919 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 868/1730] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:18:41 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1443 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:18:42.197909 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-db8f1a68-0105-492c-abcf-6653b5ebaace tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:18:42.198527 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-db8f1a68-0105-492c-abcf-6653b5ebaace tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:18:42.201837 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-12cfc5d0-6ec7-48fc-9438-835c5151ada9 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:18:42.202437 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-12cfc5d0-6ec7-48fc-9438-835c5151ada9 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] [instance: f6d81116-5b48-433f-8c7e-88f2a9687167] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:18:42.209261 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-db8f1a68-0105-492c-abcf-6653b5ebaace tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:18:42.209716 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-db8f1a68-0105-492c-abcf-6653b5ebaace tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:18:42.210527 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-db8f1a68-0105-492c-abcf-6653b5ebaace tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:18:42.211115 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-db8f1a68-0105-492c-abcf-6653b5ebaace tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:18:42.211830 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-12cfc5d0-6ec7-48fc-9438-835c5151ada9 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:18:42.212499 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-12cfc5d0-6ec7-48fc-9438-835c5151ada9 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:18:42.213404 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-12cfc5d0-6ec7-48fc-9438-835c5151ada9 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:18:42.213926 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-12cfc5d0-6ec7-48fc-9438-835c5151ada9 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:18:42.355561 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-db8f1a68-0105-492c-abcf-6653b5ebaace tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:18:42.366619 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-12cfc5d0-6ec7-48fc-9438-835c5151ada9 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb8e090f8ae4a2381c9b82a8090f112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90112b6f3d31421a8ee18cbe7d6b0537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:18:42.369871 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-db8f1a68-0105-492c-abcf-6653b5ebaace tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:18:42.372661 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-db8f1a68-0105-492c-abcf-6653b5ebaace tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:18:42.374583 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-db8f1a68-0105-492c-abcf-6653b5ebaace tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1443 microversion: 2.20 time: 0.182950 Nov 23 13:18:42.375518 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 863/1731] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:18:42 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1443 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:18:42.376033 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-12cfc5d0-6ec7-48fc-9438-835c5151ada9 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] 10.222.0.60 "GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167" status: 200 len: 1350 microversion: 2.1 time: 0.178424 Nov 23 13:18:42.376632 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 869/1732] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:18:42 2021] GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167 => generated 1350 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:18:43.405363 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-65afc5c7-b1a7-4085-a8f7-637ab9a93e62 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:18:43.406114 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-65afc5c7-b1a7-4085-a8f7-637ab9a93e62 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:18:43.407626 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-44e3587e-7946-4389-b169-8bbbf1efba04 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:18:43.408869 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-44e3587e-7946-4389-b169-8bbbf1efba04 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] [instance: f6d81116-5b48-433f-8c7e-88f2a9687167] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:18:43.417526 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-65afc5c7-b1a7-4085-a8f7-637ab9a93e62 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:18:43.418077 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-65afc5c7-b1a7-4085-a8f7-637ab9a93e62 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:18:43.418867 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-65afc5c7-b1a7-4085-a8f7-637ab9a93e62 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:18:43.419294 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-65afc5c7-b1a7-4085-a8f7-637ab9a93e62 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:18:43.425193 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-44e3587e-7946-4389-b169-8bbbf1efba04 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:18:43.425636 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-44e3587e-7946-4389-b169-8bbbf1efba04 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:18:43.426418 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-44e3587e-7946-4389-b169-8bbbf1efba04 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:18:43.426840 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-44e3587e-7946-4389-b169-8bbbf1efba04 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:18:43.555292 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-65afc5c7-b1a7-4085-a8f7-637ab9a93e62 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:18:43.555465 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-44e3587e-7946-4389-b169-8bbbf1efba04 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb8e090f8ae4a2381c9b82a8090f112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90112b6f3d31421a8ee18cbe7d6b0537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:18:43.565272 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-44e3587e-7946-4389-b169-8bbbf1efba04 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] 10.222.0.60 "GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167" status: 200 len: 1350 microversion: 2.1 time: 0.174406 Nov 23 13:18:43.565822 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-65afc5c7-b1a7-4085-a8f7-637ab9a93e62 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:18:43.565970 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 864/1733] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:18:43 2021] GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167 => generated 1350 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:18:43.567584 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-65afc5c7-b1a7-4085-a8f7-637ab9a93e62 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:18:43.568628 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-65afc5c7-b1a7-4085-a8f7-637ab9a93e62 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1443 microversion: 2.20 time: 0.176263 Nov 23 13:18:43.569202 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 870/1734] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:18:43 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1443 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:18:44.583281 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-7d28a988-516c-4f41-b6fe-1c7a4c303ea2 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:18:44.583909 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-7d28a988-516c-4f41-b6fe-1c7a4c303ea2 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] [instance: f6d81116-5b48-433f-8c7e-88f2a9687167] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:18:44.587507 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-f2ea9216-8295-4022-b6be-ba1ca2384c82 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:18:44.588454 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-f2ea9216-8295-4022-b6be-ba1ca2384c82 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:18:44.592649 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-7d28a988-516c-4f41-b6fe-1c7a4c303ea2 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:18:44.593091 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-7d28a988-516c-4f41-b6fe-1c7a4c303ea2 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:18:44.593861 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-7d28a988-516c-4f41-b6fe-1c7a4c303ea2 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:18:44.594276 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-7d28a988-516c-4f41-b6fe-1c7a4c303ea2 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:18:44.595991 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f2ea9216-8295-4022-b6be-ba1ca2384c82 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:18:44.596489 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f2ea9216-8295-4022-b6be-ba1ca2384c82 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:18:44.597272 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f2ea9216-8295-4022-b6be-ba1ca2384c82 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:18:44.597706 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f2ea9216-8295-4022-b6be-ba1ca2384c82 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:18:44.722713 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-7d28a988-516c-4f41-b6fe-1c7a4c303ea2 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb8e090f8ae4a2381c9b82a8090f112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90112b6f3d31421a8ee18cbe7d6b0537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:18:44.726524 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-f2ea9216-8295-4022-b6be-ba1ca2384c82 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:18:44.732620 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-7d28a988-516c-4f41-b6fe-1c7a4c303ea2 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] 10.222.0.60 "GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167" status: 200 len: 1350 microversion: 2.1 time: 0.152938 Nov 23 13:18:44.733419 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 865/1735] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:18:44 2021] GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167 => generated 1350 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:18:44.736518 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-f2ea9216-8295-4022-b6be-ba1ca2384c82 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:18:44.738017 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-f2ea9216-8295-4022-b6be-ba1ca2384c82 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:18:44.739131 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-f2ea9216-8295-4022-b6be-ba1ca2384c82 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1443 microversion: 2.20 time: 0.155780 Nov 23 13:18:44.739687 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 871/1736] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:18:44 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1443 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:18:45.751655 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-5c9b48e8-a941-4ee5-b8f1-4df5dfa07fa4 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:18:45.752271 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-5c9b48e8-a941-4ee5-b8f1-4df5dfa07fa4 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] [instance: f6d81116-5b48-433f-8c7e-88f2a9687167] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:18:45.757393 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-ceb62305-14e6-4507-a44f-84830414b909 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:18:45.758025 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-ceb62305-14e6-4507-a44f-84830414b909 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:18:45.760957 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5c9b48e8-a941-4ee5-b8f1-4df5dfa07fa4 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:18:45.761409 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5c9b48e8-a941-4ee5-b8f1-4df5dfa07fa4 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:18:45.762197 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5c9b48e8-a941-4ee5-b8f1-4df5dfa07fa4 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:18:45.762634 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5c9b48e8-a941-4ee5-b8f1-4df5dfa07fa4 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:18:45.766346 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ceb62305-14e6-4507-a44f-84830414b909 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:18:45.766793 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ceb62305-14e6-4507-a44f-84830414b909 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:18:45.767565 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ceb62305-14e6-4507-a44f-84830414b909 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:18:45.767984 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ceb62305-14e6-4507-a44f-84830414b909 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:18:45.883796 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-5c9b48e8-a941-4ee5-b8f1-4df5dfa07fa4 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb8e090f8ae4a2381c9b82a8090f112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90112b6f3d31421a8ee18cbe7d6b0537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:18:45.885627 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-ceb62305-14e6-4507-a44f-84830414b909 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:18:45.893970 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-5c9b48e8-a941-4ee5-b8f1-4df5dfa07fa4 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] 10.222.0.60 "GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167" status: 200 len: 1350 microversion: 2.1 time: 0.146093 Nov 23 13:18:45.894579 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 866/1737] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:18:45 2021] GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167 => generated 1350 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:18:45.896456 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-ceb62305-14e6-4507-a44f-84830414b909 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:18:45.898670 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-ceb62305-14e6-4507-a44f-84830414b909 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:18:45.900753 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-ceb62305-14e6-4507-a44f-84830414b909 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1443 microversion: 2.20 time: 0.146631 Nov 23 13:18:45.901858 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 872/1738] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:18:45 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1443 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:18:46.912568 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-d6e31e74-0aa7-4da9-b950-d229a6e9aeae tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:18:46.913233 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-d6e31e74-0aa7-4da9-b950-d229a6e9aeae tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] [instance: f6d81116-5b48-433f-8c7e-88f2a9687167] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:18:46.919100 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-a150c7b9-b6e2-4320-901e-0e98f3e95c23 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:18:46.919690 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-a150c7b9-b6e2-4320-901e-0e98f3e95c23 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:18:46.921469 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d6e31e74-0aa7-4da9-b950-d229a6e9aeae tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:18:46.921909 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d6e31e74-0aa7-4da9-b950-d229a6e9aeae tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:18:46.922725 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d6e31e74-0aa7-4da9-b950-d229a6e9aeae tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:18:46.923179 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d6e31e74-0aa7-4da9-b950-d229a6e9aeae tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:18:46.927476 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a150c7b9-b6e2-4320-901e-0e98f3e95c23 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:18:46.927927 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a150c7b9-b6e2-4320-901e-0e98f3e95c23 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:18:46.928755 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a150c7b9-b6e2-4320-901e-0e98f3e95c23 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:18:46.929189 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a150c7b9-b6e2-4320-901e-0e98f3e95c23 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:18:47.042510 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-d6e31e74-0aa7-4da9-b950-d229a6e9aeae tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb8e090f8ae4a2381c9b82a8090f112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90112b6f3d31421a8ee18cbe7d6b0537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:18:47.045772 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-a150c7b9-b6e2-4320-901e-0e98f3e95c23 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:18:47.052256 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-d6e31e74-0aa7-4da9-b950-d229a6e9aeae tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] 10.222.0.60 "GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167" status: 200 len: 1350 microversion: 2.1 time: 0.143490 Nov 23 13:18:47.052888 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 867/1739] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:18:46 2021] GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167 => generated 1350 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:18:47.055196 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-a150c7b9-b6e2-4320-901e-0e98f3e95c23 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:18:47.056750 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-a150c7b9-b6e2-4320-901e-0e98f3e95c23 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:18:47.057988 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-a150c7b9-b6e2-4320-901e-0e98f3e95c23 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1443 microversion: 2.20 time: 0.142957 Nov 23 13:18:47.058545 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 873/1740] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:18:46 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1443 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 13:18:48.074277 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-d339f2d5-f888-40a7-aa47-59a7a6d04b11 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:18:48.075252 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-d339f2d5-f888-40a7-aa47-59a7a6d04b11 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] [instance: f6d81116-5b48-433f-8c7e-88f2a9687167] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:18:48.080143 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-f0e954d7-17e2-41a7-be3e-8386dece5902 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:18:48.081103 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-f0e954d7-17e2-41a7-be3e-8386dece5902 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:18:48.087692 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d339f2d5-f888-40a7-aa47-59a7a6d04b11 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:18:48.088465 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d339f2d5-f888-40a7-aa47-59a7a6d04b11 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:18:48.089255 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d339f2d5-f888-40a7-aa47-59a7a6d04b11 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:18:48.089830 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d339f2d5-f888-40a7-aa47-59a7a6d04b11 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:18:48.091100 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f0e954d7-17e2-41a7-be3e-8386dece5902 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:18:48.091545 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f0e954d7-17e2-41a7-be3e-8386dece5902 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:18:48.092356 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f0e954d7-17e2-41a7-be3e-8386dece5902 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:18:48.092783 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f0e954d7-17e2-41a7-be3e-8386dece5902 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:18:48.211158 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-f0e954d7-17e2-41a7-be3e-8386dece5902 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:18:48.211368 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-d339f2d5-f888-40a7-aa47-59a7a6d04b11 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb8e090f8ae4a2381c9b82a8090f112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90112b6f3d31421a8ee18cbe7d6b0537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:18:48.220576 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-d339f2d5-f888-40a7-aa47-59a7a6d04b11 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] 10.222.0.60 "GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167" status: 200 len: 1350 microversion: 2.1 time: 0.152719 Nov 23 13:18:48.221154 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 868/1741] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:18:48 2021] GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167 => generated 1350 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:18:48.221325 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-f0e954d7-17e2-41a7-be3e-8386dece5902 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:18:48.222828 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-f0e954d7-17e2-41a7-be3e-8386dece5902 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:18:48.223956 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-f0e954d7-17e2-41a7-be3e-8386dece5902 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1443 microversion: 2.20 time: 0.150161 Nov 23 13:18:48.224510 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 874/1742] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:18:48 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1443 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:18:49.239275 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-f61063f7-7c61-4eba-8011-b575532bc088 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:18:49.239849 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-f61063f7-7c61-4eba-8011-b575532bc088 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] [instance: f6d81116-5b48-433f-8c7e-88f2a9687167] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:18:49.242865 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-619c16c0-f045-40f9-a62f-d8df48076e54 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:18:49.243471 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-619c16c0-f045-40f9-a62f-d8df48076e54 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:18:49.249566 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f61063f7-7c61-4eba-8011-b575532bc088 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:18:49.250300 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f61063f7-7c61-4eba-8011-b575532bc088 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:18:49.251523 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f61063f7-7c61-4eba-8011-b575532bc088 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:18:49.252111 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f61063f7-7c61-4eba-8011-b575532bc088 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:18:49.253746 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-619c16c0-f045-40f9-a62f-d8df48076e54 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:18:49.254194 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-619c16c0-f045-40f9-a62f-d8df48076e54 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:18:49.254973 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-619c16c0-f045-40f9-a62f-d8df48076e54 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:18:49.255399 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-619c16c0-f045-40f9-a62f-d8df48076e54 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:18:49.378194 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-619c16c0-f045-40f9-a62f-d8df48076e54 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:18:49.390130 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-619c16c0-f045-40f9-a62f-d8df48076e54 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:18:49.391664 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-619c16c0-f045-40f9-a62f-d8df48076e54 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:18:49.393131 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-619c16c0-f045-40f9-a62f-d8df48076e54 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1443 microversion: 2.20 time: 0.154009 Nov 23 13:18:49.393987 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 875/1743] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:18:49 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1443 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:18:49.530147 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-f61063f7-7c61-4eba-8011-b575532bc088 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb8e090f8ae4a2381c9b82a8090f112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90112b6f3d31421a8ee18cbe7d6b0537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:18:49.540926 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-f61063f7-7c61-4eba-8011-b575532bc088 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] 10.222.0.60 "GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167" status: 200 len: 1350 microversion: 2.1 time: 0.305857 Nov 23 13:18:49.541595 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 869/1744] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:18:49 2021] GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167 => generated 1350 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:18:50.411219 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-33bdc919-2108-420f-abcc-213ea8d222d7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:18:50.412066 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-33bdc919-2108-420f-abcc-213ea8d222d7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:18:50.420758 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-33bdc919-2108-420f-abcc-213ea8d222d7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:18:50.421202 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-33bdc919-2108-420f-abcc-213ea8d222d7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:18:50.421971 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-33bdc919-2108-420f-abcc-213ea8d222d7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:18:50.422440 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-33bdc919-2108-420f-abcc-213ea8d222d7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:18:50.540264 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-33bdc919-2108-420f-abcc-213ea8d222d7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:18:50.550110 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-33bdc919-2108-420f-abcc-213ea8d222d7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:18:50.551598 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-33bdc919-2108-420f-abcc-213ea8d222d7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:18:50.553933 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-33bdc919-2108-420f-abcc-213ea8d222d7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1443 microversion: 2.20 time: 0.145365 Nov 23 13:18:50.553933 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 876/1745] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:18:50 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1443 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:18:50.559286 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-f2e59806-91f7-437b-a6de-42e0c785717a tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:18:50.559875 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-f2e59806-91f7-437b-a6de-42e0c785717a tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] [instance: f6d81116-5b48-433f-8c7e-88f2a9687167] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:18:50.568492 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f2e59806-91f7-437b-a6de-42e0c785717a tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:18:50.568944 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f2e59806-91f7-437b-a6de-42e0c785717a tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:18:50.569716 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f2e59806-91f7-437b-a6de-42e0c785717a tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:18:50.570148 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f2e59806-91f7-437b-a6de-42e0c785717a tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:18:50.687235 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-f2e59806-91f7-437b-a6de-42e0c785717a tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb8e090f8ae4a2381c9b82a8090f112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90112b6f3d31421a8ee18cbe7d6b0537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:18:50.696585 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-f2e59806-91f7-437b-a6de-42e0c785717a tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] 10.222.0.60 "GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167" status: 200 len: 1350 microversion: 2.1 time: 0.141082 Nov 23 13:18:50.697148 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 870/1746] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:18:50 2021] GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167 => generated 1350 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:18:51.573284 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-d2ef2d59-f150-472a-ba61-da6adaea835c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:18:51.574110 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-d2ef2d59-f150-472a-ba61-da6adaea835c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:18:51.582222 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d2ef2d59-f150-472a-ba61-da6adaea835c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:18:51.582666 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d2ef2d59-f150-472a-ba61-da6adaea835c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:18:51.583468 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d2ef2d59-f150-472a-ba61-da6adaea835c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:18:51.583898 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d2ef2d59-f150-472a-ba61-da6adaea835c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:18:51.715264 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-76e7e4fd-ec39-490e-88e0-415af3b05526 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:18:51.715948 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-76e7e4fd-ec39-490e-88e0-415af3b05526 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] [instance: f6d81116-5b48-433f-8c7e-88f2a9687167] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:18:51.724031 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-76e7e4fd-ec39-490e-88e0-415af3b05526 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:18:51.724514 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-76e7e4fd-ec39-490e-88e0-415af3b05526 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:18:51.725334 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-76e7e4fd-ec39-490e-88e0-415af3b05526 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:18:51.725751 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-76e7e4fd-ec39-490e-88e0-415af3b05526 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:18:51.804807 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-d2ef2d59-f150-472a-ba61-da6adaea835c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:18:51.823189 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-d2ef2d59-f150-472a-ba61-da6adaea835c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:18:51.825484 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-d2ef2d59-f150-472a-ba61-da6adaea835c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:18:51.827295 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-d2ef2d59-f150-472a-ba61-da6adaea835c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1443 microversion: 2.20 time: 0.258159 Nov 23 13:18:51.834556 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 877/1747] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:18:51 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1443 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:18:51.855130 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-76e7e4fd-ec39-490e-88e0-415af3b05526 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb8e090f8ae4a2381c9b82a8090f112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90112b6f3d31421a8ee18cbe7d6b0537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:18:51.864790 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-76e7e4fd-ec39-490e-88e0-415af3b05526 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] 10.222.0.60 "GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167" status: 200 len: 1350 microversion: 2.1 time: 0.153383 Nov 23 13:18:51.865568 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 871/1748] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:18:51 2021] GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167 => generated 1350 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 13:18:52.847813 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-031e4a22-58f5-45a9-a01e-6a42a5e05e86 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:18:52.848477 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-031e4a22-58f5-45a9-a01e-6a42a5e05e86 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:18:52.856124 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-031e4a22-58f5-45a9-a01e-6a42a5e05e86 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:18:52.856617 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-031e4a22-58f5-45a9-a01e-6a42a5e05e86 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:18:52.857724 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-031e4a22-58f5-45a9-a01e-6a42a5e05e86 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:18:52.858161 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-031e4a22-58f5-45a9-a01e-6a42a5e05e86 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:18:52.883206 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-3dae13d5-f04f-4893-8e5d-367c658f1b57 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:18:52.883814 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-3dae13d5-f04f-4893-8e5d-367c658f1b57 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] [instance: f6d81116-5b48-433f-8c7e-88f2a9687167] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:18:52.891822 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-3dae13d5-f04f-4893-8e5d-367c658f1b57 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:18:52.892272 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-3dae13d5-f04f-4893-8e5d-367c658f1b57 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:18:52.893076 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-3dae13d5-f04f-4893-8e5d-367c658f1b57 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:18:52.893589 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-3dae13d5-f04f-4893-8e5d-367c658f1b57 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:18:52.980719 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-031e4a22-58f5-45a9-a01e-6a42a5e05e86 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:18:52.992284 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-031e4a22-58f5-45a9-a01e-6a42a5e05e86 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:18:52.993810 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-031e4a22-58f5-45a9-a01e-6a42a5e05e86 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:18:52.995015 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-031e4a22-58f5-45a9-a01e-6a42a5e05e86 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1443 microversion: 2.20 time: 0.151019 Nov 23 13:18:52.995576 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 878/1749] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:18:52 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1443 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:18:53.018961 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-3dae13d5-f04f-4893-8e5d-367c658f1b57 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb8e090f8ae4a2381c9b82a8090f112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90112b6f3d31421a8ee18cbe7d6b0537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:18:53.029021 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-3dae13d5-f04f-4893-8e5d-367c658f1b57 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] 10.222.0.60 "GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167" status: 200 len: 1350 microversion: 2.1 time: 0.149631 Nov 23 13:18:53.029598 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 872/1750] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:18:52 2021] GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167 => generated 1350 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:18:54.017066 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-aa7fa0f0-b9bd-48ff-a969-851b6f188be4 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:18:54.017725 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-aa7fa0f0-b9bd-48ff-a969-851b6f188be4 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:18:54.029565 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-aa7fa0f0-b9bd-48ff-a969-851b6f188be4 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:18:54.030005 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-aa7fa0f0-b9bd-48ff-a969-851b6f188be4 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:18:54.030764 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-aa7fa0f0-b9bd-48ff-a969-851b6f188be4 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:18:54.031185 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-aa7fa0f0-b9bd-48ff-a969-851b6f188be4 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:18:54.047125 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-50d19704-b118-4329-8c53-92fd5945e136 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:18:54.047742 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-50d19704-b118-4329-8c53-92fd5945e136 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] [instance: f6d81116-5b48-433f-8c7e-88f2a9687167] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:18:54.055993 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-50d19704-b118-4329-8c53-92fd5945e136 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:18:54.056486 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-50d19704-b118-4329-8c53-92fd5945e136 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:18:54.057355 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-50d19704-b118-4329-8c53-92fd5945e136 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:18:54.058022 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-50d19704-b118-4329-8c53-92fd5945e136 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:18:54.153291 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-aa7fa0f0-b9bd-48ff-a969-851b6f188be4 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:18:54.163719 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-aa7fa0f0-b9bd-48ff-a969-851b6f188be4 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:18:54.165344 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-aa7fa0f0-b9bd-48ff-a969-851b6f188be4 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:18:54.166491 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-aa7fa0f0-b9bd-48ff-a969-851b6f188be4 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1443 microversion: 2.20 time: 0.153600 Nov 23 13:18:54.167051 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 879/1751] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:18:54 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1443 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:18:54.176333 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-50d19704-b118-4329-8c53-92fd5945e136 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb8e090f8ae4a2381c9b82a8090f112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90112b6f3d31421a8ee18cbe7d6b0537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:18:54.185734 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-50d19704-b118-4329-8c53-92fd5945e136 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] 10.222.0.60 "GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167" status: 200 len: 1350 microversion: 2.1 time: 0.142280 Nov 23 13:18:54.186255 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 873/1752] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:18:54 2021] GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167 => generated 1350 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:18:55.185138 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-b45f3932-87dc-412a-84ae-81eb3a8ab5d5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:18:55.186028 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-b45f3932-87dc-412a-84ae-81eb3a8ab5d5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:18:55.194766 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b45f3932-87dc-412a-84ae-81eb3a8ab5d5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:18:55.195212 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b45f3932-87dc-412a-84ae-81eb3a8ab5d5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:18:55.195988 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b45f3932-87dc-412a-84ae-81eb3a8ab5d5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:18:55.196487 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b45f3932-87dc-412a-84ae-81eb3a8ab5d5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:18:55.205148 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-f9d022fa-e916-486c-a957-dcee9fc61fe0 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:18:55.205842 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-f9d022fa-e916-486c-a957-dcee9fc61fe0 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] [instance: f6d81116-5b48-433f-8c7e-88f2a9687167] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:18:55.214846 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f9d022fa-e916-486c-a957-dcee9fc61fe0 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:18:55.215287 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f9d022fa-e916-486c-a957-dcee9fc61fe0 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:18:55.216409 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f9d022fa-e916-486c-a957-dcee9fc61fe0 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:18:55.216674 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f9d022fa-e916-486c-a957-dcee9fc61fe0 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:18:55.320887 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-b45f3932-87dc-412a-84ae-81eb3a8ab5d5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:18:55.331075 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-b45f3932-87dc-412a-84ae-81eb3a8ab5d5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:18:55.332576 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-b45f3932-87dc-412a-84ae-81eb3a8ab5d5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:18:55.333683 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-b45f3932-87dc-412a-84ae-81eb3a8ab5d5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1443 microversion: 2.20 time: 0.152583 Nov 23 13:18:55.334459 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 880/1753] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:18:55 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1443 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:18:55.337055 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-f9d022fa-e916-486c-a957-dcee9fc61fe0 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb8e090f8ae4a2381c9b82a8090f112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90112b6f3d31421a8ee18cbe7d6b0537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:18:55.350398 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-f9d022fa-e916-486c-a957-dcee9fc61fe0 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] 10.222.0.60 "GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167" status: 200 len: 1350 microversion: 2.1 time: 0.151047 Nov 23 13:18:55.350988 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 874/1754] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:18:55 2021] GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167 => generated 1350 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:18:56.352754 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-e96c13f3-593a-42dc-89df-17216bac7ba7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:18:56.353410 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-e96c13f3-593a-42dc-89df-17216bac7ba7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:18:56.363566 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e96c13f3-593a-42dc-89df-17216bac7ba7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:18:56.364009 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e96c13f3-593a-42dc-89df-17216bac7ba7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:18:56.364835 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e96c13f3-593a-42dc-89df-17216bac7ba7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:18:56.365265 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e96c13f3-593a-42dc-89df-17216bac7ba7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:18:56.369291 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-388fe16a-4d9c-4e7b-ae71-f5d5d996a7f5 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:18:56.370369 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-388fe16a-4d9c-4e7b-ae71-f5d5d996a7f5 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] [instance: f6d81116-5b48-433f-8c7e-88f2a9687167] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:18:56.379236 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-388fe16a-4d9c-4e7b-ae71-f5d5d996a7f5 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:18:56.379697 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-388fe16a-4d9c-4e7b-ae71-f5d5d996a7f5 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:18:56.380531 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-388fe16a-4d9c-4e7b-ae71-f5d5d996a7f5 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:18:56.380984 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-388fe16a-4d9c-4e7b-ae71-f5d5d996a7f5 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:18:56.494217 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-e96c13f3-593a-42dc-89df-17216bac7ba7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:18:56.505188 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-e96c13f3-593a-42dc-89df-17216bac7ba7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:18:56.506393 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-388fe16a-4d9c-4e7b-ae71-f5d5d996a7f5 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb8e090f8ae4a2381c9b82a8090f112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90112b6f3d31421a8ee18cbe7d6b0537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:18:56.506839 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-e96c13f3-593a-42dc-89df-17216bac7ba7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:18:56.508077 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-e96c13f3-593a-42dc-89df-17216bac7ba7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1443 microversion: 2.20 time: 0.159236 Nov 23 13:18:56.508733 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 881/1755] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:18:56 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1443 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:18:56.516054 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-388fe16a-4d9c-4e7b-ae71-f5d5d996a7f5 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] 10.222.0.60 "GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167" status: 200 len: 1350 microversion: 2.1 time: 0.151523 Nov 23 13:18:56.516666 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 875/1756] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:18:56 2021] GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167 => generated 1350 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 13:18:57.526254 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-523e6061-c818-4d04-a6c1-869d99838dbb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:18:57.526834 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-523e6061-c818-4d04-a6c1-869d99838dbb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:18:57.534482 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-5a0998f5-4a49-4abe-91ab-039679f11505 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:18:57.535143 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-523e6061-c818-4d04-a6c1-869d99838dbb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:18:57.535267 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-5a0998f5-4a49-4abe-91ab-039679f11505 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] [instance: f6d81116-5b48-433f-8c7e-88f2a9687167] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:18:57.535386 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-523e6061-c818-4d04-a6c1-869d99838dbb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:18:57.536045 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-523e6061-c818-4d04-a6c1-869d99838dbb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:18:57.536515 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-523e6061-c818-4d04-a6c1-869d99838dbb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:18:57.543212 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5a0998f5-4a49-4abe-91ab-039679f11505 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:18:57.543655 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5a0998f5-4a49-4abe-91ab-039679f11505 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:18:57.544452 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5a0998f5-4a49-4abe-91ab-039679f11505 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:18:57.544886 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5a0998f5-4a49-4abe-91ab-039679f11505 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:18:57.654111 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-523e6061-c818-4d04-a6c1-869d99838dbb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:18:57.664839 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-523e6061-c818-4d04-a6c1-869d99838dbb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:18:57.666437 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-523e6061-c818-4d04-a6c1-869d99838dbb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:18:57.680415 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-523e6061-c818-4d04-a6c1-869d99838dbb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1443 microversion: 2.20 time: 0.145168 Nov 23 13:18:57.680415 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 882/1757] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:18:57 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1443 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:18:57.680819 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-5a0998f5-4a49-4abe-91ab-039679f11505 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb8e090f8ae4a2381c9b82a8090f112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90112b6f3d31421a8ee18cbe7d6b0537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:18:57.685466 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-5a0998f5-4a49-4abe-91ab-039679f11505 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] 10.222.0.60 "GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167" status: 200 len: 1350 microversion: 2.1 time: 0.155648 Nov 23 13:18:57.686134 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 876/1758] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:18:57 2021] GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167 => generated 1350 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:18:58.692978 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-a6c132c9-6713-4792-80dd-ea8154a64d4a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:18:58.693611 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-a6c132c9-6713-4792-80dd-ea8154a64d4a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:18:58.702718 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-a6e99e33-8db4-4885-a083-ff1a6252eb20 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:18:58.703387 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a6c132c9-6713-4792-80dd-ea8154a64d4a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:18:58.703387 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a6c132c9-6713-4792-80dd-ea8154a64d4a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:18:58.703629 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-a6e99e33-8db4-4885-a083-ff1a6252eb20 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] [instance: f6d81116-5b48-433f-8c7e-88f2a9687167] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:18:58.704020 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a6c132c9-6713-4792-80dd-ea8154a64d4a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:18:58.704474 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a6c132c9-6713-4792-80dd-ea8154a64d4a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:18:58.711297 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a6e99e33-8db4-4885-a083-ff1a6252eb20 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:18:58.711755 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a6e99e33-8db4-4885-a083-ff1a6252eb20 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:18:58.712557 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a6e99e33-8db4-4885-a083-ff1a6252eb20 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:18:58.712979 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a6e99e33-8db4-4885-a083-ff1a6252eb20 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:18:58.834573 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-a6c132c9-6713-4792-80dd-ea8154a64d4a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:18:58.835236 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-a6e99e33-8db4-4885-a083-ff1a6252eb20 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb8e090f8ae4a2381c9b82a8090f112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90112b6f3d31421a8ee18cbe7d6b0537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:18:58.844933 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-a6e99e33-8db4-4885-a083-ff1a6252eb20 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] 10.222.0.60 "GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167" status: 200 len: 1350 microversion: 2.1 time: 0.145799 Nov 23 13:18:58.845143 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-a6c132c9-6713-4792-80dd-ea8154a64d4a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:18:58.853625 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 877/1759] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:18:58 2021] GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167 => generated 1350 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:18:58.853829 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-a6c132c9-6713-4792-80dd-ea8154a64d4a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:18:58.853829 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-a6c132c9-6713-4792-80dd-ea8154a64d4a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1443 microversion: 2.20 time: 0.160353 Nov 23 13:18:58.860976 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 883/1760] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:18:58 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1443 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:18:59.863207 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-230673b5-7946-4edd-9f04-cbc3e3fc80c9 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:18:59.863841 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-230673b5-7946-4edd-9f04-cbc3e3fc80c9 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] [instance: f6d81116-5b48-433f-8c7e-88f2a9687167] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:18:59.868530 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-48481dc3-137b-4249-b912-0d6040b671f8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:18:59.869132 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-48481dc3-137b-4249-b912-0d6040b671f8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:18:59.871920 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-230673b5-7946-4edd-9f04-cbc3e3fc80c9 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:18:59.872385 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-230673b5-7946-4edd-9f04-cbc3e3fc80c9 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:18:59.873156 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-230673b5-7946-4edd-9f04-cbc3e3fc80c9 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:18:59.873666 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-230673b5-7946-4edd-9f04-cbc3e3fc80c9 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:18:59.876593 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-48481dc3-137b-4249-b912-0d6040b671f8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:18:59.877015 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-48481dc3-137b-4249-b912-0d6040b671f8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:18:59.877813 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-48481dc3-137b-4249-b912-0d6040b671f8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:18:59.878245 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-48481dc3-137b-4249-b912-0d6040b671f8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:18:59.990808 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-230673b5-7946-4edd-9f04-cbc3e3fc80c9 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb8e090f8ae4a2381c9b82a8090f112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90112b6f3d31421a8ee18cbe7d6b0537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:18:59.991764 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-48481dc3-137b-4249-b912-0d6040b671f8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:18:59.999611 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-230673b5-7946-4edd-9f04-cbc3e3fc80c9 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] 10.222.0.60 "GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167" status: 200 len: 1350 microversion: 2.1 time: 0.140782 Nov 23 13:19:00.000305 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 878/1761] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:18:59 2021] GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167 => generated 1350 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:19:00.001097 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-48481dc3-137b-4249-b912-0d6040b671f8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:00.002689 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-48481dc3-137b-4249-b912-0d6040b671f8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:00.003798 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-48481dc3-137b-4249-b912-0d6040b671f8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1443 microversion: 2.20 time: 0.139216 Nov 23 13:19:00.004361 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 884/1762] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:18:59 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1443 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 13:19:01.019643 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-33764d5b-ae1b-40bd-967a-cfba5cdb646a tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:19:01.020288 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-33764d5b-ae1b-40bd-967a-cfba5cdb646a tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] [instance: f6d81116-5b48-433f-8c7e-88f2a9687167] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:19:01.022874 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-8709ac9a-8b09-4daa-bbc4-90bf50ce41d3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:19:01.023485 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-8709ac9a-8b09-4daa-bbc4-90bf50ce41d3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:19:01.028138 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-33764d5b-ae1b-40bd-967a-cfba5cdb646a tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:01.028625 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-33764d5b-ae1b-40bd-967a-cfba5cdb646a tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:01.029405 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-33764d5b-ae1b-40bd-967a-cfba5cdb646a tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:01.029836 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-33764d5b-ae1b-40bd-967a-cfba5cdb646a tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:01.030931 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8709ac9a-8b09-4daa-bbc4-90bf50ce41d3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:01.031407 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8709ac9a-8b09-4daa-bbc4-90bf50ce41d3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:01.032180 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8709ac9a-8b09-4daa-bbc4-90bf50ce41d3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:01.032631 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8709ac9a-8b09-4daa-bbc4-90bf50ce41d3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:01.143558 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-33764d5b-ae1b-40bd-967a-cfba5cdb646a tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb8e090f8ae4a2381c9b82a8090f112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90112b6f3d31421a8ee18cbe7d6b0537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:01.147637 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-8709ac9a-8b09-4daa-bbc4-90bf50ce41d3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:01.156007 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-33764d5b-ae1b-40bd-967a-cfba5cdb646a tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] 10.222.0.60 "GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167" status: 200 len: 1350 microversion: 2.1 time: 0.140350 Nov 23 13:19:01.157412 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 879/1763] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:19:01 2021] GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167 => generated 1350 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:19:01.161994 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-8709ac9a-8b09-4daa-bbc4-90bf50ce41d3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:01.164392 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-8709ac9a-8b09-4daa-bbc4-90bf50ce41d3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:01.165709 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-8709ac9a-8b09-4daa-bbc4-90bf50ce41d3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1443 microversion: 2.20 time: 0.147202 Nov 23 13:19:01.166510 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 885/1764] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:19:01 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1443 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:19:02.177053 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-c54a1093-74da-436d-bde8-472066b0cf67 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:19:02.177627 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-c54a1093-74da-436d-bde8-472066b0cf67 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] [instance: f6d81116-5b48-433f-8c7e-88f2a9687167] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:19:02.184434 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-ff3598f9-be13-4d1f-9f80-d07b00275515 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:19:02.185040 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-ff3598f9-be13-4d1f-9f80-d07b00275515 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:19:02.185618 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c54a1093-74da-436d-bde8-472066b0cf67 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:02.186064 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c54a1093-74da-436d-bde8-472066b0cf67 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:02.186828 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c54a1093-74da-436d-bde8-472066b0cf67 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:02.187234 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c54a1093-74da-436d-bde8-472066b0cf67 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:02.193256 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ff3598f9-be13-4d1f-9f80-d07b00275515 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:02.193684 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ff3598f9-be13-4d1f-9f80-d07b00275515 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:02.194714 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ff3598f9-be13-4d1f-9f80-d07b00275515 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:02.195025 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ff3598f9-be13-4d1f-9f80-d07b00275515 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:02.309820 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-c54a1093-74da-436d-bde8-472066b0cf67 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb8e090f8ae4a2381c9b82a8090f112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90112b6f3d31421a8ee18cbe7d6b0537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:02.311472 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-ff3598f9-be13-4d1f-9f80-d07b00275515 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:02.319270 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-c54a1093-74da-436d-bde8-472066b0cf67 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] 10.222.0.60 "GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167" status: 200 len: 1350 microversion: 2.1 time: 0.146220 Nov 23 13:19:02.319823 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 880/1765] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:19:02 2021] GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167 => generated 1350 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:19:02.321308 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-ff3598f9-be13-4d1f-9f80-d07b00275515 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:02.323026 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-ff3598f9-be13-4d1f-9f80-d07b00275515 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:02.324132 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-ff3598f9-be13-4d1f-9f80-d07b00275515 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1443 microversion: 2.20 time: 0.143793 Nov 23 13:19:02.324736 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 886/1766] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:19:02 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1443 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:19:03.339249 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-c846ea75-bca1-40b1-8767-587de944047e tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:19:03.339898 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-c846ea75-bca1-40b1-8767-587de944047e tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] [instance: f6d81116-5b48-433f-8c7e-88f2a9687167] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:19:03.342582 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-31598242-11d9-43a6-8e58-82e40b5ae00d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:19:03.343180 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-31598242-11d9-43a6-8e58-82e40b5ae00d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:19:03.349889 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c846ea75-bca1-40b1-8767-587de944047e tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:03.350346 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c846ea75-bca1-40b1-8767-587de944047e tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:03.351879 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c846ea75-bca1-40b1-8767-587de944047e tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:03.352354 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c846ea75-bca1-40b1-8767-587de944047e tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:03.352831 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-31598242-11d9-43a6-8e58-82e40b5ae00d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:03.353279 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-31598242-11d9-43a6-8e58-82e40b5ae00d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:03.354206 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-31598242-11d9-43a6-8e58-82e40b5ae00d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:03.354628 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-31598242-11d9-43a6-8e58-82e40b5ae00d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:03.487229 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-31598242-11d9-43a6-8e58-82e40b5ae00d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:03.492484 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-c846ea75-bca1-40b1-8767-587de944047e tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb8e090f8ae4a2381c9b82a8090f112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90112b6f3d31421a8ee18cbe7d6b0537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:03.501012 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-31598242-11d9-43a6-8e58-82e40b5ae00d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:03.501545 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-c846ea75-bca1-40b1-8767-587de944047e tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] 10.222.0.60 "GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167" status: 200 len: 1350 microversion: 2.1 time: 0.167991 Nov 23 13:19:03.502131 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 881/1767] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:19:03 2021] GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167 => generated 1350 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:19:03.502882 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-31598242-11d9-43a6-8e58-82e40b5ae00d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:03.504063 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-31598242-11d9-43a6-8e58-82e40b5ae00d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1443 microversion: 2.20 time: 0.165330 Nov 23 13:19:03.504736 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 887/1768] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:19:03 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1443 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:19:04.523814 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-e318a1fa-a37d-4666-9af4-c3f13b2ddcba tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:19:04.524796 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-e318a1fa-a37d-4666-9af4-c3f13b2ddcba tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] [instance: f6d81116-5b48-433f-8c7e-88f2a9687167] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:19:04.526951 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-27d047a3-85c5-4698-be6e-5c8924ebfa97 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:19:04.527947 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-27d047a3-85c5-4698-be6e-5c8924ebfa97 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:19:04.536372 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e318a1fa-a37d-4666-9af4-c3f13b2ddcba tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:04.536811 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e318a1fa-a37d-4666-9af4-c3f13b2ddcba tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:04.537565 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e318a1fa-a37d-4666-9af4-c3f13b2ddcba tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:04.537927 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-27d047a3-85c5-4698-be6e-5c8924ebfa97 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:04.538075 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e318a1fa-a37d-4666-9af4-c3f13b2ddcba tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:04.538381 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-27d047a3-85c5-4698-be6e-5c8924ebfa97 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:04.539139 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-27d047a3-85c5-4698-be6e-5c8924ebfa97 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:04.539559 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-27d047a3-85c5-4698-be6e-5c8924ebfa97 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:04.652153 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-27d047a3-85c5-4698-be6e-5c8924ebfa97 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:04.652352 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-e318a1fa-a37d-4666-9af4-c3f13b2ddcba tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb8e090f8ae4a2381c9b82a8090f112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90112b6f3d31421a8ee18cbe7d6b0537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:04.661269 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-e318a1fa-a37d-4666-9af4-c3f13b2ddcba tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] 10.222.0.60 "GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167" status: 200 len: 1350 microversion: 2.1 time: 0.144279 Nov 23 13:19:04.661719 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-27d047a3-85c5-4698-be6e-5c8924ebfa97 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:04.661887 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 882/1769] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:19:04 2021] GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167 => generated 1350 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:19:04.663207 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-27d047a3-85c5-4698-be6e-5c8924ebfa97 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:04.664318 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-27d047a3-85c5-4698-be6e-5c8924ebfa97 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1443 microversion: 2.20 time: 0.143754 Nov 23 13:19:04.664866 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 888/1770] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:19:04 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1443 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:19:05.678998 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-1785205d-7125-489d-998b-c56d9ed5c453 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:19:05.679700 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-1785205d-7125-489d-998b-c56d9ed5c453 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] [instance: f6d81116-5b48-433f-8c7e-88f2a9687167] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:19:05.682840 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-f0bd74d8-dfd7-44f0-9fe1-c12b2eff800f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:19:05.683452 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-f0bd74d8-dfd7-44f0-9fe1-c12b2eff800f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:19:05.688519 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-1785205d-7125-489d-998b-c56d9ed5c453 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:05.689080 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-1785205d-7125-489d-998b-c56d9ed5c453 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:05.689866 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-1785205d-7125-489d-998b-c56d9ed5c453 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:05.690307 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-1785205d-7125-489d-998b-c56d9ed5c453 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:05.692087 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f0bd74d8-dfd7-44f0-9fe1-c12b2eff800f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:05.692697 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f0bd74d8-dfd7-44f0-9fe1-c12b2eff800f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:05.693907 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f0bd74d8-dfd7-44f0-9fe1-c12b2eff800f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:05.694442 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f0bd74d8-dfd7-44f0-9fe1-c12b2eff800f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:05.808623 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-1785205d-7125-489d-998b-c56d9ed5c453 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb8e090f8ae4a2381c9b82a8090f112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90112b6f3d31421a8ee18cbe7d6b0537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:05.810874 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-f0bd74d8-dfd7-44f0-9fe1-c12b2eff800f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:05.818227 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-1785205d-7125-489d-998b-c56d9ed5c453 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] 10.222.0.60 "GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167" status: 200 len: 1350 microversion: 2.1 time: 0.143275 Nov 23 13:19:05.818999 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 883/1771] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:19:05 2021] GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167 => generated 1350 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:19:05.820223 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-f0bd74d8-dfd7-44f0-9fe1-c12b2eff800f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:05.821732 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-f0bd74d8-dfd7-44f0-9fe1-c12b2eff800f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:05.822856 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-f0bd74d8-dfd7-44f0-9fe1-c12b2eff800f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1443 microversion: 2.20 time: 0.144125 Nov 23 13:19:05.823559 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 889/1772] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:19:05 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1443 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:19:06.835295 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-fbc2d102-4bb9-4662-9a58-d0e4b6c66dba tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:19:06.836115 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-fbc2d102-4bb9-4662-9a58-d0e4b6c66dba tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] [instance: f6d81116-5b48-433f-8c7e-88f2a9687167] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:19:06.841224 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-23cc5405-2e9d-4c40-b1e2-783a6568cfd0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:19:06.841835 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-23cc5405-2e9d-4c40-b1e2-783a6568cfd0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:19:06.843920 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-fbc2d102-4bb9-4662-9a58-d0e4b6c66dba tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:06.844423 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-fbc2d102-4bb9-4662-9a58-d0e4b6c66dba tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:06.845198 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-fbc2d102-4bb9-4662-9a58-d0e4b6c66dba tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:06.845625 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-fbc2d102-4bb9-4662-9a58-d0e4b6c66dba tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:06.849550 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-23cc5405-2e9d-4c40-b1e2-783a6568cfd0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:06.850000 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-23cc5405-2e9d-4c40-b1e2-783a6568cfd0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:06.850807 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-23cc5405-2e9d-4c40-b1e2-783a6568cfd0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:06.851241 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-23cc5405-2e9d-4c40-b1e2-783a6568cfd0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:06.971829 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-fbc2d102-4bb9-4662-9a58-d0e4b6c66dba tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb8e090f8ae4a2381c9b82a8090f112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90112b6f3d31421a8ee18cbe7d6b0537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:06.973324 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-23cc5405-2e9d-4c40-b1e2-783a6568cfd0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:06.981170 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-fbc2d102-4bb9-4662-9a58-d0e4b6c66dba tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] 10.222.0.60 "GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167" status: 200 len: 1350 microversion: 2.1 time: 0.149855 Nov 23 13:19:06.981736 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 884/1773] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:19:06 2021] GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167 => generated 1350 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:19:06.982872 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-23cc5405-2e9d-4c40-b1e2-783a6568cfd0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:06.984394 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-23cc5405-2e9d-4c40-b1e2-783a6568cfd0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:06.985815 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-23cc5405-2e9d-4c40-b1e2-783a6568cfd0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1443 microversion: 2.20 time: 0.148564 Nov 23 13:19:06.986396 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 890/1774] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:19:06 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1443 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:19:08.000115 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-01613297-5216-4204-90b1-c12dd07415a2 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:19:08.000741 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-01613297-5216-4204-90b1-c12dd07415a2 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] [instance: f6d81116-5b48-433f-8c7e-88f2a9687167] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:19:08.004903 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-23abe4b3-312a-48a4-97d7-b2f18e464bda tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:19:08.005640 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-23abe4b3-312a-48a4-97d7-b2f18e464bda tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:19:08.009914 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-01613297-5216-4204-90b1-c12dd07415a2 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:08.010511 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-01613297-5216-4204-90b1-c12dd07415a2 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:08.011963 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-01613297-5216-4204-90b1-c12dd07415a2 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:08.012761 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-01613297-5216-4204-90b1-c12dd07415a2 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:08.013355 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-23abe4b3-312a-48a4-97d7-b2f18e464bda tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:08.013808 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-23abe4b3-312a-48a4-97d7-b2f18e464bda tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:08.014578 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-23abe4b3-312a-48a4-97d7-b2f18e464bda tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:08.015000 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-23abe4b3-312a-48a4-97d7-b2f18e464bda tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:08.127799 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-23abe4b3-312a-48a4-97d7-b2f18e464bda tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:08.137137 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-23abe4b3-312a-48a4-97d7-b2f18e464bda tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:08.138460 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-01613297-5216-4204-90b1-c12dd07415a2 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb8e090f8ae4a2381c9b82a8090f112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90112b6f3d31421a8ee18cbe7d6b0537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:08.138636 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-23abe4b3-312a-48a4-97d7-b2f18e464bda tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:08.139723 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-23abe4b3-312a-48a4-97d7-b2f18e464bda tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1443 microversion: 2.20 time: 0.138930 Nov 23 13:19:08.140286 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 891/1775] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:19:07 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1443 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:19:08.147695 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-01613297-5216-4204-90b1-c12dd07415a2 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] 10.222.0.60 "GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167" status: 200 len: 1350 microversion: 2.1 time: 0.151542 Nov 23 13:19:08.148271 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 885/1776] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:19:07 2021] GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167 => generated 1350 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:19:09.159009 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-bdd7da11-728c-40ec-b022-f6001152f122 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:19:09.159613 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-bdd7da11-728c-40ec-b022-f6001152f122 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:19:09.165592 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-c6b28412-a6a2-4259-a670-dc51b20675cc tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:19:09.166198 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-c6b28412-a6a2-4259-a670-dc51b20675cc tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] [instance: f6d81116-5b48-433f-8c7e-88f2a9687167] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:19:09.167336 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-bdd7da11-728c-40ec-b022-f6001152f122 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:09.167779 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-bdd7da11-728c-40ec-b022-f6001152f122 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:09.168567 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-bdd7da11-728c-40ec-b022-f6001152f122 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:09.168990 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-bdd7da11-728c-40ec-b022-f6001152f122 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:09.173912 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c6b28412-a6a2-4259-a670-dc51b20675cc tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:09.174364 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c6b28412-a6a2-4259-a670-dc51b20675cc tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:09.175134 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c6b28412-a6a2-4259-a670-dc51b20675cc tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:09.175581 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c6b28412-a6a2-4259-a670-dc51b20675cc tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:09.285478 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-bdd7da11-728c-40ec-b022-f6001152f122 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:09.294512 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-c6b28412-a6a2-4259-a670-dc51b20675cc tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb8e090f8ae4a2381c9b82a8090f112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90112b6f3d31421a8ee18cbe7d6b0537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:09.298043 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-bdd7da11-728c-40ec-b022-f6001152f122 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:09.300345 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-bdd7da11-728c-40ec-b022-f6001152f122 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:09.301805 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-bdd7da11-728c-40ec-b022-f6001152f122 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1443 microversion: 2.20 time: 0.146830 Nov 23 13:19:09.302641 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 892/1777] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:19:09 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1443 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:19:09.306536 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-c6b28412-a6a2-4259-a670-dc51b20675cc tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] 10.222.0.60 "GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167" status: 200 len: 1350 microversion: 2.1 time: 0.144962 Nov 23 13:19:09.307172 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 886/1778] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:19:09 2021] GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167 => generated 1350 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:19:10.321099 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-92904814-7fb3-45d4-8f91-446e2a50ea2c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:19:10.321716 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-92904814-7fb3-45d4-8f91-446e2a50ea2c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:19:10.323773 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-eddb4481-3c04-481a-af9c-9ea22b11a4c2 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:19:10.324437 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-eddb4481-3c04-481a-af9c-9ea22b11a4c2 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] [instance: f6d81116-5b48-433f-8c7e-88f2a9687167] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:19:10.330374 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-92904814-7fb3-45d4-8f91-446e2a50ea2c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:10.330798 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-92904814-7fb3-45d4-8f91-446e2a50ea2c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:10.331571 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-92904814-7fb3-45d4-8f91-446e2a50ea2c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:10.331882 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-eddb4481-3c04-481a-af9c-9ea22b11a4c2 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:10.332008 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-92904814-7fb3-45d4-8f91-446e2a50ea2c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:10.332363 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-eddb4481-3c04-481a-af9c-9ea22b11a4c2 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:10.333119 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-eddb4481-3c04-481a-af9c-9ea22b11a4c2 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:10.333548 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-eddb4481-3c04-481a-af9c-9ea22b11a4c2 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:10.449768 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-92904814-7fb3-45d4-8f91-446e2a50ea2c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:10.450621 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-eddb4481-3c04-481a-af9c-9ea22b11a4c2 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb8e090f8ae4a2381c9b82a8090f112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90112b6f3d31421a8ee18cbe7d6b0537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:10.460897 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-eddb4481-3c04-481a-af9c-9ea22b11a4c2 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] 10.222.0.60 "GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167" status: 200 len: 1350 microversion: 2.1 time: 0.141113 Nov 23 13:19:10.461465 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 887/1779] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:19:10 2021] GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167 => generated 1350 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:19:10.463786 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-92904814-7fb3-45d4-8f91-446e2a50ea2c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:10.465304 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-92904814-7fb3-45d4-8f91-446e2a50ea2c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:10.466425 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-92904814-7fb3-45d4-8f91-446e2a50ea2c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1443 microversion: 2.20 time: 0.149390 Nov 23 13:19:10.466968 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 893/1780] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:19:10 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1443 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:19:11.482122 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-b8f93338-aded-4a5e-8fe0-e743ddba1eab tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:19:11.483184 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-b8f93338-aded-4a5e-8fe0-e743ddba1eab tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] [instance: f6d81116-5b48-433f-8c7e-88f2a9687167] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:19:11.496573 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b8f93338-aded-4a5e-8fe0-e743ddba1eab tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:11.497276 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b8f93338-aded-4a5e-8fe0-e743ddba1eab tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:11.498569 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b8f93338-aded-4a5e-8fe0-e743ddba1eab tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:11.499058 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-fe46df79-10f8-4d52-b976-f3a9a058b52b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:19:11.499572 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b8f93338-aded-4a5e-8fe0-e743ddba1eab tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:11.500067 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-fe46df79-10f8-4d52-b976-f3a9a058b52b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:19:11.512866 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-fe46df79-10f8-4d52-b976-f3a9a058b52b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:11.513544 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-fe46df79-10f8-4d52-b976-f3a9a058b52b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:11.514853 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-fe46df79-10f8-4d52-b976-f3a9a058b52b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:11.515589 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-fe46df79-10f8-4d52-b976-f3a9a058b52b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:11.678913 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-fe46df79-10f8-4d52-b976-f3a9a058b52b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:11.691507 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-fe46df79-10f8-4d52-b976-f3a9a058b52b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:11.693563 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-fe46df79-10f8-4d52-b976-f3a9a058b52b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:11.696010 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-fe46df79-10f8-4d52-b976-f3a9a058b52b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1443 microversion: 2.20 time: 0.203430 Nov 23 13:19:11.696010 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 894/1781] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:19:11 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1443 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:19:11.708458 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-b8f93338-aded-4a5e-8fe0-e743ddba1eab tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb8e090f8ae4a2381c9b82a8090f112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90112b6f3d31421a8ee18cbe7d6b0537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:11.722708 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-b8f93338-aded-4a5e-8fe0-e743ddba1eab tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] 10.222.0.60 "GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167" status: 200 len: 1350 microversion: 2.1 time: 0.246906 Nov 23 13:19:11.723485 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 888/1782] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:19:11 2021] GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167 => generated 1350 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:19:12.716277 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-072f88e9-7b0e-47ad-aa1d-f19c3e4c8e99 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:19:12.716918 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-072f88e9-7b0e-47ad-aa1d-f19c3e4c8e99 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:19:12.725513 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-072f88e9-7b0e-47ad-aa1d-f19c3e4c8e99 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:12.725960 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-072f88e9-7b0e-47ad-aa1d-f19c3e4c8e99 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:12.726784 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-072f88e9-7b0e-47ad-aa1d-f19c3e4c8e99 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:12.727246 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-072f88e9-7b0e-47ad-aa1d-f19c3e4c8e99 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:12.740984 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-37c17b75-20df-4cc3-b90d-e2274ba86f05 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:19:12.741573 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-37c17b75-20df-4cc3-b90d-e2274ba86f05 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] [instance: f6d81116-5b48-433f-8c7e-88f2a9687167] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:19:12.749477 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-37c17b75-20df-4cc3-b90d-e2274ba86f05 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:12.749923 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-37c17b75-20df-4cc3-b90d-e2274ba86f05 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:12.750688 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-37c17b75-20df-4cc3-b90d-e2274ba86f05 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:12.751119 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-37c17b75-20df-4cc3-b90d-e2274ba86f05 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:12.848229 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-072f88e9-7b0e-47ad-aa1d-f19c3e4c8e99 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:12.859292 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-072f88e9-7b0e-47ad-aa1d-f19c3e4c8e99 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:12.861601 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-072f88e9-7b0e-47ad-aa1d-f19c3e4c8e99 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:12.862980 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-072f88e9-7b0e-47ad-aa1d-f19c3e4c8e99 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1443 microversion: 2.20 time: 0.150584 Nov 23 13:19:12.864374 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 895/1783] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:19:12 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1443 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:19:12.881747 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-37c17b75-20df-4cc3-b90d-e2274ba86f05 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb8e090f8ae4a2381c9b82a8090f112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90112b6f3d31421a8ee18cbe7d6b0537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:12.891086 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-37c17b75-20df-4cc3-b90d-e2274ba86f05 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] 10.222.0.60 "GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167" status: 200 len: 1350 microversion: 2.1 time: 0.154120 Nov 23 13:19:12.891657 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 889/1784] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:19:12 2021] GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167 => generated 1350 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:19:13.883571 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-3ffe8fda-e7a7-4c13-9e5b-46fee6000bb5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:19:13.884265 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-3ffe8fda-e7a7-4c13-9e5b-46fee6000bb5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:19:13.892156 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3ffe8fda-e7a7-4c13-9e5b-46fee6000bb5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:13.892631 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3ffe8fda-e7a7-4c13-9e5b-46fee6000bb5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:13.893386 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3ffe8fda-e7a7-4c13-9e5b-46fee6000bb5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:13.893843 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3ffe8fda-e7a7-4c13-9e5b-46fee6000bb5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:13.909143 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-2e846c8f-3150-4e6d-bac3-9a2c9951b915 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:19:13.909774 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-2e846c8f-3150-4e6d-bac3-9a2c9951b915 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] [instance: f6d81116-5b48-433f-8c7e-88f2a9687167] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:19:13.918281 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-2e846c8f-3150-4e6d-bac3-9a2c9951b915 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:13.918770 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-2e846c8f-3150-4e6d-bac3-9a2c9951b915 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:13.919603 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-2e846c8f-3150-4e6d-bac3-9a2c9951b915 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:13.920100 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-2e846c8f-3150-4e6d-bac3-9a2c9951b915 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:14.015658 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-3ffe8fda-e7a7-4c13-9e5b-46fee6000bb5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:14.025828 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-3ffe8fda-e7a7-4c13-9e5b-46fee6000bb5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:14.027317 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-3ffe8fda-e7a7-4c13-9e5b-46fee6000bb5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:14.028487 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-3ffe8fda-e7a7-4c13-9e5b-46fee6000bb5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1443 microversion: 2.20 time: 0.149411 Nov 23 13:19:14.029051 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 896/1785] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:19:13 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1443 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:19:14.041604 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-2e846c8f-3150-4e6d-bac3-9a2c9951b915 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb8e090f8ae4a2381c9b82a8090f112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90112b6f3d31421a8ee18cbe7d6b0537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:14.051177 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-2e846c8f-3150-4e6d-bac3-9a2c9951b915 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] 10.222.0.60 "GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167" status: 200 len: 1350 microversion: 2.1 time: 0.145725 Nov 23 13:19:14.051764 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 890/1786] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:19:13 2021] GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167 => generated 1350 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:19:15.048060 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-aff83b42-154b-4a7c-8942-1e4596602146 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:19:15.048724 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-aff83b42-154b-4a7c-8942-1e4596602146 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:19:15.056744 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-aff83b42-154b-4a7c-8942-1e4596602146 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:15.057166 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-aff83b42-154b-4a7c-8942-1e4596602146 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:15.057958 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-aff83b42-154b-4a7c-8942-1e4596602146 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:15.058388 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-aff83b42-154b-4a7c-8942-1e4596602146 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:15.069893 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-8e874db9-912e-4fc9-a81b-0bfe5bf8186c tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:19:15.070503 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-8e874db9-912e-4fc9-a81b-0bfe5bf8186c tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] [instance: f6d81116-5b48-433f-8c7e-88f2a9687167] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:19:15.078979 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8e874db9-912e-4fc9-a81b-0bfe5bf8186c tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:15.079413 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8e874db9-912e-4fc9-a81b-0bfe5bf8186c tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:15.080171 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8e874db9-912e-4fc9-a81b-0bfe5bf8186c tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:15.080622 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8e874db9-912e-4fc9-a81b-0bfe5bf8186c tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:15.176531 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-aff83b42-154b-4a7c-8942-1e4596602146 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:15.186392 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-aff83b42-154b-4a7c-8942-1e4596602146 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:15.187923 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-aff83b42-154b-4a7c-8942-1e4596602146 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:15.189072 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-aff83b42-154b-4a7c-8942-1e4596602146 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1443 microversion: 2.20 time: 0.144954 Nov 23 13:19:15.189638 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 897/1787] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:19:15 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1443 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:19:15.199098 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-8e874db9-912e-4fc9-a81b-0bfe5bf8186c tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb8e090f8ae4a2381c9b82a8090f112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90112b6f3d31421a8ee18cbe7d6b0537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:15.207958 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-8e874db9-912e-4fc9-a81b-0bfe5bf8186c tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] 10.222.0.60 "GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167" status: 200 len: 1350 microversion: 2.1 time: 0.142656 Nov 23 13:19:15.208526 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 891/1788] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:19:15 2021] GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167 => generated 1350 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 13:19:16.207645 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-4254d283-cf5b-477b-b2e4-f3774f582da5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:19:16.208490 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-4254d283-cf5b-477b-b2e4-f3774f582da5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:19:16.224206 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-69dba659-2da7-41ff-990c-2dc76ca6de25 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:19:16.225365 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-69dba659-2da7-41ff-990c-2dc76ca6de25 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] [instance: f6d81116-5b48-433f-8c7e-88f2a9687167] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:19:16.226730 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-4254d283-cf5b-477b-b2e4-f3774f582da5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:16.227559 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-4254d283-cf5b-477b-b2e4-f3774f582da5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:16.229015 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-4254d283-cf5b-477b-b2e4-f3774f582da5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:16.229758 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-4254d283-cf5b-477b-b2e4-f3774f582da5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:16.232585 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-69dba659-2da7-41ff-990c-2dc76ca6de25 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:16.233026 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-69dba659-2da7-41ff-990c-2dc76ca6de25 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:16.233779 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-69dba659-2da7-41ff-990c-2dc76ca6de25 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:16.234218 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-69dba659-2da7-41ff-990c-2dc76ca6de25 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:16.348967 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-4254d283-cf5b-477b-b2e4-f3774f582da5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:16.359816 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-4254d283-cf5b-477b-b2e4-f3774f582da5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:16.361376 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-4254d283-cf5b-477b-b2e4-f3774f582da5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:16.362485 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-4254d283-cf5b-477b-b2e4-f3774f582da5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1443 microversion: 2.20 time: 0.158791 Nov 23 13:19:16.363051 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 898/1789] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:19:16 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1443 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:19:16.444011 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-69dba659-2da7-41ff-990c-2dc76ca6de25 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb8e090f8ae4a2381c9b82a8090f112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90112b6f3d31421a8ee18cbe7d6b0537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:16.455876 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-69dba659-2da7-41ff-990c-2dc76ca6de25 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] 10.222.0.60 "GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167" status: 200 len: 1350 microversion: 2.1 time: 0.235186 Nov 23 13:19:16.456853 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 892/1790] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:19:16 2021] GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167 => generated 1350 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:19:17.383496 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-fb8bed8e-9dce-408e-a9a2-c581b8d85c0b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:19:17.384203 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-fb8bed8e-9dce-408e-a9a2-c581b8d85c0b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:19:17.396893 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-fb8bed8e-9dce-408e-a9a2-c581b8d85c0b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:17.397216 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-fb8bed8e-9dce-408e-a9a2-c581b8d85c0b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:17.398073 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-fb8bed8e-9dce-408e-a9a2-c581b8d85c0b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:17.398545 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-fb8bed8e-9dce-408e-a9a2-c581b8d85c0b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:17.478125 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-a8f024af-9d30-40dc-b189-487edcbf1b1f tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:19:17.478762 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-a8f024af-9d30-40dc-b189-487edcbf1b1f tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] [instance: f6d81116-5b48-433f-8c7e-88f2a9687167] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:19:17.486891 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a8f024af-9d30-40dc-b189-487edcbf1b1f tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:17.487340 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a8f024af-9d30-40dc-b189-487edcbf1b1f tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:17.488268 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a8f024af-9d30-40dc-b189-487edcbf1b1f tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:17.488710 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a8f024af-9d30-40dc-b189-487edcbf1b1f tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:17.519145 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-fb8bed8e-9dce-408e-a9a2-c581b8d85c0b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:17.529161 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-fb8bed8e-9dce-408e-a9a2-c581b8d85c0b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:17.530763 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-fb8bed8e-9dce-408e-a9a2-c581b8d85c0b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:17.531970 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-fb8bed8e-9dce-408e-a9a2-c581b8d85c0b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1443 microversion: 2.20 time: 0.153919 Nov 23 13:19:17.532666 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 899/1791] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:19:17 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1443 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:19:17.607794 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-a8f024af-9d30-40dc-b189-487edcbf1b1f tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb8e090f8ae4a2381c9b82a8090f112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90112b6f3d31421a8ee18cbe7d6b0537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:17.619933 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-a8f024af-9d30-40dc-b189-487edcbf1b1f tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] 10.222.0.60 "GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167" status: 200 len: 1350 microversion: 2.1 time: 0.145565 Nov 23 13:19:17.620571 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 893/1792] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:19:17 2021] GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167 => generated 1350 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:19:18.553454 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-9fd6cd51-9a84-42bd-8cf0-3065d4ff89c3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:19:18.554102 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-9fd6cd51-9a84-42bd-8cf0-3065d4ff89c3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:19:18.565008 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-9fd6cd51-9a84-42bd-8cf0-3065d4ff89c3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:18.565709 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-9fd6cd51-9a84-42bd-8cf0-3065d4ff89c3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:18.566857 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-9fd6cd51-9a84-42bd-8cf0-3065d4ff89c3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:18.567323 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-9fd6cd51-9a84-42bd-8cf0-3065d4ff89c3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:18.636744 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-fe8ca979-65a9-4465-be97-19cd56728d7c tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:19:18.637411 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-fe8ca979-65a9-4465-be97-19cd56728d7c tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] [instance: f6d81116-5b48-433f-8c7e-88f2a9687167] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:19:18.648284 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-fe8ca979-65a9-4465-be97-19cd56728d7c tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:18.648852 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-fe8ca979-65a9-4465-be97-19cd56728d7c tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:18.649904 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-fe8ca979-65a9-4465-be97-19cd56728d7c tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:18.650491 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-fe8ca979-65a9-4465-be97-19cd56728d7c tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:18.694472 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-9fd6cd51-9a84-42bd-8cf0-3065d4ff89c3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:18.704121 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-9fd6cd51-9a84-42bd-8cf0-3065d4ff89c3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:18.705621 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-9fd6cd51-9a84-42bd-8cf0-3065d4ff89c3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:18.706757 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-9fd6cd51-9a84-42bd-8cf0-3065d4ff89c3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1443 microversion: 2.20 time: 0.159096 Nov 23 13:19:18.707280 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 900/1793] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:19:18 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1443 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:19:18.768590 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-fe8ca979-65a9-4465-be97-19cd56728d7c tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb8e090f8ae4a2381c9b82a8090f112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90112b6f3d31421a8ee18cbe7d6b0537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:18.778012 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-fe8ca979-65a9-4465-be97-19cd56728d7c tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] 10.222.0.60 "GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167" status: 200 len: 1350 microversion: 2.1 time: 0.144933 Nov 23 13:19:18.778566 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 894/1794] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:19:18 2021] GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167 => generated 1350 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 13:19:19.725512 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-191821cc-1248-419d-9de2-c46413acde74 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:19:19.726172 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-191821cc-1248-419d-9de2-c46413acde74 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:19:19.735249 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-191821cc-1248-419d-9de2-c46413acde74 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:19.735681 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-191821cc-1248-419d-9de2-c46413acde74 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:19.736532 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-191821cc-1248-419d-9de2-c46413acde74 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:19.736979 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-191821cc-1248-419d-9de2-c46413acde74 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:19.796391 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-ff32286f-3628-461a-ba5e-34e83bc61a92 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:19:19.797030 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-ff32286f-3628-461a-ba5e-34e83bc61a92 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] [instance: f6d81116-5b48-433f-8c7e-88f2a9687167] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:19:19.804984 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ff32286f-3628-461a-ba5e-34e83bc61a92 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:19.809292 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ff32286f-3628-461a-ba5e-34e83bc61a92 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:19.809292 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ff32286f-3628-461a-ba5e-34e83bc61a92 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:19.809292 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ff32286f-3628-461a-ba5e-34e83bc61a92 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:19.860150 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-191821cc-1248-419d-9de2-c46413acde74 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:19.871057 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-191821cc-1248-419d-9de2-c46413acde74 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:19.872751 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-191821cc-1248-419d-9de2-c46413acde74 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:19.874007 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-191821cc-1248-419d-9de2-c46413acde74 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1443 microversion: 2.20 time: 0.152359 Nov 23 13:19:19.874973 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 901/1795] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:19:19 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1443 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:19:19.933570 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-ff32286f-3628-461a-ba5e-34e83bc61a92 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb8e090f8ae4a2381c9b82a8090f112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90112b6f3d31421a8ee18cbe7d6b0537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:19.943210 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-ff32286f-3628-461a-ba5e-34e83bc61a92 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] 10.222.0.60 "GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167" status: 200 len: 1350 microversion: 2.1 time: 0.151091 Nov 23 13:19:19.943788 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 895/1796] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:19:19 2021] GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167 => generated 1350 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:19:20.896521 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-19de8a1f-683a-4ad7-8b1f-3b23ec655776 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:19:20.897457 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-19de8a1f-683a-4ad7-8b1f-3b23ec655776 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:19:20.907301 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-19de8a1f-683a-4ad7-8b1f-3b23ec655776 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:20.907752 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-19de8a1f-683a-4ad7-8b1f-3b23ec655776 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:20.908549 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-19de8a1f-683a-4ad7-8b1f-3b23ec655776 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:20.908980 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-19de8a1f-683a-4ad7-8b1f-3b23ec655776 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:20.965280 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-26637bdc-db1c-481e-8a6a-520698bdbdaa tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:19:20.966219 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-26637bdc-db1c-481e-8a6a-520698bdbdaa tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] [instance: f6d81116-5b48-433f-8c7e-88f2a9687167] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:19:20.974462 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-26637bdc-db1c-481e-8a6a-520698bdbdaa tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:20.974899 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-26637bdc-db1c-481e-8a6a-520698bdbdaa tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:20.975683 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-26637bdc-db1c-481e-8a6a-520698bdbdaa tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:20.976111 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-26637bdc-db1c-481e-8a6a-520698bdbdaa tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:21.097301 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-26637bdc-db1c-481e-8a6a-520698bdbdaa tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb8e090f8ae4a2381c9b82a8090f112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90112b6f3d31421a8ee18cbe7d6b0537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:21.107089 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-26637bdc-db1c-481e-8a6a-520698bdbdaa tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] 10.222.0.60 "GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167" status: 200 len: 1350 microversion: 2.1 time: 0.145356 Nov 23 13:19:21.107750 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 896/1797] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:19:20 2021] GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167 => generated 1350 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:19:21.181786 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-19de8a1f-683a-4ad7-8b1f-3b23ec655776 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:21.191639 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-19de8a1f-683a-4ad7-8b1f-3b23ec655776 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:21.193133 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-19de8a1f-683a-4ad7-8b1f-3b23ec655776 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:21.194274 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-19de8a1f-683a-4ad7-8b1f-3b23ec655776 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1443 microversion: 2.20 time: 0.303834 Nov 23 13:19:21.194840 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 902/1798] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:19:20 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1443 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:19:22.127246 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-d0f8b5f8-d903-4ce4-b348-675a33ca1884 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:19:22.127851 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-d0f8b5f8-d903-4ce4-b348-675a33ca1884 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] [instance: f6d81116-5b48-433f-8c7e-88f2a9687167] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:19:22.137774 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d0f8b5f8-d903-4ce4-b348-675a33ca1884 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:22.138219 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d0f8b5f8-d903-4ce4-b348-675a33ca1884 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:22.138998 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d0f8b5f8-d903-4ce4-b348-675a33ca1884 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:22.139420 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d0f8b5f8-d903-4ce4-b348-675a33ca1884 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:22.218664 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-3aeb03b0-7158-465d-be80-2b32dce7137a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:19:22.220456 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-3aeb03b0-7158-465d-be80-2b32dce7137a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:19:22.231622 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3aeb03b0-7158-465d-be80-2b32dce7137a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:22.232228 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3aeb03b0-7158-465d-be80-2b32dce7137a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:22.233045 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3aeb03b0-7158-465d-be80-2b32dce7137a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:22.233480 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3aeb03b0-7158-465d-be80-2b32dce7137a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:22.261188 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-d0f8b5f8-d903-4ce4-b348-675a33ca1884 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb8e090f8ae4a2381c9b82a8090f112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90112b6f3d31421a8ee18cbe7d6b0537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:22.271559 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-d0f8b5f8-d903-4ce4-b348-675a33ca1884 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] 10.222.0.60 "GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167" status: 200 len: 1350 microversion: 2.1 time: 0.150308 Nov 23 13:19:22.272170 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 897/1799] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:19:22 2021] GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167 => generated 1350 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:19:22.356227 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-3aeb03b0-7158-465d-be80-2b32dce7137a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:22.366937 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-3aeb03b0-7158-465d-be80-2b32dce7137a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:22.368471 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-3aeb03b0-7158-465d-be80-2b32dce7137a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:22.369580 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-3aeb03b0-7158-465d-be80-2b32dce7137a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1443 microversion: 2.20 time: 0.157208 Nov 23 13:19:22.370127 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 903/1800] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:19:22 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1443 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:19:23.289227 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-541228f3-3a2b-46a9-b68f-55cdace3ebd5 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:19:23.289858 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-541228f3-3a2b-46a9-b68f-55cdace3ebd5 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] [instance: f6d81116-5b48-433f-8c7e-88f2a9687167] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:19:23.297721 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-541228f3-3a2b-46a9-b68f-55cdace3ebd5 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:23.298167 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-541228f3-3a2b-46a9-b68f-55cdace3ebd5 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:23.298937 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-541228f3-3a2b-46a9-b68f-55cdace3ebd5 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:23.299358 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-541228f3-3a2b-46a9-b68f-55cdace3ebd5 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:23.387529 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-c939d5df-f5a2-4991-b458-f744ba4700b2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:19:23.388148 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-c939d5df-f5a2-4991-b458-f744ba4700b2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:19:23.395880 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c939d5df-f5a2-4991-b458-f744ba4700b2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:23.396352 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c939d5df-f5a2-4991-b458-f744ba4700b2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:23.397123 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c939d5df-f5a2-4991-b458-f744ba4700b2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:23.397550 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c939d5df-f5a2-4991-b458-f744ba4700b2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:23.418286 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-541228f3-3a2b-46a9-b68f-55cdace3ebd5 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb8e090f8ae4a2381c9b82a8090f112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90112b6f3d31421a8ee18cbe7d6b0537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:23.428912 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-541228f3-3a2b-46a9-b68f-55cdace3ebd5 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] 10.222.0.60 "GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167" status: 200 len: 1350 microversion: 2.1 time: 0.143439 Nov 23 13:19:23.429511 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 898/1801] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:19:23 2021] GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167 => generated 1350 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:19:23.652440 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-c939d5df-f5a2-4991-b458-f744ba4700b2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:23.665234 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-c939d5df-f5a2-4991-b458-f744ba4700b2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:23.667773 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-c939d5df-f5a2-4991-b458-f744ba4700b2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:23.669450 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-c939d5df-f5a2-4991-b458-f744ba4700b2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1443 microversion: 2.20 time: 0.285760 Nov 23 13:19:23.670307 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 904/1802] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:19:23 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1443 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:19:24.448914 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-3d14e8ae-816c-4c71-a55d-911101859c1d tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:19:24.449687 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-3d14e8ae-816c-4c71-a55d-911101859c1d tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] [instance: f6d81116-5b48-433f-8c7e-88f2a9687167] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:19:24.457992 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-3d14e8ae-816c-4c71-a55d-911101859c1d tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:24.458479 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-3d14e8ae-816c-4c71-a55d-911101859c1d tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:24.459261 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-3d14e8ae-816c-4c71-a55d-911101859c1d tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:24.459718 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-3d14e8ae-816c-4c71-a55d-911101859c1d tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:24.583568 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-3d14e8ae-816c-4c71-a55d-911101859c1d tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb8e090f8ae4a2381c9b82a8090f112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90112b6f3d31421a8ee18cbe7d6b0537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:24.595027 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-3d14e8ae-816c-4c71-a55d-911101859c1d tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] 10.222.0.60 "GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167" status: 200 len: 1350 microversion: 2.1 time: 0.151352 Nov 23 13:19:24.595627 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 899/1803] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:19:24 2021] GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167 => generated 1350 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:19:24.687591 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-5a9c7dd0-f294-476f-8022-1c22326e9d81 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:19:24.688963 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-5a9c7dd0-f294-476f-8022-1c22326e9d81 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:19:24.697017 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5a9c7dd0-f294-476f-8022-1c22326e9d81 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:24.697457 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5a9c7dd0-f294-476f-8022-1c22326e9d81 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:24.698255 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5a9c7dd0-f294-476f-8022-1c22326e9d81 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:24.698833 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5a9c7dd0-f294-476f-8022-1c22326e9d81 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:24.819781 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-5a9c7dd0-f294-476f-8022-1c22326e9d81 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:24.829888 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-5a9c7dd0-f294-476f-8022-1c22326e9d81 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:24.831385 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-5a9c7dd0-f294-476f-8022-1c22326e9d81 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:24.832528 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-5a9c7dd0-f294-476f-8022-1c22326e9d81 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1443 microversion: 2.20 time: 0.148973 Nov 23 13:19:24.833096 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 905/1804] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:19:24 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1443 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:19:25.024065 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 13:19:25.024411 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: Tue Nov 23 13:19:25 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 23 13:19:25.612966 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-223388fa-e827-4459-9a94-f6b3dbd937fb tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:19:25.613734 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-223388fa-e827-4459-9a94-f6b3dbd937fb tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] [instance: f6d81116-5b48-433f-8c7e-88f2a9687167] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:19:25.621548 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-223388fa-e827-4459-9a94-f6b3dbd937fb tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:25.621971 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-223388fa-e827-4459-9a94-f6b3dbd937fb tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:25.622728 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-223388fa-e827-4459-9a94-f6b3dbd937fb tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:25.623150 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-223388fa-e827-4459-9a94-f6b3dbd937fb tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:25.812111 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-223388fa-e827-4459-9a94-f6b3dbd937fb tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb8e090f8ae4a2381c9b82a8090f112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90112b6f3d31421a8ee18cbe7d6b0537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:25.826018 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-223388fa-e827-4459-9a94-f6b3dbd937fb tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] 10.222.0.60 "GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167" status: 200 len: 1350 microversion: 2.1 time: 0.216917 Nov 23 13:19:25.826850 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 900/1805] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:19:25 2021] GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167 => generated 1350 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:19:25.850983 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-44c1d6be-bc7a-4899-9fbb-cdc917f0d6b2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:19:25.851713 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-44c1d6be-bc7a-4899-9fbb-cdc917f0d6b2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:19:25.860076 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-44c1d6be-bc7a-4899-9fbb-cdc917f0d6b2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:25.860553 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-44c1d6be-bc7a-4899-9fbb-cdc917f0d6b2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:25.861331 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-44c1d6be-bc7a-4899-9fbb-cdc917f0d6b2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:25.861766 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-44c1d6be-bc7a-4899-9fbb-cdc917f0d6b2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:25.976063 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-44c1d6be-bc7a-4899-9fbb-cdc917f0d6b2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:25.989204 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-44c1d6be-bc7a-4899-9fbb-cdc917f0d6b2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:25.990726 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-44c1d6be-bc7a-4899-9fbb-cdc917f0d6b2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:25.991828 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-44c1d6be-bc7a-4899-9fbb-cdc917f0d6b2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1443 microversion: 2.20 time: 0.144739 Nov 23 13:19:25.992411 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 906/1806] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:19:25 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1443 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:19:26.843991 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-6769203b-042f-421c-9640-e71c1642818a tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:19:26.845002 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-6769203b-042f-421c-9640-e71c1642818a tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] [instance: f6d81116-5b48-433f-8c7e-88f2a9687167] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:19:26.856645 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6769203b-042f-421c-9640-e71c1642818a tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:26.857079 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6769203b-042f-421c-9640-e71c1642818a tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:26.857948 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6769203b-042f-421c-9640-e71c1642818a tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:26.858419 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6769203b-042f-421c-9640-e71c1642818a tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:26.984631 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-6769203b-042f-421c-9640-e71c1642818a tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb8e090f8ae4a2381c9b82a8090f112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90112b6f3d31421a8ee18cbe7d6b0537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:26.998670 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-6769203b-042f-421c-9640-e71c1642818a tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] 10.222.0.60 "GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167" status: 200 len: 1350 microversion: 2.1 time: 0.159145 Nov 23 13:19:26.999456 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 901/1807] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:19:26 2021] GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167 => generated 1350 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:19:27.011720 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-c6e779f2-9550-4075-afa4-f5c2956bc14a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:19:27.012381 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-c6e779f2-9550-4075-afa4-f5c2956bc14a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:19:27.021081 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c6e779f2-9550-4075-afa4-f5c2956bc14a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:27.021529 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c6e779f2-9550-4075-afa4-f5c2956bc14a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:27.022314 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c6e779f2-9550-4075-afa4-f5c2956bc14a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:27.022744 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c6e779f2-9550-4075-afa4-f5c2956bc14a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:27.147194 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-c6e779f2-9550-4075-afa4-f5c2956bc14a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:27.162870 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-c6e779f2-9550-4075-afa4-f5c2956bc14a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:27.165370 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-c6e779f2-9550-4075-afa4-f5c2956bc14a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:27.167161 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-c6e779f2-9550-4075-afa4-f5c2956bc14a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1443 microversion: 2.20 time: 0.159976 Nov 23 13:19:27.167938 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 907/1808] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:19:27 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1443 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:19:28.019645 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-0ea8e542-03bf-464a-bee8-5615dd4cf775 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:19:28.020291 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-0ea8e542-03bf-464a-bee8-5615dd4cf775 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] [instance: f6d81116-5b48-433f-8c7e-88f2a9687167] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:19:28.028507 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0ea8e542-03bf-464a-bee8-5615dd4cf775 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:28.028950 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0ea8e542-03bf-464a-bee8-5615dd4cf775 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:28.029719 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0ea8e542-03bf-464a-bee8-5615dd4cf775 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:28.030145 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0ea8e542-03bf-464a-bee8-5615dd4cf775 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:28.152195 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-0ea8e542-03bf-464a-bee8-5615dd4cf775 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb8e090f8ae4a2381c9b82a8090f112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90112b6f3d31421a8ee18cbe7d6b0537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:28.162205 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-0ea8e542-03bf-464a-bee8-5615dd4cf775 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] 10.222.0.60 "GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167" status: 200 len: 1350 microversion: 2.1 time: 0.148284 Nov 23 13:19:28.162803 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 902/1809] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:19:28 2021] GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167 => generated 1350 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:19:28.188364 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-e8c5188f-2b8b-46e6-99b7-628126d838f5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:19:28.189145 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-e8c5188f-2b8b-46e6-99b7-628126d838f5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:19:28.197016 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e8c5188f-2b8b-46e6-99b7-628126d838f5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:28.197463 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e8c5188f-2b8b-46e6-99b7-628126d838f5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:28.198247 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e8c5188f-2b8b-46e6-99b7-628126d838f5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:28.198648 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e8c5188f-2b8b-46e6-99b7-628126d838f5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:28.318065 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-e8c5188f-2b8b-46e6-99b7-628126d838f5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:28.327556 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-e8c5188f-2b8b-46e6-99b7-628126d838f5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:28.329069 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-e8c5188f-2b8b-46e6-99b7-628126d838f5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:28.330133 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-e8c5188f-2b8b-46e6-99b7-628126d838f5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1443 microversion: 2.20 time: 0.145642 Nov 23 13:19:28.330820 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 908/1810] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:19:28 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1443 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:19:29.181575 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-236677d9-5d79-4c18-9fae-757488cb25e2 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:19:29.182480 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-236677d9-5d79-4c18-9fae-757488cb25e2 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] [instance: f6d81116-5b48-433f-8c7e-88f2a9687167] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:19:29.194226 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-236677d9-5d79-4c18-9fae-757488cb25e2 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:29.194449 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-236677d9-5d79-4c18-9fae-757488cb25e2 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:29.195151 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-236677d9-5d79-4c18-9fae-757488cb25e2 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:29.195576 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-236677d9-5d79-4c18-9fae-757488cb25e2 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:29.321744 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-236677d9-5d79-4c18-9fae-757488cb25e2 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb8e090f8ae4a2381c9b82a8090f112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90112b6f3d31421a8ee18cbe7d6b0537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:29.333762 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-236677d9-5d79-4c18-9fae-757488cb25e2 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] 10.222.0.60 "GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167" status: 200 len: 1350 microversion: 2.1 time: 0.157449 Nov 23 13:19:29.334328 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 903/1811] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:19:29 2021] GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167 => generated 1350 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:19:29.350305 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-892a35f8-03d4-4e87-ab61-0c3f6745ba81 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:19:29.351486 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-892a35f8-03d4-4e87-ab61-0c3f6745ba81 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:19:29.363313 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-892a35f8-03d4-4e87-ab61-0c3f6745ba81 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:29.364040 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-892a35f8-03d4-4e87-ab61-0c3f6745ba81 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:29.365173 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-892a35f8-03d4-4e87-ab61-0c3f6745ba81 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:29.365626 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-892a35f8-03d4-4e87-ab61-0c3f6745ba81 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:29.486926 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-892a35f8-03d4-4e87-ab61-0c3f6745ba81 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:29.496537 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-892a35f8-03d4-4e87-ab61-0c3f6745ba81 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:29.498038 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-892a35f8-03d4-4e87-ab61-0c3f6745ba81 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:29.499209 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-892a35f8-03d4-4e87-ab61-0c3f6745ba81 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1443 microversion: 2.20 time: 0.154540 Nov 23 13:19:29.499764 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 909/1812] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:19:29 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1443 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:19:30.351376 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-77322e50-34ca-4e04-b8bd-b17984160076 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:19:30.351972 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-77322e50-34ca-4e04-b8bd-b17984160076 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] [instance: f6d81116-5b48-433f-8c7e-88f2a9687167] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:19:30.360419 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-77322e50-34ca-4e04-b8bd-b17984160076 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:30.360868 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-77322e50-34ca-4e04-b8bd-b17984160076 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:30.361644 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-77322e50-34ca-4e04-b8bd-b17984160076 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:30.362075 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-77322e50-34ca-4e04-b8bd-b17984160076 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:30.481488 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-77322e50-34ca-4e04-b8bd-b17984160076 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb8e090f8ae4a2381c9b82a8090f112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90112b6f3d31421a8ee18cbe7d6b0537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:30.494561 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-77322e50-34ca-4e04-b8bd-b17984160076 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] 10.222.0.60 "GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167" status: 200 len: 1350 microversion: 2.1 time: 0.147397 Nov 23 13:19:30.495123 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 904/1813] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:19:30 2021] GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167 => generated 1350 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:19:30.525638 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-a355c263-2144-4045-8f32-78fa1439c090 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:19:30.526275 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-a355c263-2144-4045-8f32-78fa1439c090 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:19:30.534230 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a355c263-2144-4045-8f32-78fa1439c090 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:30.534811 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a355c263-2144-4045-8f32-78fa1439c090 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:30.535650 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a355c263-2144-4045-8f32-78fa1439c090 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:30.536056 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a355c263-2144-4045-8f32-78fa1439c090 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:30.765199 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-a355c263-2144-4045-8f32-78fa1439c090 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:30.774959 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-a355c263-2144-4045-8f32-78fa1439c090 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:30.776593 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-a355c263-2144-4045-8f32-78fa1439c090 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:30.777777 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-a355c263-2144-4045-8f32-78fa1439c090 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1443 microversion: 2.20 time: 0.256486 Nov 23 13:19:30.778433 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 910/1814] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:19:30 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1443 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:19:31.519740 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-cc2c5231-de5e-4fd3-a516-84e665e5a909 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:19:31.520388 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-cc2c5231-de5e-4fd3-a516-84e665e5a909 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] [instance: f6d81116-5b48-433f-8c7e-88f2a9687167] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:19:31.528578 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-cc2c5231-de5e-4fd3-a516-84e665e5a909 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:31.529032 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-cc2c5231-de5e-4fd3-a516-84e665e5a909 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:31.529810 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-cc2c5231-de5e-4fd3-a516-84e665e5a909 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:31.530242 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-cc2c5231-de5e-4fd3-a516-84e665e5a909 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:31.649381 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-cc2c5231-de5e-4fd3-a516-84e665e5a909 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb8e090f8ae4a2381c9b82a8090f112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90112b6f3d31421a8ee18cbe7d6b0537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:31.662431 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-cc2c5231-de5e-4fd3-a516-84e665e5a909 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] 10.222.0.60 "GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167" status: 200 len: 1350 microversion: 2.1 time: 0.146327 Nov 23 13:19:31.663140 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 905/1815] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:19:31 2021] GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167 => generated 1350 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:19:31.797276 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-677ed0b6-3830-4c0d-a8f8-99ade629f8f7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:19:31.797904 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-677ed0b6-3830-4c0d-a8f8-99ade629f8f7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:19:31.805989 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-677ed0b6-3830-4c0d-a8f8-99ade629f8f7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:31.806449 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-677ed0b6-3830-4c0d-a8f8-99ade629f8f7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:31.807267 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-677ed0b6-3830-4c0d-a8f8-99ade629f8f7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:31.807702 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-677ed0b6-3830-4c0d-a8f8-99ade629f8f7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:31.925536 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-677ed0b6-3830-4c0d-a8f8-99ade629f8f7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:31.937897 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-677ed0b6-3830-4c0d-a8f8-99ade629f8f7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:31.939469 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-677ed0b6-3830-4c0d-a8f8-99ade629f8f7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:31.940519 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-677ed0b6-3830-4c0d-a8f8-99ade629f8f7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1443 microversion: 2.20 time: 0.147052 Nov 23 13:19:31.941079 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 911/1816] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:19:31 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1443 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:19:32.683047 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-247a76b1-22db-4b85-a562-5669c1de99c0 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:19:32.684210 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-247a76b1-22db-4b85-a562-5669c1de99c0 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] [instance: f6d81116-5b48-433f-8c7e-88f2a9687167] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:19:32.691626 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-247a76b1-22db-4b85-a562-5669c1de99c0 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:32.692067 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-247a76b1-22db-4b85-a562-5669c1de99c0 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:32.692851 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-247a76b1-22db-4b85-a562-5669c1de99c0 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:32.693302 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-247a76b1-22db-4b85-a562-5669c1de99c0 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:32.824566 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-247a76b1-22db-4b85-a562-5669c1de99c0 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb8e090f8ae4a2381c9b82a8090f112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90112b6f3d31421a8ee18cbe7d6b0537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:32.835165 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-247a76b1-22db-4b85-a562-5669c1de99c0 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] 10.222.0.60 "GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167" status: 200 len: 1350 microversion: 2.1 time: 0.155849 Nov 23 13:19:32.837791 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 906/1817] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:19:32 2021] GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167 => generated 1350 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:19:32.964541 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-45e93cd9-42f0-4404-b3af-b3e60d78dd16 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:19:32.965144 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-45e93cd9-42f0-4404-b3af-b3e60d78dd16 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:19:32.972964 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-45e93cd9-42f0-4404-b3af-b3e60d78dd16 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:32.973419 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-45e93cd9-42f0-4404-b3af-b3e60d78dd16 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:32.974194 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-45e93cd9-42f0-4404-b3af-b3e60d78dd16 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:32.974610 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-45e93cd9-42f0-4404-b3af-b3e60d78dd16 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:33.117227 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-45e93cd9-42f0-4404-b3af-b3e60d78dd16 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:33.132300 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-45e93cd9-42f0-4404-b3af-b3e60d78dd16 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:33.134696 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-45e93cd9-42f0-4404-b3af-b3e60d78dd16 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:33.136451 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-45e93cd9-42f0-4404-b3af-b3e60d78dd16 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1443 microversion: 2.20 time: 0.175764 Nov 23 13:19:33.137322 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 912/1818] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:19:32 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1443 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:19:33.856826 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-7e6104d6-ee10-4fe3-b1f4-df3c054918f0 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:19:33.858049 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-7e6104d6-ee10-4fe3-b1f4-df3c054918f0 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] [instance: f6d81116-5b48-433f-8c7e-88f2a9687167] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:19:33.872784 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-7e6104d6-ee10-4fe3-b1f4-df3c054918f0 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:33.873241 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-7e6104d6-ee10-4fe3-b1f4-df3c054918f0 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:33.874148 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-7e6104d6-ee10-4fe3-b1f4-df3c054918f0 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:33.874983 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-7e6104d6-ee10-4fe3-b1f4-df3c054918f0 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:34.006270 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-7e6104d6-ee10-4fe3-b1f4-df3c054918f0 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb8e090f8ae4a2381c9b82a8090f112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90112b6f3d31421a8ee18cbe7d6b0537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:34.016591 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-7e6104d6-ee10-4fe3-b1f4-df3c054918f0 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] 10.222.0.60 "GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167" status: 200 len: 1350 microversion: 2.1 time: 0.167096 Nov 23 13:19:34.017270 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 907/1819] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:19:33 2021] GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167 => generated 1350 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:19:34.326697 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-1604e05f-4c2c-4f1b-86bb-52d40e39b7e3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:19:34.327306 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-1604e05f-4c2c-4f1b-86bb-52d40e39b7e3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:19:34.335166 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1604e05f-4c2c-4f1b-86bb-52d40e39b7e3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:34.335612 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1604e05f-4c2c-4f1b-86bb-52d40e39b7e3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:34.336429 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1604e05f-4c2c-4f1b-86bb-52d40e39b7e3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:34.336861 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1604e05f-4c2c-4f1b-86bb-52d40e39b7e3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:34.465927 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-1604e05f-4c2c-4f1b-86bb-52d40e39b7e3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:34.482608 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-1604e05f-4c2c-4f1b-86bb-52d40e39b7e3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:34.484606 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-1604e05f-4c2c-4f1b-86bb-52d40e39b7e3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:34.485794 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-1604e05f-4c2c-4f1b-86bb-52d40e39b7e3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1443 microversion: 2.20 time: 0.326084 Nov 23 13:19:34.486344 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 913/1820] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:19:34 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1443 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:19:35.038184 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-776ce900-aa04-4f73-8785-b988f237a411 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:19:35.039478 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-776ce900-aa04-4f73-8785-b988f237a411 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] [instance: f6d81116-5b48-433f-8c7e-88f2a9687167] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:19:35.051582 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-776ce900-aa04-4f73-8785-b988f237a411 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:35.052267 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-776ce900-aa04-4f73-8785-b988f237a411 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:35.053624 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-776ce900-aa04-4f73-8785-b988f237a411 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:35.054270 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-776ce900-aa04-4f73-8785-b988f237a411 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:35.217737 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-776ce900-aa04-4f73-8785-b988f237a411 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb8e090f8ae4a2381c9b82a8090f112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90112b6f3d31421a8ee18cbe7d6b0537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:35.227146 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-776ce900-aa04-4f73-8785-b988f237a411 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] 10.222.0.60 "GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167" status: 200 len: 1350 microversion: 2.1 time: 0.195588 Nov 23 13:19:35.227728 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 908/1821] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:19:35 2021] GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167 => generated 1350 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:19:35.506989 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-b3db71fe-b07e-4de2-9f44-81b06ff4f67b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:19:35.507727 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-b3db71fe-b07e-4de2-9f44-81b06ff4f67b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:19:35.519554 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b3db71fe-b07e-4de2-9f44-81b06ff4f67b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:35.520363 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b3db71fe-b07e-4de2-9f44-81b06ff4f67b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:35.521729 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b3db71fe-b07e-4de2-9f44-81b06ff4f67b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:35.522471 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b3db71fe-b07e-4de2-9f44-81b06ff4f67b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:35.668998 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-b3db71fe-b07e-4de2-9f44-81b06ff4f67b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:35.678899 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-b3db71fe-b07e-4de2-9f44-81b06ff4f67b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:35.680440 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-b3db71fe-b07e-4de2-9f44-81b06ff4f67b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:35.681582 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-b3db71fe-b07e-4de2-9f44-81b06ff4f67b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1443 microversion: 2.20 time: 0.180733 Nov 23 13:19:35.682141 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 914/1822] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:19:35 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1443 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:19:36.245793 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-2f1d6384-cfd7-40bf-add2-96ffc1011a55 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:19:36.246553 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-2f1d6384-cfd7-40bf-add2-96ffc1011a55 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] [instance: f6d81116-5b48-433f-8c7e-88f2a9687167] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:19:36.254206 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-2f1d6384-cfd7-40bf-add2-96ffc1011a55 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:36.254725 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-2f1d6384-cfd7-40bf-add2-96ffc1011a55 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:36.255562 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-2f1d6384-cfd7-40bf-add2-96ffc1011a55 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:36.256028 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-2f1d6384-cfd7-40bf-add2-96ffc1011a55 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:36.383343 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-2f1d6384-cfd7-40bf-add2-96ffc1011a55 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb8e090f8ae4a2381c9b82a8090f112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90112b6f3d31421a8ee18cbe7d6b0537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:36.393786 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-2f1d6384-cfd7-40bf-add2-96ffc1011a55 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] 10.222.0.60 "GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167" status: 200 len: 1350 microversion: 2.1 time: 0.152035 Nov 23 13:19:36.394343 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 909/1823] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:19:36 2021] GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167 => generated 1350 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:19:36.702065 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-2c9bec30-1278-4997-b258-a70fa12b9e14 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:19:36.702756 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-2c9bec30-1278-4997-b258-a70fa12b9e14 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:19:36.714782 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2c9bec30-1278-4997-b258-a70fa12b9e14 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:36.715448 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2c9bec30-1278-4997-b258-a70fa12b9e14 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:36.716821 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2c9bec30-1278-4997-b258-a70fa12b9e14 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:36.717593 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2c9bec30-1278-4997-b258-a70fa12b9e14 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:36.844486 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-2c9bec30-1278-4997-b258-a70fa12b9e14 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:36.858069 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-2c9bec30-1278-4997-b258-a70fa12b9e14 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:36.861568 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-2c9bec30-1278-4997-b258-a70fa12b9e14 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:36.863453 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-2c9bec30-1278-4997-b258-a70fa12b9e14 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1443 microversion: 2.20 time: 0.165687 Nov 23 13:19:36.864368 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 915/1824] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:19:36 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1443 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 13:19:37.413201 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-3b627082-537f-46aa-a6f0-0129e527208c tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:19:37.413863 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-3b627082-537f-46aa-a6f0-0129e527208c tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] [instance: f6d81116-5b48-433f-8c7e-88f2a9687167] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:19:37.421608 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-3b627082-537f-46aa-a6f0-0129e527208c tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:37.422131 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-3b627082-537f-46aa-a6f0-0129e527208c tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:37.422957 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-3b627082-537f-46aa-a6f0-0129e527208c tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:37.423420 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-3b627082-537f-46aa-a6f0-0129e527208c tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:37.547176 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-3b627082-537f-46aa-a6f0-0129e527208c tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb8e090f8ae4a2381c9b82a8090f112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90112b6f3d31421a8ee18cbe7d6b0537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:37.558341 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-3b627082-537f-46aa-a6f0-0129e527208c tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] 10.222.0.60 "GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167" status: 200 len: 1350 microversion: 2.1 time: 0.149108 Nov 23 13:19:37.558963 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 910/1825] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:19:37 2021] GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167 => generated 1350 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:19:37.885844 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-09f5e783-e8aa-43fe-abe7-66516b63f8c9 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:19:37.886495 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-09f5e783-e8aa-43fe-abe7-66516b63f8c9 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:19:37.894326 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-09f5e783-e8aa-43fe-abe7-66516b63f8c9 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:37.894762 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-09f5e783-e8aa-43fe-abe7-66516b63f8c9 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:37.896031 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-09f5e783-e8aa-43fe-abe7-66516b63f8c9 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:37.896818 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-09f5e783-e8aa-43fe-abe7-66516b63f8c9 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:38.036936 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-09f5e783-e8aa-43fe-abe7-66516b63f8c9 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:38.052356 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-09f5e783-e8aa-43fe-abe7-66516b63f8c9 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:38.055187 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-09f5e783-e8aa-43fe-abe7-66516b63f8c9 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:38.056894 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-09f5e783-e8aa-43fe-abe7-66516b63f8c9 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1443 microversion: 2.20 time: 0.174997 Nov 23 13:19:38.057757 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 916/1826] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:19:37 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1443 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:19:38.579078 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-895bb6d6-1961-42a8-8629-1fe999bd38d9 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:19:38.580214 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-895bb6d6-1961-42a8-8629-1fe999bd38d9 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] [instance: f6d81116-5b48-433f-8c7e-88f2a9687167] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:19:38.591175 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-895bb6d6-1961-42a8-8629-1fe999bd38d9 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:38.591633 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-895bb6d6-1961-42a8-8629-1fe999bd38d9 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:38.592463 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-895bb6d6-1961-42a8-8629-1fe999bd38d9 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:38.592897 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-895bb6d6-1961-42a8-8629-1fe999bd38d9 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:38.717260 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-895bb6d6-1961-42a8-8629-1fe999bd38d9 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb8e090f8ae4a2381c9b82a8090f112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90112b6f3d31421a8ee18cbe7d6b0537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:38.726644 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-895bb6d6-1961-42a8-8629-1fe999bd38d9 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] 10.222.0.60 "GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167" status: 200 len: 1350 microversion: 2.1 time: 0.154291 Nov 23 13:19:38.727343 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 911/1827] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:19:38 2021] GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167 => generated 1350 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:19:39.083142 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-e99d0a8b-dac5-424a-8155-64d0a41496de tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:19:39.083794 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-e99d0a8b-dac5-424a-8155-64d0a41496de tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:19:39.092686 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e99d0a8b-dac5-424a-8155-64d0a41496de tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:39.093332 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e99d0a8b-dac5-424a-8155-64d0a41496de tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:39.094242 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e99d0a8b-dac5-424a-8155-64d0a41496de tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:39.094773 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e99d0a8b-dac5-424a-8155-64d0a41496de tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:39.224401 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-e99d0a8b-dac5-424a-8155-64d0a41496de tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:39.235302 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-e99d0a8b-dac5-424a-8155-64d0a41496de tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:39.237043 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-e99d0a8b-dac5-424a-8155-64d0a41496de tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:39.238443 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-e99d0a8b-dac5-424a-8155-64d0a41496de tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1443 microversion: 2.20 time: 0.160006 Nov 23 13:19:39.239077 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 917/1828] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:19:39 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1443 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:19:39.744556 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-a292297f-88dc-4373-9142-981ab64a2767 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:19:39.745237 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-a292297f-88dc-4373-9142-981ab64a2767 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] [instance: f6d81116-5b48-433f-8c7e-88f2a9687167] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:19:39.753378 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a292297f-88dc-4373-9142-981ab64a2767 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:39.753806 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a292297f-88dc-4373-9142-981ab64a2767 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:39.754583 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a292297f-88dc-4373-9142-981ab64a2767 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:39.755008 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a292297f-88dc-4373-9142-981ab64a2767 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:39.877505 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-a292297f-88dc-4373-9142-981ab64a2767 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb8e090f8ae4a2381c9b82a8090f112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90112b6f3d31421a8ee18cbe7d6b0537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:39.893208 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-a292297f-88dc-4373-9142-981ab64a2767 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] 10.222.0.60 "GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167" status: 200 len: 1350 microversion: 2.1 time: 0.152096 Nov 23 13:19:39.894030 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 912/1829] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:19:39 2021] GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167 => generated 1350 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:19:40.262238 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-5d7712dd-9593-4722-b725-0d3edc0c0641 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:19:40.262963 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-5d7712dd-9593-4722-b725-0d3edc0c0641 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:19:40.273797 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5d7712dd-9593-4722-b725-0d3edc0c0641 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:40.274521 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5d7712dd-9593-4722-b725-0d3edc0c0641 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:40.275753 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5d7712dd-9593-4722-b725-0d3edc0c0641 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:40.276629 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5d7712dd-9593-4722-b725-0d3edc0c0641 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:40.393287 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-5d7712dd-9593-4722-b725-0d3edc0c0641 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:40.403576 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-5d7712dd-9593-4722-b725-0d3edc0c0641 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:40.405114 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-5d7712dd-9593-4722-b725-0d3edc0c0641 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:40.406235 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-5d7712dd-9593-4722-b725-0d3edc0c0641 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1443 microversion: 2.20 time: 0.151327 Nov 23 13:19:40.406829 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 918/1830] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:19:40 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1443 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:19:40.921413 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-290edc98-e211-4a0a-8c26-3127d05215a0 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:19:40.922629 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-290edc98-e211-4a0a-8c26-3127d05215a0 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] [instance: f6d81116-5b48-433f-8c7e-88f2a9687167] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:19:40.933603 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-290edc98-e211-4a0a-8c26-3127d05215a0 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:40.934054 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-290edc98-e211-4a0a-8c26-3127d05215a0 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:40.934834 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-290edc98-e211-4a0a-8c26-3127d05215a0 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:40.935268 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-290edc98-e211-4a0a-8c26-3127d05215a0 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:41.059883 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-290edc98-e211-4a0a-8c26-3127d05215a0 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb8e090f8ae4a2381c9b82a8090f112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90112b6f3d31421a8ee18cbe7d6b0537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:41.072350 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-290edc98-e211-4a0a-8c26-3127d05215a0 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] 10.222.0.60 "GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167" status: 200 len: 1350 microversion: 2.1 time: 0.155889 Nov 23 13:19:41.073017 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 913/1831] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:19:40 2021] GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167 => generated 1350 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:19:41.428649 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-23579530-738d-440a-b45f-0e1edf125ff4 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:19:41.429592 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-23579530-738d-440a-b45f-0e1edf125ff4 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:19:41.440314 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-23579530-738d-440a-b45f-0e1edf125ff4 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:41.440833 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-23579530-738d-440a-b45f-0e1edf125ff4 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:41.441760 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-23579530-738d-440a-b45f-0e1edf125ff4 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:41.442377 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-23579530-738d-440a-b45f-0e1edf125ff4 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:41.600372 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-23579530-738d-440a-b45f-0e1edf125ff4 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:41.612008 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-23579530-738d-440a-b45f-0e1edf125ff4 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:41.613564 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-23579530-738d-440a-b45f-0e1edf125ff4 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:41.614753 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-23579530-738d-440a-b45f-0e1edf125ff4 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1443 microversion: 2.20 time: 0.191248 Nov 23 13:19:41.615322 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 919/1832] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:19:41 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1443 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 13:19:42.091971 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-1c8e2c51-0963-463d-824a-19904c1ccea4 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:19:42.092788 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-1c8e2c51-0963-463d-824a-19904c1ccea4 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] [instance: f6d81116-5b48-433f-8c7e-88f2a9687167] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:19:42.101435 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-1c8e2c51-0963-463d-824a-19904c1ccea4 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:42.101886 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-1c8e2c51-0963-463d-824a-19904c1ccea4 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:42.102842 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-1c8e2c51-0963-463d-824a-19904c1ccea4 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:42.103295 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-1c8e2c51-0963-463d-824a-19904c1ccea4 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:42.250424 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-1c8e2c51-0963-463d-824a-19904c1ccea4 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb8e090f8ae4a2381c9b82a8090f112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90112b6f3d31421a8ee18cbe7d6b0537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:42.260566 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-1c8e2c51-0963-463d-824a-19904c1ccea4 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] 10.222.0.60 "GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167" status: 200 len: 1350 microversion: 2.1 time: 0.172739 Nov 23 13:19:42.261322 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 914/1833] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:19:42 2021] GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167 => generated 1350 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:19:42.639914 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-caccb09f-bee5-4d09-9b1e-a8acd6fda141 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:19:42.640597 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-caccb09f-bee5-4d09-9b1e-a8acd6fda141 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:19:42.648219 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-caccb09f-bee5-4d09-9b1e-a8acd6fda141 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:42.648744 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-caccb09f-bee5-4d09-9b1e-a8acd6fda141 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:42.649466 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-caccb09f-bee5-4d09-9b1e-a8acd6fda141 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:42.649890 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-caccb09f-bee5-4d09-9b1e-a8acd6fda141 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:42.767490 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-caccb09f-bee5-4d09-9b1e-a8acd6fda141 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:42.781109 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-caccb09f-bee5-4d09-9b1e-a8acd6fda141 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:42.782591 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-caccb09f-bee5-4d09-9b1e-a8acd6fda141 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:42.783807 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-caccb09f-bee5-4d09-9b1e-a8acd6fda141 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1443 microversion: 2.20 time: 0.148474 Nov 23 13:19:42.784403 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 920/1834] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:19:42 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1443 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:19:43.279999 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-0dbdcc85-c4a6-481a-9b5b-db7d424d0b56 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:19:43.280634 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-0dbdcc85-c4a6-481a-9b5b-db7d424d0b56 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] [instance: f6d81116-5b48-433f-8c7e-88f2a9687167] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:19:43.288533 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0dbdcc85-c4a6-481a-9b5b-db7d424d0b56 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:43.288998 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0dbdcc85-c4a6-481a-9b5b-db7d424d0b56 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:43.289782 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0dbdcc85-c4a6-481a-9b5b-db7d424d0b56 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:43.290280 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0dbdcc85-c4a6-481a-9b5b-db7d424d0b56 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:43.408784 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-0dbdcc85-c4a6-481a-9b5b-db7d424d0b56 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb8e090f8ae4a2381c9b82a8090f112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90112b6f3d31421a8ee18cbe7d6b0537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:43.418309 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-0dbdcc85-c4a6-481a-9b5b-db7d424d0b56 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] 10.222.0.60 "GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167" status: 200 len: 1350 microversion: 2.1 time: 0.142347 Nov 23 13:19:43.418910 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 915/1835] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:19:43 2021] GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167 => generated 1350 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:19:43.803736 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-17c01a8b-4de1-4d96-90f1-9267fc6ad4da tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:19:43.804635 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-17c01a8b-4de1-4d96-90f1-9267fc6ad4da tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:19:43.812139 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-17c01a8b-4de1-4d96-90f1-9267fc6ad4da tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:43.812633 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-17c01a8b-4de1-4d96-90f1-9267fc6ad4da tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:43.813451 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-17c01a8b-4de1-4d96-90f1-9267fc6ad4da tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:43.813884 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-17c01a8b-4de1-4d96-90f1-9267fc6ad4da tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:43.932371 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-17c01a8b-4de1-4d96-90f1-9267fc6ad4da tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:43.947319 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-17c01a8b-4de1-4d96-90f1-9267fc6ad4da tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:43.949475 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-17c01a8b-4de1-4d96-90f1-9267fc6ad4da tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:43.950694 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-17c01a8b-4de1-4d96-90f1-9267fc6ad4da tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1443 microversion: 2.20 time: 0.151351 Nov 23 13:19:43.951278 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 921/1836] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:19:43 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1443 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:19:44.435180 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-46d995e7-a567-4dfd-8bec-782a776db901 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:19:44.435796 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-46d995e7-a567-4dfd-8bec-782a776db901 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] [instance: f6d81116-5b48-433f-8c7e-88f2a9687167] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:19:44.444195 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-46d995e7-a567-4dfd-8bec-782a776db901 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:44.444660 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-46d995e7-a567-4dfd-8bec-782a776db901 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:44.445438 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-46d995e7-a567-4dfd-8bec-782a776db901 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:44.445868 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-46d995e7-a567-4dfd-8bec-782a776db901 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:44.576582 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-46d995e7-a567-4dfd-8bec-782a776db901 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb8e090f8ae4a2381c9b82a8090f112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90112b6f3d31421a8ee18cbe7d6b0537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:44.587856 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-46d995e7-a567-4dfd-8bec-782a776db901 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] 10.222.0.60 "GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167" status: 200 len: 1350 microversion: 2.1 time: 0.156387 Nov 23 13:19:44.588721 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 916/1837] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:19:44 2021] GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167 => generated 1350 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:19:44.972007 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-5a2f4813-dea6-4d60-bf17-325c1f056f1d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:19:44.973141 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-5a2f4813-dea6-4d60-bf17-325c1f056f1d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:19:44.985382 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5a2f4813-dea6-4d60-bf17-325c1f056f1d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:44.985853 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5a2f4813-dea6-4d60-bf17-325c1f056f1d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:44.986645 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5a2f4813-dea6-4d60-bf17-325c1f056f1d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:44.987069 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5a2f4813-dea6-4d60-bf17-325c1f056f1d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:45.116921 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-5a2f4813-dea6-4d60-bf17-325c1f056f1d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:45.129865 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-5a2f4813-dea6-4d60-bf17-325c1f056f1d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:45.131669 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-5a2f4813-dea6-4d60-bf17-325c1f056f1d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:45.132875 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-5a2f4813-dea6-4d60-bf17-325c1f056f1d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1443 microversion: 2.20 time: 0.165333 Nov 23 13:19:45.133622 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 922/1838] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:19:44 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1443 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:19:45.606740 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-c62588fa-3a45-4e61-ab12-af65a4561615 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:19:45.607497 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-c62588fa-3a45-4e61-ab12-af65a4561615 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] [instance: f6d81116-5b48-433f-8c7e-88f2a9687167] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:19:45.616317 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c62588fa-3a45-4e61-ab12-af65a4561615 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:45.616788 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c62588fa-3a45-4e61-ab12-af65a4561615 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:45.617540 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c62588fa-3a45-4e61-ab12-af65a4561615 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:45.617991 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c62588fa-3a45-4e61-ab12-af65a4561615 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:45.743255 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-c62588fa-3a45-4e61-ab12-af65a4561615 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb8e090f8ae4a2381c9b82a8090f112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90112b6f3d31421a8ee18cbe7d6b0537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:45.755982 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-c62588fa-3a45-4e61-ab12-af65a4561615 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] 10.222.0.60 "GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167" status: 200 len: 1350 microversion: 2.1 time: 0.152863 Nov 23 13:19:45.756955 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 917/1839] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:19:45 2021] GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167 => generated 1350 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:19:46.155631 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-327bb577-a1a4-4516-920c-948f70c18545 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:19:46.156266 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-327bb577-a1a4-4516-920c-948f70c18545 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:19:46.164665 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-327bb577-a1a4-4516-920c-948f70c18545 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:46.165119 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-327bb577-a1a4-4516-920c-948f70c18545 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:46.165885 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-327bb577-a1a4-4516-920c-948f70c18545 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:46.166330 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-327bb577-a1a4-4516-920c-948f70c18545 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:46.289617 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-327bb577-a1a4-4516-920c-948f70c18545 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:46.300123 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-327bb577-a1a4-4516-920c-948f70c18545 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:46.301644 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-327bb577-a1a4-4516-920c-948f70c18545 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:46.303035 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-327bb577-a1a4-4516-920c-948f70c18545 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1443 microversion: 2.20 time: 0.151513 Nov 23 13:19:46.303334 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 923/1840] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:19:46 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1443 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:19:46.776043 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-3ceed80a-fa99-4f17-8f01-fb17dd7e166a tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:19:46.776892 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-3ceed80a-fa99-4f17-8f01-fb17dd7e166a tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] [instance: f6d81116-5b48-433f-8c7e-88f2a9687167] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:19:46.785145 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-3ceed80a-fa99-4f17-8f01-fb17dd7e166a tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:46.785582 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-3ceed80a-fa99-4f17-8f01-fb17dd7e166a tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:46.786348 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-3ceed80a-fa99-4f17-8f01-fb17dd7e166a tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:46.786768 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-3ceed80a-fa99-4f17-8f01-fb17dd7e166a tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:46.906588 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-3ceed80a-fa99-4f17-8f01-fb17dd7e166a tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb8e090f8ae4a2381c9b82a8090f112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90112b6f3d31421a8ee18cbe7d6b0537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:46.916609 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-3ceed80a-fa99-4f17-8f01-fb17dd7e166a tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] 10.222.0.60 "GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167" status: 200 len: 1350 microversion: 2.1 time: 0.144114 Nov 23 13:19:46.917193 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 918/1841] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:19:46 2021] GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167 => generated 1350 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:19:47.322812 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-b7fb48cc-f545-447f-89fd-4f5fea0b7f6a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:19:47.323600 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-b7fb48cc-f545-447f-89fd-4f5fea0b7f6a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:19:47.333450 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b7fb48cc-f545-447f-89fd-4f5fea0b7f6a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:47.333891 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b7fb48cc-f545-447f-89fd-4f5fea0b7f6a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:47.335073 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b7fb48cc-f545-447f-89fd-4f5fea0b7f6a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:47.335212 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b7fb48cc-f545-447f-89fd-4f5fea0b7f6a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:47.462507 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-b7fb48cc-f545-447f-89fd-4f5fea0b7f6a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:47.472604 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-b7fb48cc-f545-447f-89fd-4f5fea0b7f6a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:47.474134 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-b7fb48cc-f545-447f-89fd-4f5fea0b7f6a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:47.475228 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-b7fb48cc-f545-447f-89fd-4f5fea0b7f6a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1443 microversion: 2.20 time: 0.156597 Nov 23 13:19:47.475814 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 924/1842] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:19:47 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1443 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:19:47.934657 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-2a7fc8ca-4dde-4b14-8a8a-6e30753e79a6 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:19:47.935415 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-2a7fc8ca-4dde-4b14-8a8a-6e30753e79a6 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] [instance: f6d81116-5b48-433f-8c7e-88f2a9687167] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:19:47.943493 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-2a7fc8ca-4dde-4b14-8a8a-6e30753e79a6 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:47.943941 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-2a7fc8ca-4dde-4b14-8a8a-6e30753e79a6 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:47.944751 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-2a7fc8ca-4dde-4b14-8a8a-6e30753e79a6 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:47.945179 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-2a7fc8ca-4dde-4b14-8a8a-6e30753e79a6 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:48.069567 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-2a7fc8ca-4dde-4b14-8a8a-6e30753e79a6 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb8e090f8ae4a2381c9b82a8090f112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90112b6f3d31421a8ee18cbe7d6b0537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:48.079628 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-2a7fc8ca-4dde-4b14-8a8a-6e30753e79a6 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] 10.222.0.60 "GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167" status: 200 len: 1350 microversion: 2.1 time: 0.148793 Nov 23 13:19:48.080179 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 919/1843] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:19:47 2021] GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167 => generated 1350 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:19:48.495243 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-cdc936aa-5502-4fc6-8673-110fe945e1d1 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:19:48.495953 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-cdc936aa-5502-4fc6-8673-110fe945e1d1 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:19:48.503656 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-cdc936aa-5502-4fc6-8673-110fe945e1d1 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:48.504078 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-cdc936aa-5502-4fc6-8673-110fe945e1d1 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:48.504866 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-cdc936aa-5502-4fc6-8673-110fe945e1d1 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:48.505300 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-cdc936aa-5502-4fc6-8673-110fe945e1d1 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:48.629076 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-cdc936aa-5502-4fc6-8673-110fe945e1d1 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:48.638940 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-cdc936aa-5502-4fc6-8673-110fe945e1d1 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:48.640476 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-cdc936aa-5502-4fc6-8673-110fe945e1d1 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:48.641951 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-cdc936aa-5502-4fc6-8673-110fe945e1d1 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1443 microversion: 2.20 time: 0.150938 Nov 23 13:19:48.642506 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 925/1844] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:19:48 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1443 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:19:49.104477 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-ff7abf83-d615-4ba7-b063-a3b24140c8fa tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:19:49.105079 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-ff7abf83-d615-4ba7-b063-a3b24140c8fa tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] [instance: f6d81116-5b48-433f-8c7e-88f2a9687167] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:19:49.113443 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ff7abf83-d615-4ba7-b063-a3b24140c8fa tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:49.113821 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ff7abf83-d615-4ba7-b063-a3b24140c8fa tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:49.114598 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ff7abf83-d615-4ba7-b063-a3b24140c8fa tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:49.115053 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ff7abf83-d615-4ba7-b063-a3b24140c8fa tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:49.261189 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-ff7abf83-d615-4ba7-b063-a3b24140c8fa tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb8e090f8ae4a2381c9b82a8090f112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90112b6f3d31421a8ee18cbe7d6b0537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:49.270754 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-ff7abf83-d615-4ba7-b063-a3b24140c8fa tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] 10.222.0.60 "GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167" status: 200 len: 1350 microversion: 2.1 time: 0.170052 Nov 23 13:19:49.271495 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 920/1845] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:19:49 2021] GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167 => generated 1350 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:19:49.661213 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-4ff17612-b133-433f-a799-3d5a9381c22f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:19:49.661888 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-4ff17612-b133-433f-a799-3d5a9381c22f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:19:49.669786 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-4ff17612-b133-433f-a799-3d5a9381c22f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:49.670235 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-4ff17612-b133-433f-a799-3d5a9381c22f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:49.671010 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-4ff17612-b133-433f-a799-3d5a9381c22f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:49.671432 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-4ff17612-b133-433f-a799-3d5a9381c22f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:49.791124 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-4ff17612-b133-433f-a799-3d5a9381c22f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:49.801915 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-4ff17612-b133-433f-a799-3d5a9381c22f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:49.803393 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-4ff17612-b133-433f-a799-3d5a9381c22f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:49.804620 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-4ff17612-b133-433f-a799-3d5a9381c22f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1443 microversion: 2.20 time: 0.147509 Nov 23 13:19:49.805180 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 926/1846] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:19:49 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1443 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:19:50.287988 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-bb0168be-e1eb-4676-abfb-b1a049d07179 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:19:50.288618 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-bb0168be-e1eb-4676-abfb-b1a049d07179 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] [instance: f6d81116-5b48-433f-8c7e-88f2a9687167] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:19:50.296466 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-bb0168be-e1eb-4676-abfb-b1a049d07179 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:50.296911 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-bb0168be-e1eb-4676-abfb-b1a049d07179 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:50.297680 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-bb0168be-e1eb-4676-abfb-b1a049d07179 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:50.298186 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-bb0168be-e1eb-4676-abfb-b1a049d07179 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:50.572053 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-bb0168be-e1eb-4676-abfb-b1a049d07179 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb8e090f8ae4a2381c9b82a8090f112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90112b6f3d31421a8ee18cbe7d6b0537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:50.584660 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-bb0168be-e1eb-4676-abfb-b1a049d07179 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] 10.222.0.60 "GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167" status: 200 len: 1350 microversion: 2.1 time: 0.300413 Nov 23 13:19:50.585228 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 921/1847] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:19:50 2021] GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167 => generated 1350 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:19:50.824298 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-23851575-0efb-40da-9418-e28323fbc85b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:19:50.824956 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-23851575-0efb-40da-9418-e28323fbc85b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:19:50.833581 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-23851575-0efb-40da-9418-e28323fbc85b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:50.834032 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-23851575-0efb-40da-9418-e28323fbc85b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:50.834810 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-23851575-0efb-40da-9418-e28323fbc85b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:50.835253 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-23851575-0efb-40da-9418-e28323fbc85b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:50.952338 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-23851575-0efb-40da-9418-e28323fbc85b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:50.962872 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-23851575-0efb-40da-9418-e28323fbc85b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:50.964360 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-23851575-0efb-40da-9418-e28323fbc85b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:50.965495 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-23851575-0efb-40da-9418-e28323fbc85b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1443 microversion: 2.20 time: 0.146026 Nov 23 13:19:50.966055 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 927/1848] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:19:50 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1443 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:19:51.602808 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-bfb4a3e4-5303-4d77-a483-eaf401f78766 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:19:51.603453 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-bfb4a3e4-5303-4d77-a483-eaf401f78766 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] [instance: f6d81116-5b48-433f-8c7e-88f2a9687167] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:19:51.612015 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-bfb4a3e4-5303-4d77-a483-eaf401f78766 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:51.612509 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-bfb4a3e4-5303-4d77-a483-eaf401f78766 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:51.613306 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-bfb4a3e4-5303-4d77-a483-eaf401f78766 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:51.613734 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-bfb4a3e4-5303-4d77-a483-eaf401f78766 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:51.734577 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-bfb4a3e4-5303-4d77-a483-eaf401f78766 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb8e090f8ae4a2381c9b82a8090f112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90112b6f3d31421a8ee18cbe7d6b0537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:51.744607 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-bfb4a3e4-5303-4d77-a483-eaf401f78766 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] 10.222.0.60 "GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167" status: 200 len: 1350 microversion: 2.1 time: 0.145532 Nov 23 13:19:51.745191 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 922/1849] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:19:51 2021] GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167 => generated 1350 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:19:51.985322 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-e2ed3dd7-e07c-4479-a776-7778af275b72 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:19:51.986594 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-e2ed3dd7-e07c-4479-a776-7778af275b72 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:19:51.994926 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e2ed3dd7-e07c-4479-a776-7778af275b72 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:51.995371 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e2ed3dd7-e07c-4479-a776-7778af275b72 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:51.996168 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e2ed3dd7-e07c-4479-a776-7778af275b72 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:51.996625 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e2ed3dd7-e07c-4479-a776-7778af275b72 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:52.120212 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-e2ed3dd7-e07c-4479-a776-7778af275b72 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:52.131058 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-e2ed3dd7-e07c-4479-a776-7778af275b72 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:52.132596 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-e2ed3dd7-e07c-4479-a776-7778af275b72 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:52.133751 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-e2ed3dd7-e07c-4479-a776-7778af275b72 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1443 microversion: 2.20 time: 0.152754 Nov 23 13:19:52.134327 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 928/1850] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:19:51 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1443 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:19:52.763024 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-c0d64dec-0d58-4c86-aa96-0168a41db18e tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:19:52.763703 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-c0d64dec-0d58-4c86-aa96-0168a41db18e tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] [instance: f6d81116-5b48-433f-8c7e-88f2a9687167] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:19:52.771899 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c0d64dec-0d58-4c86-aa96-0168a41db18e tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:52.772488 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c0d64dec-0d58-4c86-aa96-0168a41db18e tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:52.773121 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c0d64dec-0d58-4c86-aa96-0168a41db18e tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:52.773547 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c0d64dec-0d58-4c86-aa96-0168a41db18e tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:52.891904 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-c0d64dec-0d58-4c86-aa96-0168a41db18e tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb8e090f8ae4a2381c9b82a8090f112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90112b6f3d31421a8ee18cbe7d6b0537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:52.901522 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-c0d64dec-0d58-4c86-aa96-0168a41db18e tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] 10.222.0.60 "GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167" status: 200 len: 1350 microversion: 2.1 time: 0.142345 Nov 23 13:19:52.902092 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 923/1851] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:19:52 2021] GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167 => generated 1350 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:19:53.153373 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-c53c10a4-b5ce-4b3c-9a68-394f28032649 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:19:53.154002 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-c53c10a4-b5ce-4b3c-9a68-394f28032649 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:19:53.162244 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c53c10a4-b5ce-4b3c-9a68-394f28032649 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:53.162693 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c53c10a4-b5ce-4b3c-9a68-394f28032649 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:53.163538 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c53c10a4-b5ce-4b3c-9a68-394f28032649 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:53.164167 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c53c10a4-b5ce-4b3c-9a68-394f28032649 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:53.280262 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-c53c10a4-b5ce-4b3c-9a68-394f28032649 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:53.290494 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-c53c10a4-b5ce-4b3c-9a68-394f28032649 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:53.291963 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-c53c10a4-b5ce-4b3c-9a68-394f28032649 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:53.293099 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-c53c10a4-b5ce-4b3c-9a68-394f28032649 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1443 microversion: 2.20 time: 0.143643 Nov 23 13:19:53.293678 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 929/1852] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:19:53 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1443 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:19:53.919268 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-0ef1f9ae-1526-436f-9625-150780b11b51 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:19:53.919903 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-0ef1f9ae-1526-436f-9625-150780b11b51 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] [instance: f6d81116-5b48-433f-8c7e-88f2a9687167] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:19:53.928542 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0ef1f9ae-1526-436f-9625-150780b11b51 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:53.929013 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0ef1f9ae-1526-436f-9625-150780b11b51 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:53.929899 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0ef1f9ae-1526-436f-9625-150780b11b51 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:53.930345 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0ef1f9ae-1526-436f-9625-150780b11b51 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:54.046127 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-0ef1f9ae-1526-436f-9625-150780b11b51 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb8e090f8ae4a2381c9b82a8090f112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90112b6f3d31421a8ee18cbe7d6b0537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:54.056334 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-0ef1f9ae-1526-436f-9625-150780b11b51 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] 10.222.0.60 "GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167" status: 200 len: 1350 microversion: 2.1 time: 0.140872 Nov 23 13:19:54.056924 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 924/1853] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:19:53 2021] GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167 => generated 1350 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:19:54.311952 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-c7d59ecf-6ba2-47c4-abfb-2e8672a2a219 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:19:54.312643 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-c7d59ecf-6ba2-47c4-abfb-2e8672a2a219 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:19:54.322008 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c7d59ecf-6ba2-47c4-abfb-2e8672a2a219 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:54.322448 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c7d59ecf-6ba2-47c4-abfb-2e8672a2a219 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:54.323270 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c7d59ecf-6ba2-47c4-abfb-2e8672a2a219 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:54.323722 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c7d59ecf-6ba2-47c4-abfb-2e8672a2a219 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:54.442620 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-c7d59ecf-6ba2-47c4-abfb-2e8672a2a219 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:54.459134 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-c7d59ecf-6ba2-47c4-abfb-2e8672a2a219 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:54.461752 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-c7d59ecf-6ba2-47c4-abfb-2e8672a2a219 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:54.463669 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-c7d59ecf-6ba2-47c4-abfb-2e8672a2a219 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1443 microversion: 2.20 time: 0.155327 Nov 23 13:19:54.464495 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 930/1854] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:19:54 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1443 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:19:55.076621 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-4dfd3508-f265-4596-9e98-27aad0eb809c tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:19:55.077543 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-4dfd3508-f265-4596-9e98-27aad0eb809c tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] [instance: f6d81116-5b48-433f-8c7e-88f2a9687167] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:19:55.087177 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4dfd3508-f265-4596-9e98-27aad0eb809c tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:55.087615 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4dfd3508-f265-4596-9e98-27aad0eb809c tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:55.088434 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4dfd3508-f265-4596-9e98-27aad0eb809c tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:55.088863 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4dfd3508-f265-4596-9e98-27aad0eb809c tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:55.317253 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-4dfd3508-f265-4596-9e98-27aad0eb809c tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb8e090f8ae4a2381c9b82a8090f112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90112b6f3d31421a8ee18cbe7d6b0537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:55.328309 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-4dfd3508-f265-4596-9e98-27aad0eb809c tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] 10.222.0.60 "GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167" status: 200 len: 1350 microversion: 2.1 time: 0.257248 Nov 23 13:19:55.328970 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 925/1855] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:19:55 2021] GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167 => generated 1350 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 13:19:55.483025 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-b2eea6b3-9c90-48ab-b40f-85f3ea3253ee tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:19:55.484315 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-b2eea6b3-9c90-48ab-b40f-85f3ea3253ee tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:19:55.492465 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b2eea6b3-9c90-48ab-b40f-85f3ea3253ee tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:55.492934 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b2eea6b3-9c90-48ab-b40f-85f3ea3253ee tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:55.493738 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b2eea6b3-9c90-48ab-b40f-85f3ea3253ee tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:55.494194 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b2eea6b3-9c90-48ab-b40f-85f3ea3253ee tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:55.621967 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-b2eea6b3-9c90-48ab-b40f-85f3ea3253ee tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:55.633699 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-b2eea6b3-9c90-48ab-b40f-85f3ea3253ee tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:55.635179 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-b2eea6b3-9c90-48ab-b40f-85f3ea3253ee tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:55.636328 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-b2eea6b3-9c90-48ab-b40f-85f3ea3253ee tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1443 microversion: 2.20 time: 0.157429 Nov 23 13:19:55.636920 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 931/1856] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:19:55 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1443 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:19:56.352877 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-d7a4edb2-9055-43f5-8686-de8e8c48b0d0 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:19:56.353803 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-d7a4edb2-9055-43f5-8686-de8e8c48b0d0 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] [instance: f6d81116-5b48-433f-8c7e-88f2a9687167] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:19:56.366393 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d7a4edb2-9055-43f5-8686-de8e8c48b0d0 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:56.367112 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d7a4edb2-9055-43f5-8686-de8e8c48b0d0 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:56.368320 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d7a4edb2-9055-43f5-8686-de8e8c48b0d0 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:56.369037 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d7a4edb2-9055-43f5-8686-de8e8c48b0d0 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:56.524183 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-d7a4edb2-9055-43f5-8686-de8e8c48b0d0 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb8e090f8ae4a2381c9b82a8090f112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90112b6f3d31421a8ee18cbe7d6b0537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:56.537482 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-d7a4edb2-9055-43f5-8686-de8e8c48b0d0 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] 10.222.0.60 "GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167" status: 200 len: 1350 microversion: 2.1 time: 0.190600 Nov 23 13:19:56.538393 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 926/1857] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:19:56 2021] GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167 => generated 1350 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:19:56.661047 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-de0f9144-80ed-4d4b-ab76-1d4df63aa4d0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:19:56.661812 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-de0f9144-80ed-4d4b-ab76-1d4df63aa4d0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:19:56.669230 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-de0f9144-80ed-4d4b-ab76-1d4df63aa4d0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:56.669669 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-de0f9144-80ed-4d4b-ab76-1d4df63aa4d0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:56.670430 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-de0f9144-80ed-4d4b-ab76-1d4df63aa4d0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:56.670858 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-de0f9144-80ed-4d4b-ab76-1d4df63aa4d0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:56.792679 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-de0f9144-80ed-4d4b-ab76-1d4df63aa4d0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:56.802430 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-de0f9144-80ed-4d4b-ab76-1d4df63aa4d0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:56.804039 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-de0f9144-80ed-4d4b-ab76-1d4df63aa4d0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:56.805255 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-de0f9144-80ed-4d4b-ab76-1d4df63aa4d0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1443 microversion: 2.20 time: 0.148188 Nov 23 13:19:56.805852 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 932/1858] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:19:56 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1443 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:19:57.554840 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-6693af2a-1e02-450c-9d89-1d8aa3638f55 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:19:57.555998 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-6693af2a-1e02-450c-9d89-1d8aa3638f55 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] [instance: f6d81116-5b48-433f-8c7e-88f2a9687167] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:19:57.563434 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6693af2a-1e02-450c-9d89-1d8aa3638f55 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:57.563861 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6693af2a-1e02-450c-9d89-1d8aa3638f55 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:57.564690 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6693af2a-1e02-450c-9d89-1d8aa3638f55 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:57.565449 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6693af2a-1e02-450c-9d89-1d8aa3638f55 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:57.689248 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-6693af2a-1e02-450c-9d89-1d8aa3638f55 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb8e090f8ae4a2381c9b82a8090f112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90112b6f3d31421a8ee18cbe7d6b0537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:57.698906 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-6693af2a-1e02-450c-9d89-1d8aa3638f55 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] 10.222.0.60 "GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167" status: 200 len: 1350 microversion: 2.1 time: 0.147880 Nov 23 13:19:57.699489 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 927/1859] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:19:57 2021] GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167 => generated 1350 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:19:57.823767 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-ebb7bff9-1b18-47c4-9054-b365317a3544 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:19:57.824447 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-ebb7bff9-1b18-47c4-9054-b365317a3544 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:19:57.833524 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ebb7bff9-1b18-47c4-9054-b365317a3544 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:57.834162 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ebb7bff9-1b18-47c4-9054-b365317a3544 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:57.835824 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ebb7bff9-1b18-47c4-9054-b365317a3544 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:57.836463 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ebb7bff9-1b18-47c4-9054-b365317a3544 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:57.958026 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-ebb7bff9-1b18-47c4-9054-b365317a3544 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:57.968785 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-ebb7bff9-1b18-47c4-9054-b365317a3544 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:57.970287 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-ebb7bff9-1b18-47c4-9054-b365317a3544 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:57.971472 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-ebb7bff9-1b18-47c4-9054-b365317a3544 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1443 microversion: 2.20 time: 0.151657 Nov 23 13:19:57.972155 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 933/1860] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:19:57 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1443 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:19:58.720182 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-82e84d7a-6260-4959-9fdd-a84edf582909 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:19:58.721166 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-82e84d7a-6260-4959-9fdd-a84edf582909 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] [instance: f6d81116-5b48-433f-8c7e-88f2a9687167] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:19:58.732067 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-82e84d7a-6260-4959-9fdd-a84edf582909 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:58.732588 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-82e84d7a-6260-4959-9fdd-a84edf582909 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:58.733392 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-82e84d7a-6260-4959-9fdd-a84edf582909 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:58.734120 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-82e84d7a-6260-4959-9fdd-a84edf582909 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:58.882741 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-82e84d7a-6260-4959-9fdd-a84edf582909 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb8e090f8ae4a2381c9b82a8090f112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90112b6f3d31421a8ee18cbe7d6b0537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:58.897114 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-82e84d7a-6260-4959-9fdd-a84edf582909 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] 10.222.0.60 "GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167" status: 200 len: 1350 microversion: 2.1 time: 0.183241 Nov 23 13:19:58.897775 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 928/1861] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:19:58 2021] GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167 => generated 1350 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:19:58.993202 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-67e9b6b2-6e2f-482d-b73d-cb81f506884a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:19:58.994115 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-67e9b6b2-6e2f-482d-b73d-cb81f506884a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:19:59.006100 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-67e9b6b2-6e2f-482d-b73d-cb81f506884a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:59.006893 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-67e9b6b2-6e2f-482d-b73d-cb81f506884a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:59.008372 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-67e9b6b2-6e2f-482d-b73d-cb81f506884a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:59.008857 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-67e9b6b2-6e2f-482d-b73d-cb81f506884a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:59.193023 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-67e9b6b2-6e2f-482d-b73d-cb81f506884a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:59.204722 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-67e9b6b2-6e2f-482d-b73d-cb81f506884a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:59.206904 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-67e9b6b2-6e2f-482d-b73d-cb81f506884a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:19:59.208368 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-67e9b6b2-6e2f-482d-b73d-cb81f506884a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1443 microversion: 2.20 time: 0.221303 Nov 23 13:19:59.208913 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 934/1862] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:19:58 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1443 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:19:59.915178 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-682520ac-2d89-4145-9087-91e2e95bf170 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:19:59.915864 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-682520ac-2d89-4145-9087-91e2e95bf170 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] [instance: f6d81116-5b48-433f-8c7e-88f2a9687167] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:19:59.928005 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-682520ac-2d89-4145-9087-91e2e95bf170 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:59.930463 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-682520ac-2d89-4145-9087-91e2e95bf170 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:19:59.931050 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-682520ac-2d89-4145-9087-91e2e95bf170 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:19:59.931762 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-682520ac-2d89-4145-9087-91e2e95bf170 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:00.062973 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-682520ac-2d89-4145-9087-91e2e95bf170 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb8e090f8ae4a2381c9b82a8090f112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90112b6f3d31421a8ee18cbe7d6b0537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:00.074414 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-682520ac-2d89-4145-9087-91e2e95bf170 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] 10.222.0.60 "GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167" status: 200 len: 1350 microversion: 2.1 time: 0.162970 Nov 23 13:20:00.074987 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 929/1863] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:19:59 2021] GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167 => generated 1350 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:20:00.235702 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-ae0773cf-29c6-4b2b-bfd7-9d7741fe068a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:20:00.236466 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-ae0773cf-29c6-4b2b-bfd7-9d7741fe068a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:20:00.249634 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ae0773cf-29c6-4b2b-bfd7-9d7741fe068a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:00.250135 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ae0773cf-29c6-4b2b-bfd7-9d7741fe068a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:00.250984 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ae0773cf-29c6-4b2b-bfd7-9d7741fe068a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:00.251393 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ae0773cf-29c6-4b2b-bfd7-9d7741fe068a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:00.370803 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-ae0773cf-29c6-4b2b-bfd7-9d7741fe068a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:00.382726 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-ae0773cf-29c6-4b2b-bfd7-9d7741fe068a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:00.384518 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-ae0773cf-29c6-4b2b-bfd7-9d7741fe068a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:00.385758 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-ae0773cf-29c6-4b2b-bfd7-9d7741fe068a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1443 microversion: 2.20 time: 0.156408 Nov 23 13:20:00.386409 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 935/1864] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:20:00 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1443 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:20:01.093869 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-d16358c9-1b7d-4c7e-b883-42c347c41a74 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:20:01.094842 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-d16358c9-1b7d-4c7e-b883-42c347c41a74 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] [instance: f6d81116-5b48-433f-8c7e-88f2a9687167] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:20:01.106398 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d16358c9-1b7d-4c7e-b883-42c347c41a74 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:01.107099 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d16358c9-1b7d-4c7e-b883-42c347c41a74 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:01.108776 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d16358c9-1b7d-4c7e-b883-42c347c41a74 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:01.109481 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d16358c9-1b7d-4c7e-b883-42c347c41a74 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:01.260076 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-d16358c9-1b7d-4c7e-b883-42c347c41a74 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb8e090f8ae4a2381c9b82a8090f112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90112b6f3d31421a8ee18cbe7d6b0537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:01.274687 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-d16358c9-1b7d-4c7e-b883-42c347c41a74 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] 10.222.0.60 "GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167" status: 200 len: 1350 microversion: 2.1 time: 0.185712 Nov 23 13:20:01.275703 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 930/1865] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:20:01 2021] GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167 => generated 1350 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:20:01.406308 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-e864716d-7697-4f49-b16f-44723b44bacc tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:20:01.407078 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-e864716d-7697-4f49-b16f-44723b44bacc tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:20:01.415020 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e864716d-7697-4f49-b16f-44723b44bacc tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:01.415466 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e864716d-7697-4f49-b16f-44723b44bacc tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:01.416292 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e864716d-7697-4f49-b16f-44723b44bacc tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:01.416709 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e864716d-7697-4f49-b16f-44723b44bacc tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:01.537963 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-e864716d-7697-4f49-b16f-44723b44bacc tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:01.547717 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-e864716d-7697-4f49-b16f-44723b44bacc tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:01.549481 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-e864716d-7697-4f49-b16f-44723b44bacc tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:01.550648 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-e864716d-7697-4f49-b16f-44723b44bacc tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1443 microversion: 2.20 time: 0.149765 Nov 23 13:20:01.551521 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 936/1866] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:20:01 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1443 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:20:02.299859 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-d8ef4b56-5aad-4627-b900-cda5c4933653 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:20:02.300752 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-d8ef4b56-5aad-4627-b900-cda5c4933653 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] [instance: f6d81116-5b48-433f-8c7e-88f2a9687167] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:20:02.309355 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d8ef4b56-5aad-4627-b900-cda5c4933653 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:02.309974 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d8ef4b56-5aad-4627-b900-cda5c4933653 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:02.310848 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d8ef4b56-5aad-4627-b900-cda5c4933653 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:02.311272 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d8ef4b56-5aad-4627-b900-cda5c4933653 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:02.434166 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-d8ef4b56-5aad-4627-b900-cda5c4933653 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb8e090f8ae4a2381c9b82a8090f112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90112b6f3d31421a8ee18cbe7d6b0537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:02.443734 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-d8ef4b56-5aad-4627-b900-cda5c4933653 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] 10.222.0.60 "GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167" status: 200 len: 1350 microversion: 2.1 time: 0.147629 Nov 23 13:20:02.444442 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 931/1867] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:20:02 2021] GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167 => generated 1350 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:20:02.572305 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-dad1dc6c-aa8d-49df-863c-b470747c3f8a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:20:02.573085 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-dad1dc6c-aa8d-49df-863c-b470747c3f8a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:20:02.580792 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-dad1dc6c-aa8d-49df-863c-b470747c3f8a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:02.581244 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-dad1dc6c-aa8d-49df-863c-b470747c3f8a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:02.582028 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-dad1dc6c-aa8d-49df-863c-b470747c3f8a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:02.582459 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-dad1dc6c-aa8d-49df-863c-b470747c3f8a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:02.701640 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-dad1dc6c-aa8d-49df-863c-b470747c3f8a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:02.712824 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-dad1dc6c-aa8d-49df-863c-b470747c3f8a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:02.714384 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-dad1dc6c-aa8d-49df-863c-b470747c3f8a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:02.715564 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-dad1dc6c-aa8d-49df-863c-b470747c3f8a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1443 microversion: 2.20 time: 0.148585 Nov 23 13:20:02.716142 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 937/1868] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:20:02 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1443 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:20:03.461288 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-8a307999-c11c-44ae-b54c-5e6e270a09cf tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:20:03.462031 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-8a307999-c11c-44ae-b54c-5e6e270a09cf tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] [instance: f6d81116-5b48-433f-8c7e-88f2a9687167] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:20:03.470056 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8a307999-c11c-44ae-b54c-5e6e270a09cf tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:03.470520 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8a307999-c11c-44ae-b54c-5e6e270a09cf tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:03.471284 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8a307999-c11c-44ae-b54c-5e6e270a09cf tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:03.471704 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8a307999-c11c-44ae-b54c-5e6e270a09cf tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:03.589510 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-8a307999-c11c-44ae-b54c-5e6e270a09cf tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb8e090f8ae4a2381c9b82a8090f112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90112b6f3d31421a8ee18cbe7d6b0537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:03.598538 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-8a307999-c11c-44ae-b54c-5e6e270a09cf tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] 10.222.0.60 "GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167" status: 200 len: 1350 microversion: 2.1 time: 0.141124 Nov 23 13:20:03.599099 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 932/1869] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:20:03 2021] GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167 => generated 1350 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:20:03.735052 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-00fc882e-fc0d-4fe1-9b01-85d5332d8bbd tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:20:03.735687 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-00fc882e-fc0d-4fe1-9b01-85d5332d8bbd tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:20:03.743860 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-00fc882e-fc0d-4fe1-9b01-85d5332d8bbd tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:03.744338 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-00fc882e-fc0d-4fe1-9b01-85d5332d8bbd tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:03.745121 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-00fc882e-fc0d-4fe1-9b01-85d5332d8bbd tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:03.745552 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-00fc882e-fc0d-4fe1-9b01-85d5332d8bbd tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:03.860561 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-00fc882e-fc0d-4fe1-9b01-85d5332d8bbd tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:03.870538 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-00fc882e-fc0d-4fe1-9b01-85d5332d8bbd tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:03.872027 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-00fc882e-fc0d-4fe1-9b01-85d5332d8bbd tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:03.873198 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-00fc882e-fc0d-4fe1-9b01-85d5332d8bbd tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1443 microversion: 2.20 time: 0.142500 Nov 23 13:20:03.873740 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 938/1870] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:20:03 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1443 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:20:04.617124 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-596ffa23-a98c-44a1-adc4-b7115c48331a tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:20:04.617781 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-596ffa23-a98c-44a1-adc4-b7115c48331a tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] [instance: f6d81116-5b48-433f-8c7e-88f2a9687167] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:20:04.625577 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-596ffa23-a98c-44a1-adc4-b7115c48331a tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:04.626027 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-596ffa23-a98c-44a1-adc4-b7115c48331a tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:04.626797 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-596ffa23-a98c-44a1-adc4-b7115c48331a tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:04.627228 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-596ffa23-a98c-44a1-adc4-b7115c48331a tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:04.754519 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-596ffa23-a98c-44a1-adc4-b7115c48331a tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb8e090f8ae4a2381c9b82a8090f112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90112b6f3d31421a8ee18cbe7d6b0537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:04.764342 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-596ffa23-a98c-44a1-adc4-b7115c48331a tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] 10.222.0.60 "GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167" status: 200 len: 1350 microversion: 2.1 time: 0.151236 Nov 23 13:20:04.764939 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 933/1871] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:20:04 2021] GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167 => generated 1350 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:20:04.891084 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-d1777f17-2860-4616-a788-2d9b4b182b0c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:20:04.891619 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-d1777f17-2860-4616-a788-2d9b4b182b0c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:20:04.899403 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d1777f17-2860-4616-a788-2d9b4b182b0c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:04.899850 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d1777f17-2860-4616-a788-2d9b4b182b0c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:04.900645 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d1777f17-2860-4616-a788-2d9b4b182b0c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:04.901079 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d1777f17-2860-4616-a788-2d9b4b182b0c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:05.023984 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-d1777f17-2860-4616-a788-2d9b4b182b0c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:05.033722 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-d1777f17-2860-4616-a788-2d9b4b182b0c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:05.035204 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-d1777f17-2860-4616-a788-2d9b4b182b0c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:05.036350 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-d1777f17-2860-4616-a788-2d9b4b182b0c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1443 microversion: 2.20 time: 0.149131 Nov 23 13:20:05.036924 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 939/1872] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:20:04 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1443 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:20:05.781935 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-22946023-5866-4c91-941d-6729b6801713 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:20:05.782638 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-22946023-5866-4c91-941d-6729b6801713 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] [instance: f6d81116-5b48-433f-8c7e-88f2a9687167] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:20:05.790544 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-22946023-5866-4c91-941d-6729b6801713 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:05.790982 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-22946023-5866-4c91-941d-6729b6801713 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:05.791739 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-22946023-5866-4c91-941d-6729b6801713 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:05.792192 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-22946023-5866-4c91-941d-6729b6801713 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:05.910827 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-22946023-5866-4c91-941d-6729b6801713 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb8e090f8ae4a2381c9b82a8090f112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90112b6f3d31421a8ee18cbe7d6b0537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:05.920147 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-22946023-5866-4c91-941d-6729b6801713 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] 10.222.0.60 "GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167" status: 200 len: 1350 microversion: 2.1 time: 0.141933 Nov 23 13:20:05.920761 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 934/1873] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:20:05 2021] GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167 => generated 1350 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:20:06.055709 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-f4241c33-c8cb-46de-99d9-858684866e7c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:20:06.056346 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-f4241c33-c8cb-46de-99d9-858684866e7c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:20:06.064419 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f4241c33-c8cb-46de-99d9-858684866e7c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:06.064887 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f4241c33-c8cb-46de-99d9-858684866e7c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:06.065673 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f4241c33-c8cb-46de-99d9-858684866e7c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:06.066107 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f4241c33-c8cb-46de-99d9-858684866e7c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:06.192704 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-f4241c33-c8cb-46de-99d9-858684866e7c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:06.203031 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-f4241c33-c8cb-46de-99d9-858684866e7c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:06.204578 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-f4241c33-c8cb-46de-99d9-858684866e7c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:06.205704 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-f4241c33-c8cb-46de-99d9-858684866e7c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1443 microversion: 2.20 time: 0.154659 Nov 23 13:20:06.206268 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 940/1874] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:20:06 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1443 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:20:06.938743 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-6d992f0a-c140-4504-8df2-bcda99d824b8 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:20:06.939409 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-6d992f0a-c140-4504-8df2-bcda99d824b8 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] [instance: f6d81116-5b48-433f-8c7e-88f2a9687167] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:20:06.947437 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6d992f0a-c140-4504-8df2-bcda99d824b8 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:06.947879 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6d992f0a-c140-4504-8df2-bcda99d824b8 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:06.948678 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6d992f0a-c140-4504-8df2-bcda99d824b8 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:06.949104 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6d992f0a-c140-4504-8df2-bcda99d824b8 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:07.065943 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-6d992f0a-c140-4504-8df2-bcda99d824b8 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb8e090f8ae4a2381c9b82a8090f112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90112b6f3d31421a8ee18cbe7d6b0537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:07.075125 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-6d992f0a-c140-4504-8df2-bcda99d824b8 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] 10.222.0.60 "GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167" status: 200 len: 1350 microversion: 2.1 time: 0.140168 Nov 23 13:20:07.075700 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 935/1875] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:20:06 2021] GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167 => generated 1350 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:20:07.225177 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-5263c487-e29e-4a9e-ae6a-8001f96049a7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:20:07.225827 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-5263c487-e29e-4a9e-ae6a-8001f96049a7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:20:07.233850 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5263c487-e29e-4a9e-ae6a-8001f96049a7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:07.234288 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5263c487-e29e-4a9e-ae6a-8001f96049a7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:07.235067 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5263c487-e29e-4a9e-ae6a-8001f96049a7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:07.235495 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5263c487-e29e-4a9e-ae6a-8001f96049a7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:07.350163 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-5263c487-e29e-4a9e-ae6a-8001f96049a7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:07.360268 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-5263c487-e29e-4a9e-ae6a-8001f96049a7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:07.361753 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-5263c487-e29e-4a9e-ae6a-8001f96049a7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:07.362849 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-5263c487-e29e-4a9e-ae6a-8001f96049a7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1443 microversion: 2.20 time: 0.141656 Nov 23 13:20:07.363408 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 941/1876] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:20:07 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1443 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:20:08.092252 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-cef807ec-3b20-412f-a5c7-a96a6cdf0bd0 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:20:08.092885 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-cef807ec-3b20-412f-a5c7-a96a6cdf0bd0 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] [instance: f6d81116-5b48-433f-8c7e-88f2a9687167] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:20:08.100763 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-cef807ec-3b20-412f-a5c7-a96a6cdf0bd0 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:08.101124 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-cef807ec-3b20-412f-a5c7-a96a6cdf0bd0 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:08.101939 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-cef807ec-3b20-412f-a5c7-a96a6cdf0bd0 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:08.102368 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-cef807ec-3b20-412f-a5c7-a96a6cdf0bd0 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:08.216670 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-cef807ec-3b20-412f-a5c7-a96a6cdf0bd0 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb8e090f8ae4a2381c9b82a8090f112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90112b6f3d31421a8ee18cbe7d6b0537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:08.226315 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-cef807ec-3b20-412f-a5c7-a96a6cdf0bd0 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] 10.222.0.60 "GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167" status: 200 len: 1350 microversion: 2.1 time: 0.137719 Nov 23 13:20:08.226895 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 936/1877] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:20:08 2021] GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167 => generated 1350 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:20:08.382788 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-daecfccf-790e-448e-89d5-fa1c591f3cf0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:20:08.383470 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-daecfccf-790e-448e-89d5-fa1c591f3cf0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:20:08.391166 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-daecfccf-790e-448e-89d5-fa1c591f3cf0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:08.392118 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-daecfccf-790e-448e-89d5-fa1c591f3cf0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:08.392429 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-daecfccf-790e-448e-89d5-fa1c591f3cf0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:08.392846 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-daecfccf-790e-448e-89d5-fa1c591f3cf0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:08.517876 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-daecfccf-790e-448e-89d5-fa1c591f3cf0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:08.527973 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-daecfccf-790e-448e-89d5-fa1c591f3cf0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:08.529512 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-daecfccf-790e-448e-89d5-fa1c591f3cf0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:08.530652 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-daecfccf-790e-448e-89d5-fa1c591f3cf0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1443 microversion: 2.20 time: 0.151937 Nov 23 13:20:08.531204 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 942/1878] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:20:08 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1443 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:20:09.244543 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-8ce22c2d-d1be-4b88-86a8-d7e5b70a5101 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:20:09.245146 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-8ce22c2d-d1be-4b88-86a8-d7e5b70a5101 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] [instance: f6d81116-5b48-433f-8c7e-88f2a9687167] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:20:09.252982 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8ce22c2d-d1be-4b88-86a8-d7e5b70a5101 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:09.253428 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8ce22c2d-d1be-4b88-86a8-d7e5b70a5101 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:09.254226 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8ce22c2d-d1be-4b88-86a8-d7e5b70a5101 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:09.254653 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8ce22c2d-d1be-4b88-86a8-d7e5b70a5101 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:09.383549 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-8ce22c2d-d1be-4b88-86a8-d7e5b70a5101 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb8e090f8ae4a2381c9b82a8090f112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90112b6f3d31421a8ee18cbe7d6b0537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:09.392782 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-8ce22c2d-d1be-4b88-86a8-d7e5b70a5101 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] 10.222.0.60 "GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167" status: 200 len: 1350 microversion: 2.1 time: 0.152544 Nov 23 13:20:09.393361 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 937/1879] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:20:09 2021] GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167 => generated 1350 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:20:09.549457 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-9810f83f-03bf-4301-981c-47f36860ac0f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:20:09.550189 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-9810f83f-03bf-4301-981c-47f36860ac0f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:20:09.558248 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-9810f83f-03bf-4301-981c-47f36860ac0f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:09.558692 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-9810f83f-03bf-4301-981c-47f36860ac0f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:09.559455 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-9810f83f-03bf-4301-981c-47f36860ac0f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:09.559882 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-9810f83f-03bf-4301-981c-47f36860ac0f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:09.753764 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-9810f83f-03bf-4301-981c-47f36860ac0f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:09.763739 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-9810f83f-03bf-4301-981c-47f36860ac0f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:09.765241 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-9810f83f-03bf-4301-981c-47f36860ac0f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:09.766342 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-9810f83f-03bf-4301-981c-47f36860ac0f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1443 microversion: 2.20 time: 0.220820 Nov 23 13:20:09.766900 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 943/1880] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:20:09 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1443 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:20:10.411209 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-e28fed5a-fe46-49f5-9930-5e14ff3996cf tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:20:10.411802 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-e28fed5a-fe46-49f5-9930-5e14ff3996cf tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] [instance: f6d81116-5b48-433f-8c7e-88f2a9687167] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:20:10.419930 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e28fed5a-fe46-49f5-9930-5e14ff3996cf tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:10.420405 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e28fed5a-fe46-49f5-9930-5e14ff3996cf tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:10.421159 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e28fed5a-fe46-49f5-9930-5e14ff3996cf tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:10.421578 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e28fed5a-fe46-49f5-9930-5e14ff3996cf tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:10.538741 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-e28fed5a-fe46-49f5-9930-5e14ff3996cf tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb8e090f8ae4a2381c9b82a8090f112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90112b6f3d31421a8ee18cbe7d6b0537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:10.547982 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-e28fed5a-fe46-49f5-9930-5e14ff3996cf tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] 10.222.0.60 "GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167" status: 200 len: 1350 microversion: 2.1 time: 0.140955 Nov 23 13:20:10.548563 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 938/1881] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:20:10 2021] GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167 => generated 1350 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:20:10.784512 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-449006d6-9a26-4af8-ba31-7d7b6678786e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:20:10.785150 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-449006d6-9a26-4af8-ba31-7d7b6678786e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:20:10.793243 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-449006d6-9a26-4af8-ba31-7d7b6678786e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:10.793683 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-449006d6-9a26-4af8-ba31-7d7b6678786e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:10.794435 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-449006d6-9a26-4af8-ba31-7d7b6678786e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:10.794879 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-449006d6-9a26-4af8-ba31-7d7b6678786e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:10.909780 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-449006d6-9a26-4af8-ba31-7d7b6678786e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:10.919769 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-449006d6-9a26-4af8-ba31-7d7b6678786e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:10.921268 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-449006d6-9a26-4af8-ba31-7d7b6678786e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:10.922350 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-449006d6-9a26-4af8-ba31-7d7b6678786e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1443 microversion: 2.20 time: 0.141763 Nov 23 13:20:10.922923 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 944/1882] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:20:10 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1443 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:20:11.566900 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-e45b1a08-170b-44b9-bd94-ab2a61d870ce tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:20:11.567561 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-e45b1a08-170b-44b9-bd94-ab2a61d870ce tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] [instance: f6d81116-5b48-433f-8c7e-88f2a9687167] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:20:11.575936 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e45b1a08-170b-44b9-bd94-ab2a61d870ce tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:11.576421 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e45b1a08-170b-44b9-bd94-ab2a61d870ce tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:11.577220 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e45b1a08-170b-44b9-bd94-ab2a61d870ce tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:11.577657 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e45b1a08-170b-44b9-bd94-ab2a61d870ce tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:11.694609 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-e45b1a08-170b-44b9-bd94-ab2a61d870ce tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb8e090f8ae4a2381c9b82a8090f112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90112b6f3d31421a8ee18cbe7d6b0537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:11.704216 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-e45b1a08-170b-44b9-bd94-ab2a61d870ce tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] 10.222.0.60 "GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167" status: 200 len: 1350 microversion: 2.1 time: 0.141179 Nov 23 13:20:11.704836 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 939/1883] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:20:11 2021] GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167 => generated 1350 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:20:11.941896 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-dd0b1503-07d5-4a58-bf07-3aa2dc2c9243 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:20:11.942570 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-dd0b1503-07d5-4a58-bf07-3aa2dc2c9243 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:20:11.950884 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-dd0b1503-07d5-4a58-bf07-3aa2dc2c9243 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:11.951321 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-dd0b1503-07d5-4a58-bf07-3aa2dc2c9243 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:11.952092 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-dd0b1503-07d5-4a58-bf07-3aa2dc2c9243 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:11.952545 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-dd0b1503-07d5-4a58-bf07-3aa2dc2c9243 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:12.068045 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-dd0b1503-07d5-4a58-bf07-3aa2dc2c9243 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:12.078483 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-dd0b1503-07d5-4a58-bf07-3aa2dc2c9243 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:12.079988 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-dd0b1503-07d5-4a58-bf07-3aa2dc2c9243 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:12.081128 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-dd0b1503-07d5-4a58-bf07-3aa2dc2c9243 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1443 microversion: 2.20 time: 0.143065 Nov 23 13:20:12.081860 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 945/1884] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:20:11 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1443 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:20:12.722245 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-8d9138eb-2fb6-4e1d-8816-ec359a15a4e9 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:20:12.722871 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-8d9138eb-2fb6-4e1d-8816-ec359a15a4e9 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] [instance: f6d81116-5b48-433f-8c7e-88f2a9687167] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:20:12.730955 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8d9138eb-2fb6-4e1d-8816-ec359a15a4e9 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:12.731401 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8d9138eb-2fb6-4e1d-8816-ec359a15a4e9 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:12.732173 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8d9138eb-2fb6-4e1d-8816-ec359a15a4e9 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:12.732638 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8d9138eb-2fb6-4e1d-8816-ec359a15a4e9 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:12.849760 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-8d9138eb-2fb6-4e1d-8816-ec359a15a4e9 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb8e090f8ae4a2381c9b82a8090f112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90112b6f3d31421a8ee18cbe7d6b0537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:12.859496 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-8d9138eb-2fb6-4e1d-8816-ec359a15a4e9 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] 10.222.0.60 "GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167" status: 200 len: 1350 microversion: 2.1 time: 0.141144 Nov 23 13:20:12.860162 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 940/1885] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:20:12 2021] GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167 => generated 1350 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:20:13.100008 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-2c6054ec-9fab-4789-bfb2-8ae95a4627f7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:20:13.100692 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-2c6054ec-9fab-4789-bfb2-8ae95a4627f7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:20:13.108947 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2c6054ec-9fab-4789-bfb2-8ae95a4627f7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:13.109398 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2c6054ec-9fab-4789-bfb2-8ae95a4627f7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:13.110211 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2c6054ec-9fab-4789-bfb2-8ae95a4627f7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:13.110646 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2c6054ec-9fab-4789-bfb2-8ae95a4627f7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:13.232670 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-2c6054ec-9fab-4789-bfb2-8ae95a4627f7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:13.243100 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-2c6054ec-9fab-4789-bfb2-8ae95a4627f7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:13.244634 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-2c6054ec-9fab-4789-bfb2-8ae95a4627f7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:13.245747 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-2c6054ec-9fab-4789-bfb2-8ae95a4627f7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1443 microversion: 2.20 time: 0.149973 Nov 23 13:20:13.246299 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 946/1886] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:20:13 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1443 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:20:13.877327 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-1674f1c8-e116-47c5-b57e-d61fb75ce45e tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:20:13.877897 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-1674f1c8-e116-47c5-b57e-d61fb75ce45e tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] [instance: f6d81116-5b48-433f-8c7e-88f2a9687167] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:20:13.885712 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-1674f1c8-e116-47c5-b57e-d61fb75ce45e tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:13.886126 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-1674f1c8-e116-47c5-b57e-d61fb75ce45e tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:13.886876 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-1674f1c8-e116-47c5-b57e-d61fb75ce45e tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:13.887297 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-1674f1c8-e116-47c5-b57e-d61fb75ce45e tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:14.003549 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-1674f1c8-e116-47c5-b57e-d61fb75ce45e tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb8e090f8ae4a2381c9b82a8090f112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90112b6f3d31421a8ee18cbe7d6b0537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:14.013028 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-1674f1c8-e116-47c5-b57e-d61fb75ce45e tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] 10.222.0.60 "GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167" status: 200 len: 1350 microversion: 2.1 time: 0.139489 Nov 23 13:20:14.013603 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 941/1887] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:20:13 2021] GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167 => generated 1350 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:20:14.264645 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-09d73295-bbc6-4387-ac92-82c7658175ec tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:20:14.265251 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-09d73295-bbc6-4387-ac92-82c7658175ec tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:20:14.273052 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-09d73295-bbc6-4387-ac92-82c7658175ec tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:14.273500 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-09d73295-bbc6-4387-ac92-82c7658175ec tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:14.274267 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-09d73295-bbc6-4387-ac92-82c7658175ec tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:14.274690 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-09d73295-bbc6-4387-ac92-82c7658175ec tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:14.389617 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-09d73295-bbc6-4387-ac92-82c7658175ec tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:14.399289 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-09d73295-bbc6-4387-ac92-82c7658175ec tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:14.400852 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-09d73295-bbc6-4387-ac92-82c7658175ec tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:14.402006 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-09d73295-bbc6-4387-ac92-82c7658175ec tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1443 microversion: 2.20 time: 0.141342 Nov 23 13:20:14.402572 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 947/1888] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:20:14 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1443 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:20:15.031572 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-ff5d7644-1037-44f3-b92e-6bc9bbf855a0 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:20:15.032429 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-ff5d7644-1037-44f3-b92e-6bc9bbf855a0 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] [instance: f6d81116-5b48-433f-8c7e-88f2a9687167] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:20:15.040928 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ff5d7644-1037-44f3-b92e-6bc9bbf855a0 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:15.041378 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ff5d7644-1037-44f3-b92e-6bc9bbf855a0 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:15.042187 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ff5d7644-1037-44f3-b92e-6bc9bbf855a0 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:15.042606 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ff5d7644-1037-44f3-b92e-6bc9bbf855a0 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:15.166171 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-ff5d7644-1037-44f3-b92e-6bc9bbf855a0 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb8e090f8ae4a2381c9b82a8090f112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90112b6f3d31421a8ee18cbe7d6b0537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:15.176799 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-ff5d7644-1037-44f3-b92e-6bc9bbf855a0 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] 10.222.0.60 "GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167" status: 200 len: 1350 microversion: 2.1 time: 0.148755 Nov 23 13:20:15.177426 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 942/1889] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:20:15 2021] GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167 => generated 1350 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:20:15.420919 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-5b3cc6e9-71e4-4794-ad72-6cd8db713e6d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:20:15.421515 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-5b3cc6e9-71e4-4794-ad72-6cd8db713e6d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:20:15.429593 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5b3cc6e9-71e4-4794-ad72-6cd8db713e6d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:15.430150 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5b3cc6e9-71e4-4794-ad72-6cd8db713e6d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:15.431356 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5b3cc6e9-71e4-4794-ad72-6cd8db713e6d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:15.431937 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5b3cc6e9-71e4-4794-ad72-6cd8db713e6d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:15.550278 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-5b3cc6e9-71e4-4794-ad72-6cd8db713e6d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:15.560356 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-5b3cc6e9-71e4-4794-ad72-6cd8db713e6d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:15.561859 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-5b3cc6e9-71e4-4794-ad72-6cd8db713e6d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:15.563017 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-5b3cc6e9-71e4-4794-ad72-6cd8db713e6d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1443 microversion: 2.20 time: 0.146171 Nov 23 13:20:15.563579 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 948/1890] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:20:15 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1443 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:20:16.197554 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-73cb018b-b81f-4bf4-b8ba-5ff391ed8e86 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:20:16.198177 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-73cb018b-b81f-4bf4-b8ba-5ff391ed8e86 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] [instance: f6d81116-5b48-433f-8c7e-88f2a9687167] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:20:16.207630 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-73cb018b-b81f-4bf4-b8ba-5ff391ed8e86 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:16.208326 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-73cb018b-b81f-4bf4-b8ba-5ff391ed8e86 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:16.209609 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-73cb018b-b81f-4bf4-b8ba-5ff391ed8e86 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:16.210266 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-73cb018b-b81f-4bf4-b8ba-5ff391ed8e86 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:16.336516 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-73cb018b-b81f-4bf4-b8ba-5ff391ed8e86 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb8e090f8ae4a2381c9b82a8090f112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90112b6f3d31421a8ee18cbe7d6b0537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:16.345957 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-73cb018b-b81f-4bf4-b8ba-5ff391ed8e86 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] 10.222.0.60 "GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167" status: 200 len: 1350 microversion: 2.1 time: 0.152281 Nov 23 13:20:16.346698 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 943/1891] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:20:16 2021] GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167 => generated 1350 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:20:16.581749 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-3f5fb46b-3172-4120-84fa-4237f8b49e54 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:20:16.582402 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-3f5fb46b-3172-4120-84fa-4237f8b49e54 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:20:16.590911 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3f5fb46b-3172-4120-84fa-4237f8b49e54 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:16.591340 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3f5fb46b-3172-4120-84fa-4237f8b49e54 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:16.592175 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3f5fb46b-3172-4120-84fa-4237f8b49e54 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:16.592679 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3f5fb46b-3172-4120-84fa-4237f8b49e54 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:16.715646 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-3f5fb46b-3172-4120-84fa-4237f8b49e54 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:16.727793 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-3f5fb46b-3172-4120-84fa-4237f8b49e54 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:16.730141 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-3f5fb46b-3172-4120-84fa-4237f8b49e54 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:16.731795 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-3f5fb46b-3172-4120-84fa-4237f8b49e54 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1443 microversion: 2.20 time: 0.153947 Nov 23 13:20:16.732797 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 949/1892] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:20:16 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1443 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:20:17.363575 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-727dfbd5-554b-44d6-9dbc-4a9982e19990 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:20:17.364252 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-727dfbd5-554b-44d6-9dbc-4a9982e19990 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] [instance: f6d81116-5b48-433f-8c7e-88f2a9687167] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:20:17.372208 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-727dfbd5-554b-44d6-9dbc-4a9982e19990 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:17.372675 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-727dfbd5-554b-44d6-9dbc-4a9982e19990 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:17.373452 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-727dfbd5-554b-44d6-9dbc-4a9982e19990 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:17.373872 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-727dfbd5-554b-44d6-9dbc-4a9982e19990 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:17.504321 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-727dfbd5-554b-44d6-9dbc-4a9982e19990 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb8e090f8ae4a2381c9b82a8090f112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90112b6f3d31421a8ee18cbe7d6b0537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:17.517108 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-727dfbd5-554b-44d6-9dbc-4a9982e19990 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] 10.222.0.60 "GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167" status: 200 len: 1350 microversion: 2.1 time: 0.156968 Nov 23 13:20:17.518233 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 944/1893] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:20:17 2021] GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167 => generated 1350 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:20:17.753598 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-7a19bb93-c70e-4ff5-b0e0-9185e466176d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:20:17.754188 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-7a19bb93-c70e-4ff5-b0e0-9185e466176d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:20:17.762593 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7a19bb93-c70e-4ff5-b0e0-9185e466176d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:17.763015 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7a19bb93-c70e-4ff5-b0e0-9185e466176d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:17.763768 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7a19bb93-c70e-4ff5-b0e0-9185e466176d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:17.764205 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7a19bb93-c70e-4ff5-b0e0-9185e466176d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:17.881622 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-7a19bb93-c70e-4ff5-b0e0-9185e466176d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:17.892316 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-7a19bb93-c70e-4ff5-b0e0-9185e466176d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:17.893835 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-7a19bb93-c70e-4ff5-b0e0-9185e466176d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:17.894969 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-7a19bb93-c70e-4ff5-b0e0-9185e466176d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1443 microversion: 2.20 time: 0.145296 Nov 23 13:20:17.895578 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 950/1894] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:20:17 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1443 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:20:18.536131 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-90293f9b-36a2-47d9-8ccc-d200afe4b427 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:20:18.536832 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-90293f9b-36a2-47d9-8ccc-d200afe4b427 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] [instance: f6d81116-5b48-433f-8c7e-88f2a9687167] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:20:18.547745 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-90293f9b-36a2-47d9-8ccc-d200afe4b427 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:18.548412 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-90293f9b-36a2-47d9-8ccc-d200afe4b427 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:18.549341 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-90293f9b-36a2-47d9-8ccc-d200afe4b427 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:18.549794 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-90293f9b-36a2-47d9-8ccc-d200afe4b427 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:18.668527 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-90293f9b-36a2-47d9-8ccc-d200afe4b427 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb8e090f8ae4a2381c9b82a8090f112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90112b6f3d31421a8ee18cbe7d6b0537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:18.678633 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-90293f9b-36a2-47d9-8ccc-d200afe4b427 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] 10.222.0.60 "GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167" status: 200 len: 1350 microversion: 2.1 time: 0.146302 Nov 23 13:20:18.679361 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 945/1895] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:20:18 2021] GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167 => generated 1350 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:20:18.915825 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-46a6503a-e424-4f71-9496-83640c94f76f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:20:18.916514 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-46a6503a-e424-4f71-9496-83640c94f76f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:20:18.924736 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-46a6503a-e424-4f71-9496-83640c94f76f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:18.925201 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-46a6503a-e424-4f71-9496-83640c94f76f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:18.925952 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-46a6503a-e424-4f71-9496-83640c94f76f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:18.926384 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-46a6503a-e424-4f71-9496-83640c94f76f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:19.040595 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-46a6503a-e424-4f71-9496-83640c94f76f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:19.050677 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-46a6503a-e424-4f71-9496-83640c94f76f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:19.052174 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-46a6503a-e424-4f71-9496-83640c94f76f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:19.053452 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-46a6503a-e424-4f71-9496-83640c94f76f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1443 microversion: 2.20 time: 0.141809 Nov 23 13:20:19.054038 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 951/1896] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:20:18 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1443 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:20:19.696797 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-0f9a31ca-98f6-4da9-a31c-0dc0d53e3773 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:20:19.697515 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-0f9a31ca-98f6-4da9-a31c-0dc0d53e3773 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] [instance: f6d81116-5b48-433f-8c7e-88f2a9687167] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:20:19.705406 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0f9a31ca-98f6-4da9-a31c-0dc0d53e3773 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:19.705852 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0f9a31ca-98f6-4da9-a31c-0dc0d53e3773 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:19.706648 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0f9a31ca-98f6-4da9-a31c-0dc0d53e3773 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:19.707079 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0f9a31ca-98f6-4da9-a31c-0dc0d53e3773 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:19.825234 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-0f9a31ca-98f6-4da9-a31c-0dc0d53e3773 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb8e090f8ae4a2381c9b82a8090f112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90112b6f3d31421a8ee18cbe7d6b0537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:19.842593 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-0f9a31ca-98f6-4da9-a31c-0dc0d53e3773 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] 10.222.0.60 "GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167" status: 200 len: 1350 microversion: 2.1 time: 0.149421 Nov 23 13:20:19.843511 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 946/1897] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:20:19 2021] GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167 => generated 1350 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:20:20.072458 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-8d900c73-e4be-46ee-9ad0-28abcb8e7298 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:20:20.073153 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-8d900c73-e4be-46ee-9ad0-28abcb8e7298 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:20:20.081046 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8d900c73-e4be-46ee-9ad0-28abcb8e7298 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:20.081494 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8d900c73-e4be-46ee-9ad0-28abcb8e7298 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:20.082287 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8d900c73-e4be-46ee-9ad0-28abcb8e7298 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:20.082726 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8d900c73-e4be-46ee-9ad0-28abcb8e7298 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:20.205067 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-8d900c73-e4be-46ee-9ad0-28abcb8e7298 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:20.214798 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-8d900c73-e4be-46ee-9ad0-28abcb8e7298 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:20.216298 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-8d900c73-e4be-46ee-9ad0-28abcb8e7298 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:20.217440 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-8d900c73-e4be-46ee-9ad0-28abcb8e7298 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1443 microversion: 2.20 time: 0.148988 Nov 23 13:20:20.218013 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 952/1898] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:20:20 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1443 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:20:20.871380 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-686a7ae3-7004-4495-a30b-c185d21da587 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:20:20.871979 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-686a7ae3-7004-4495-a30b-c185d21da587 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] [instance: f6d81116-5b48-433f-8c7e-88f2a9687167] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:20:20.879956 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-686a7ae3-7004-4495-a30b-c185d21da587 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:20.880430 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-686a7ae3-7004-4495-a30b-c185d21da587 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:20.881169 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-686a7ae3-7004-4495-a30b-c185d21da587 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:20.881614 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-686a7ae3-7004-4495-a30b-c185d21da587 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:21.000148 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-686a7ae3-7004-4495-a30b-c185d21da587 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb8e090f8ae4a2381c9b82a8090f112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90112b6f3d31421a8ee18cbe7d6b0537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:21.009710 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-686a7ae3-7004-4495-a30b-c185d21da587 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] 10.222.0.60 "GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167" status: 200 len: 1350 microversion: 2.1 time: 0.142061 Nov 23 13:20:21.010283 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 947/1899] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:20:20 2021] GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167 => generated 1350 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:20:21.237175 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-5ad5eb63-ba44-4bd3-9bc6-8a56ffc2d42e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:20:21.237793 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-5ad5eb63-ba44-4bd3-9bc6-8a56ffc2d42e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:20:21.246542 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5ad5eb63-ba44-4bd3-9bc6-8a56ffc2d42e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:21.246994 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5ad5eb63-ba44-4bd3-9bc6-8a56ffc2d42e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:21.247766 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5ad5eb63-ba44-4bd3-9bc6-8a56ffc2d42e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:21.248200 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5ad5eb63-ba44-4bd3-9bc6-8a56ffc2d42e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:21.522574 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-5ad5eb63-ba44-4bd3-9bc6-8a56ffc2d42e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:21.534955 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-5ad5eb63-ba44-4bd3-9bc6-8a56ffc2d42e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:21.536616 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-5ad5eb63-ba44-4bd3-9bc6-8a56ffc2d42e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:21.537778 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-5ad5eb63-ba44-4bd3-9bc6-8a56ffc2d42e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1443 microversion: 2.20 time: 0.304939 Nov 23 13:20:21.538533 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 953/1900] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:20:21 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1443 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:20:22.028030 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-c8cbeaf1-ab8f-484b-a17c-4386bd91aa6c tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:20:22.028725 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-c8cbeaf1-ab8f-484b-a17c-4386bd91aa6c tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] [instance: f6d81116-5b48-433f-8c7e-88f2a9687167] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:20:22.036879 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c8cbeaf1-ab8f-484b-a17c-4386bd91aa6c tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:22.037475 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c8cbeaf1-ab8f-484b-a17c-4386bd91aa6c tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:22.038644 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c8cbeaf1-ab8f-484b-a17c-4386bd91aa6c tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:22.039074 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c8cbeaf1-ab8f-484b-a17c-4386bd91aa6c tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:22.157001 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-c8cbeaf1-ab8f-484b-a17c-4386bd91aa6c tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb8e090f8ae4a2381c9b82a8090f112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90112b6f3d31421a8ee18cbe7d6b0537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:22.166775 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-c8cbeaf1-ab8f-484b-a17c-4386bd91aa6c tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] 10.222.0.60 "GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167" status: 200 len: 1350 microversion: 2.1 time: 0.142519 Nov 23 13:20:22.167360 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 948/1901] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:20:22 2021] GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167 => generated 1350 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:20:22.559098 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-3addac73-1499-4e34-99e1-42725e5dadfc tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:20:22.559991 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-3addac73-1499-4e34-99e1-42725e5dadfc tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:20:22.568541 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3addac73-1499-4e34-99e1-42725e5dadfc tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:22.569039 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3addac73-1499-4e34-99e1-42725e5dadfc tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:22.569888 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3addac73-1499-4e34-99e1-42725e5dadfc tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:22.570359 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3addac73-1499-4e34-99e1-42725e5dadfc tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:22.692524 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-3addac73-1499-4e34-99e1-42725e5dadfc tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:22.702943 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-3addac73-1499-4e34-99e1-42725e5dadfc tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:22.704511 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-3addac73-1499-4e34-99e1-42725e5dadfc tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:22.705890 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-3addac73-1499-4e34-99e1-42725e5dadfc tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1443 microversion: 2.20 time: 0.152739 Nov 23 13:20:22.706399 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 954/1902] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:20:22 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1443 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 13:20:23.186199 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-af110e0d-7f12-4887-8c3e-9a2e2fa8e5af tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:20:23.186801 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-af110e0d-7f12-4887-8c3e-9a2e2fa8e5af tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] [instance: f6d81116-5b48-433f-8c7e-88f2a9687167] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:20:23.197279 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-af110e0d-7f12-4887-8c3e-9a2e2fa8e5af tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:23.197870 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-af110e0d-7f12-4887-8c3e-9a2e2fa8e5af tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:23.198721 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-af110e0d-7f12-4887-8c3e-9a2e2fa8e5af tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:23.199209 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-af110e0d-7f12-4887-8c3e-9a2e2fa8e5af tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:23.326290 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-af110e0d-7f12-4887-8c3e-9a2e2fa8e5af tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb8e090f8ae4a2381c9b82a8090f112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90112b6f3d31421a8ee18cbe7d6b0537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:23.341998 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-af110e0d-7f12-4887-8c3e-9a2e2fa8e5af tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] 10.222.0.60 "GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167" status: 200 len: 1350 microversion: 2.1 time: 0.160206 Nov 23 13:20:23.342761 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 949/1903] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:20:23 2021] GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167 => generated 1350 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:20:23.725482 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-7024e10c-4985-4eb8-b363-356643c9946b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:20:23.726102 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-7024e10c-4985-4eb8-b363-356643c9946b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:20:23.736040 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7024e10c-4985-4eb8-b363-356643c9946b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:23.736980 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7024e10c-4985-4eb8-b363-356643c9946b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:23.738198 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7024e10c-4985-4eb8-b363-356643c9946b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:23.738649 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7024e10c-4985-4eb8-b363-356643c9946b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:23.867342 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-7024e10c-4985-4eb8-b363-356643c9946b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:23.877194 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-7024e10c-4985-4eb8-b363-356643c9946b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:23.878700 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-7024e10c-4985-4eb8-b363-356643c9946b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:23.879762 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-7024e10c-4985-4eb8-b363-356643c9946b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1443 microversion: 2.20 time: 0.158556 Nov 23 13:20:23.880321 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 955/1904] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:20:23 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1443 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:20:24.367184 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-210ee336-643b-4e16-988f-71e3df5f1bea tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:20:24.368343 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-210ee336-643b-4e16-988f-71e3df5f1bea tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] [instance: f6d81116-5b48-433f-8c7e-88f2a9687167] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:20:24.382056 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-210ee336-643b-4e16-988f-71e3df5f1bea tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:24.382485 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-210ee336-643b-4e16-988f-71e3df5f1bea tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:24.384030 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-210ee336-643b-4e16-988f-71e3df5f1bea tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:24.384714 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-210ee336-643b-4e16-988f-71e3df5f1bea tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:24.513936 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-210ee336-643b-4e16-988f-71e3df5f1bea tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb8e090f8ae4a2381c9b82a8090f112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90112b6f3d31421a8ee18cbe7d6b0537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:24.527030 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-210ee336-643b-4e16-988f-71e3df5f1bea tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] 10.222.0.60 "GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167" status: 200 len: 1350 microversion: 2.1 time: 0.166373 Nov 23 13:20:24.527623 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 950/1905] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:20:24 2021] GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167 => generated 1350 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:20:24.901808 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-e500b08b-f444-414c-ba8e-121ef4f12d86 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:20:24.902435 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-e500b08b-f444-414c-ba8e-121ef4f12d86 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:20:24.911252 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e500b08b-f444-414c-ba8e-121ef4f12d86 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:24.911912 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e500b08b-f444-414c-ba8e-121ef4f12d86 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:24.913197 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e500b08b-f444-414c-ba8e-121ef4f12d86 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:24.913741 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e500b08b-f444-414c-ba8e-121ef4f12d86 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:25.035739 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-e500b08b-f444-414c-ba8e-121ef4f12d86 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:25.046057 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-e500b08b-f444-414c-ba8e-121ef4f12d86 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:25.047530 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-e500b08b-f444-414c-ba8e-121ef4f12d86 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:25.048728 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-e500b08b-f444-414c-ba8e-121ef4f12d86 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1443 microversion: 2.20 time: 0.153581 Nov 23 13:20:25.049308 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 956/1906] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:20:24 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1443 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 13:20:25.548276 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-c5547405-39fd-42f1-8a9f-24022f516375 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:20:25.549501 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-c5547405-39fd-42f1-8a9f-24022f516375 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] [instance: f6d81116-5b48-433f-8c7e-88f2a9687167] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:20:25.558463 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c5547405-39fd-42f1-8a9f-24022f516375 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:25.558908 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c5547405-39fd-42f1-8a9f-24022f516375 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:25.559748 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c5547405-39fd-42f1-8a9f-24022f516375 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:25.560403 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c5547405-39fd-42f1-8a9f-24022f516375 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:25.689642 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-c5547405-39fd-42f1-8a9f-24022f516375 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb8e090f8ae4a2381c9b82a8090f112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90112b6f3d31421a8ee18cbe7d6b0537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:25.701595 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-c5547405-39fd-42f1-8a9f-24022f516375 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] 10.222.0.60 "GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167" status: 200 len: 1350 microversion: 2.1 time: 0.159742 Nov 23 13:20:25.702188 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 951/1907] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:20:25 2021] GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167 => generated 1350 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:20:26.070190 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-c118646a-3887-4138-9bfe-3bf73f511625 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:20:26.070879 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-c118646a-3887-4138-9bfe-3bf73f511625 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:20:26.080621 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c118646a-3887-4138-9bfe-3bf73f511625 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:26.081075 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c118646a-3887-4138-9bfe-3bf73f511625 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:26.081868 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c118646a-3887-4138-9bfe-3bf73f511625 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:26.082377 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c118646a-3887-4138-9bfe-3bf73f511625 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:26.209145 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-c118646a-3887-4138-9bfe-3bf73f511625 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:26.221420 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-c118646a-3887-4138-9bfe-3bf73f511625 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:26.222941 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-c118646a-3887-4138-9bfe-3bf73f511625 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:26.224293 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-c118646a-3887-4138-9bfe-3bf73f511625 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1443 microversion: 2.20 time: 0.159671 Nov 23 13:20:26.224884 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 957/1908] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:20:26 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1443 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:20:26.719587 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-5fb7b3cc-ef74-413b-853d-753a50225d0d tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:20:26.720514 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-5fb7b3cc-ef74-413b-853d-753a50225d0d tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] [instance: f6d81116-5b48-433f-8c7e-88f2a9687167] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:20:26.731541 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5fb7b3cc-ef74-413b-853d-753a50225d0d tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:26.732160 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5fb7b3cc-ef74-413b-853d-753a50225d0d tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:26.733965 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5fb7b3cc-ef74-413b-853d-753a50225d0d tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:26.734510 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5fb7b3cc-ef74-413b-853d-753a50225d0d tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:26.875794 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-5fb7b3cc-ef74-413b-853d-753a50225d0d tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb8e090f8ae4a2381c9b82a8090f112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90112b6f3d31421a8ee18cbe7d6b0537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:26.885918 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-5fb7b3cc-ef74-413b-853d-753a50225d0d tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] 10.222.0.60 "GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167" status: 200 len: 1350 microversion: 2.1 time: 0.169708 Nov 23 13:20:26.886536 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 952/1909] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:20:26 2021] GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167 => generated 1350 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:20:27.250770 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-14c35cc4-00b9-4b33-acd9-0bf330f6d438 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:20:27.251757 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-14c35cc4-00b9-4b33-acd9-0bf330f6d438 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:20:27.261146 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-14c35cc4-00b9-4b33-acd9-0bf330f6d438 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:27.261722 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-14c35cc4-00b9-4b33-acd9-0bf330f6d438 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:27.262824 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-14c35cc4-00b9-4b33-acd9-0bf330f6d438 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:27.263416 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-14c35cc4-00b9-4b33-acd9-0bf330f6d438 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:27.393506 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-14c35cc4-00b9-4b33-acd9-0bf330f6d438 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:27.403743 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-14c35cc4-00b9-4b33-acd9-0bf330f6d438 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:27.405410 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-14c35cc4-00b9-4b33-acd9-0bf330f6d438 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:27.406548 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-14c35cc4-00b9-4b33-acd9-0bf330f6d438 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1443 microversion: 2.20 time: 0.163024 Nov 23 13:20:27.407109 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 958/1910] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:20:27 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1443 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 13:20:27.903625 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-b9cd6f5a-1afd-48e1-aa30-2838eb37115b tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:20:27.904274 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-b9cd6f5a-1afd-48e1-aa30-2838eb37115b tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] [instance: f6d81116-5b48-433f-8c7e-88f2a9687167] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:20:27.913681 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b9cd6f5a-1afd-48e1-aa30-2838eb37115b tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:27.914195 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b9cd6f5a-1afd-48e1-aa30-2838eb37115b tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:27.915027 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b9cd6f5a-1afd-48e1-aa30-2838eb37115b tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:27.915562 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b9cd6f5a-1afd-48e1-aa30-2838eb37115b tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:28.038956 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-b9cd6f5a-1afd-48e1-aa30-2838eb37115b tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb8e090f8ae4a2381c9b82a8090f112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90112b6f3d31421a8ee18cbe7d6b0537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:28.048708 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-b9cd6f5a-1afd-48e1-aa30-2838eb37115b tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] 10.222.0.60 "GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167" status: 200 len: 1350 microversion: 2.1 time: 0.148833 Nov 23 13:20:28.049295 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 953/1911] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:20:27 2021] GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167 => generated 1350 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:20:28.427346 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-480b25a9-3e48-49ec-a338-bc434556892d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:20:28.428108 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-480b25a9-3e48-49ec-a338-bc434556892d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:20:28.436475 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-480b25a9-3e48-49ec-a338-bc434556892d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:28.436917 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-480b25a9-3e48-49ec-a338-bc434556892d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:28.437674 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-480b25a9-3e48-49ec-a338-bc434556892d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:28.438097 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-480b25a9-3e48-49ec-a338-bc434556892d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:28.567527 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-480b25a9-3e48-49ec-a338-bc434556892d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:28.577757 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-480b25a9-3e48-49ec-a338-bc434556892d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:28.579256 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-480b25a9-3e48-49ec-a338-bc434556892d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:28.580398 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-480b25a9-3e48-49ec-a338-bc434556892d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1443 microversion: 2.20 time: 0.157503 Nov 23 13:20:28.580956 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 959/1912] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:20:28 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1443 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:20:29.066931 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-1688bf99-fccc-4b15-af17-1350f9543e4f tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:20:29.067619 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-1688bf99-fccc-4b15-af17-1350f9543e4f tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] [instance: f6d81116-5b48-433f-8c7e-88f2a9687167] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:20:29.076734 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-1688bf99-fccc-4b15-af17-1350f9543e4f tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:29.077221 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-1688bf99-fccc-4b15-af17-1350f9543e4f tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:29.078292 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-1688bf99-fccc-4b15-af17-1350f9543e4f tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:29.078864 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-1688bf99-fccc-4b15-af17-1350f9543e4f tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:29.200123 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-1688bf99-fccc-4b15-af17-1350f9543e4f tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb8e090f8ae4a2381c9b82a8090f112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90112b6f3d31421a8ee18cbe7d6b0537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:29.213175 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-1688bf99-fccc-4b15-af17-1350f9543e4f tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] 10.222.0.60 "GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167" status: 200 len: 1350 microversion: 2.1 time: 0.149884 Nov 23 13:20:29.213847 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 954/1913] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:20:29 2021] GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167 => generated 1350 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:20:29.600154 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-ba9861d2-ad85-4151-9850-7639fdd3ee3a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:20:29.600816 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-ba9861d2-ad85-4151-9850-7639fdd3ee3a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:20:29.609190 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ba9861d2-ad85-4151-9850-7639fdd3ee3a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:29.609665 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ba9861d2-ad85-4151-9850-7639fdd3ee3a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:29.610722 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ba9861d2-ad85-4151-9850-7639fdd3ee3a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:29.611155 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ba9861d2-ad85-4151-9850-7639fdd3ee3a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:29.751416 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-ba9861d2-ad85-4151-9850-7639fdd3ee3a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:29.765824 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-ba9861d2-ad85-4151-9850-7639fdd3ee3a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:29.768095 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-ba9861d2-ad85-4151-9850-7639fdd3ee3a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:29.769778 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-ba9861d2-ad85-4151-9850-7639fdd3ee3a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1443 microversion: 2.20 time: 0.173297 Nov 23 13:20:29.770313 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 960/1914] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:20:29 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1443 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:20:30.237732 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-61120220-2080-42fc-815a-accca03a14fe tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:20:30.238492 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-61120220-2080-42fc-815a-accca03a14fe tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] [instance: f6d81116-5b48-433f-8c7e-88f2a9687167] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:20:30.246890 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-61120220-2080-42fc-815a-accca03a14fe tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:30.247484 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-61120220-2080-42fc-815a-accca03a14fe tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:30.248617 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-61120220-2080-42fc-815a-accca03a14fe tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:30.249115 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-61120220-2080-42fc-815a-accca03a14fe tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:30.384713 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-61120220-2080-42fc-815a-accca03a14fe tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb8e090f8ae4a2381c9b82a8090f112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90112b6f3d31421a8ee18cbe7d6b0537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:30.399227 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-61120220-2080-42fc-815a-accca03a14fe tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] 10.222.0.60 "GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167" status: 200 len: 1350 microversion: 2.1 time: 0.165723 Nov 23 13:20:30.400157 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 955/1915] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:20:30 2021] GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167 => generated 1350 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:20:30.420189 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 13:20:30.420498 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: Tue Nov 23 13:20:30 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 23 13:20:30.793424 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-130fcb94-5bd5-484b-b418-3666adcce04e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:20:30.794253 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-130fcb94-5bd5-484b-b418-3666adcce04e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:20:30.801802 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-130fcb94-5bd5-484b-b418-3666adcce04e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:30.802217 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-130fcb94-5bd5-484b-b418-3666adcce04e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:30.803011 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-130fcb94-5bd5-484b-b418-3666adcce04e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:30.803439 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-130fcb94-5bd5-484b-b418-3666adcce04e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:30.927982 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-130fcb94-5bd5-484b-b418-3666adcce04e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:30.937967 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-130fcb94-5bd5-484b-b418-3666adcce04e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:30.939454 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-130fcb94-5bd5-484b-b418-3666adcce04e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:30.940839 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-130fcb94-5bd5-484b-b418-3666adcce04e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1443 microversion: 2.20 time: 0.152673 Nov 23 13:20:30.941484 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 961/1916] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:20:30 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1443 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:20:31.421035 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-b27ca071-d392-4b85-90d8-418caca20566 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:20:31.421878 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-b27ca071-d392-4b85-90d8-418caca20566 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] [instance: f6d81116-5b48-433f-8c7e-88f2a9687167] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:20:31.430925 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b27ca071-d392-4b85-90d8-418caca20566 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:31.431366 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b27ca071-d392-4b85-90d8-418caca20566 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:31.432132 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b27ca071-d392-4b85-90d8-418caca20566 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:31.432582 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b27ca071-d392-4b85-90d8-418caca20566 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:31.556644 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-b27ca071-d392-4b85-90d8-418caca20566 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb8e090f8ae4a2381c9b82a8090f112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90112b6f3d31421a8ee18cbe7d6b0537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:31.568570 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-b27ca071-d392-4b85-90d8-418caca20566 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] 10.222.0.60 "GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167" status: 200 len: 1350 microversion: 2.1 time: 0.152946 Nov 23 13:20:31.569427 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 956/1917] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:20:31 2021] GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167 => generated 1350 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:20:31.963588 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-5bc7f4ba-ce98-478f-8a0d-6a4363ceb070 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:20:31.964274 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-5bc7f4ba-ce98-478f-8a0d-6a4363ceb070 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:20:31.972652 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5bc7f4ba-ce98-478f-8a0d-6a4363ceb070 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:31.973157 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5bc7f4ba-ce98-478f-8a0d-6a4363ceb070 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:31.973950 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5bc7f4ba-ce98-478f-8a0d-6a4363ceb070 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:31.974383 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5bc7f4ba-ce98-478f-8a0d-6a4363ceb070 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:32.102157 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-5bc7f4ba-ce98-478f-8a0d-6a4363ceb070 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:32.114125 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-5bc7f4ba-ce98-478f-8a0d-6a4363ceb070 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:32.115571 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-5bc7f4ba-ce98-478f-8a0d-6a4363ceb070 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:32.116717 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-5bc7f4ba-ce98-478f-8a0d-6a4363ceb070 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1443 microversion: 2.20 time: 0.157053 Nov 23 13:20:32.117290 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 962/1918] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:20:31 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1443 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:20:32.588561 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-4880dc1f-38a4-4e1d-9379-40e8690f5b73 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:20:32.589325 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-4880dc1f-38a4-4e1d-9379-40e8690f5b73 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] [instance: f6d81116-5b48-433f-8c7e-88f2a9687167] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:20:32.597639 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4880dc1f-38a4-4e1d-9379-40e8690f5b73 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:32.598079 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4880dc1f-38a4-4e1d-9379-40e8690f5b73 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:32.598881 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4880dc1f-38a4-4e1d-9379-40e8690f5b73 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:32.599299 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4880dc1f-38a4-4e1d-9379-40e8690f5b73 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:32.724839 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-4880dc1f-38a4-4e1d-9379-40e8690f5b73 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb8e090f8ae4a2381c9b82a8090f112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90112b6f3d31421a8ee18cbe7d6b0537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:32.736954 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-4880dc1f-38a4-4e1d-9379-40e8690f5b73 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] 10.222.0.60 "GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167" status: 200 len: 1350 microversion: 2.1 time: 0.152645 Nov 23 13:20:32.737859 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 957/1919] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:20:32 2021] GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167 => generated 1350 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:20:33.136841 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-5a23ef90-7f1c-4ce8-919c-8cc8360ac474 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:20:33.137624 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-5a23ef90-7f1c-4ce8-919c-8cc8360ac474 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:20:33.146385 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5a23ef90-7f1c-4ce8-919c-8cc8360ac474 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:33.146818 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5a23ef90-7f1c-4ce8-919c-8cc8360ac474 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:33.147573 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5a23ef90-7f1c-4ce8-919c-8cc8360ac474 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:33.148017 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5a23ef90-7f1c-4ce8-919c-8cc8360ac474 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:33.282459 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-5a23ef90-7f1c-4ce8-919c-8cc8360ac474 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:33.293393 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-5a23ef90-7f1c-4ce8-919c-8cc8360ac474 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:33.295447 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-5a23ef90-7f1c-4ce8-919c-8cc8360ac474 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:33.297252 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-5a23ef90-7f1c-4ce8-919c-8cc8360ac474 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1443 microversion: 2.20 time: 0.164406 Nov 23 13:20:33.298198 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 963/1920] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:20:33 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1443 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:20:33.755991 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-be37455d-0db7-455c-9b37-afa5055a52b0 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:20:33.756814 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-be37455d-0db7-455c-9b37-afa5055a52b0 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] [instance: f6d81116-5b48-433f-8c7e-88f2a9687167] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:20:33.766105 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-be37455d-0db7-455c-9b37-afa5055a52b0 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:33.766739 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-be37455d-0db7-455c-9b37-afa5055a52b0 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:33.767696 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-be37455d-0db7-455c-9b37-afa5055a52b0 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:33.768300 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-be37455d-0db7-455c-9b37-afa5055a52b0 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:34.001307 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-be37455d-0db7-455c-9b37-afa5055a52b0 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb8e090f8ae4a2381c9b82a8090f112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90112b6f3d31421a8ee18cbe7d6b0537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:34.010855 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-be37455d-0db7-455c-9b37-afa5055a52b0 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] 10.222.0.60 "GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167" status: 200 len: 1350 microversion: 2.1 time: 0.259299 Nov 23 13:20:34.011470 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 958/1921] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:20:33 2021] GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167 => generated 1350 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:20:34.321974 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-1de7e748-5d19-4294-896d-c52b15a78bcb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:20:34.322723 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-1de7e748-5d19-4294-896d-c52b15a78bcb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:20:34.330820 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1de7e748-5d19-4294-896d-c52b15a78bcb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:34.331258 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1de7e748-5d19-4294-896d-c52b15a78bcb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:34.332035 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1de7e748-5d19-4294-896d-c52b15a78bcb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:34.332497 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1de7e748-5d19-4294-896d-c52b15a78bcb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:34.477942 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-1de7e748-5d19-4294-896d-c52b15a78bcb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:34.490798 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-1de7e748-5d19-4294-896d-c52b15a78bcb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:34.492393 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-1de7e748-5d19-4294-896d-c52b15a78bcb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:34.493554 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-1de7e748-5d19-4294-896d-c52b15a78bcb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1443 microversion: 2.20 time: 0.175584 Nov 23 13:20:34.494079 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 964/1922] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:20:34 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1443 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:20:35.029702 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-1fe23393-6563-40eb-bff2-a36eb6e4d31c tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:20:35.030348 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-1fe23393-6563-40eb-bff2-a36eb6e4d31c tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] [instance: f6d81116-5b48-433f-8c7e-88f2a9687167] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:20:35.038049 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-1fe23393-6563-40eb-bff2-a36eb6e4d31c tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:35.038540 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-1fe23393-6563-40eb-bff2-a36eb6e4d31c tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:35.039325 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-1fe23393-6563-40eb-bff2-a36eb6e4d31c tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:35.039757 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-1fe23393-6563-40eb-bff2-a36eb6e4d31c tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:35.164644 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-1fe23393-6563-40eb-bff2-a36eb6e4d31c tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb8e090f8ae4a2381c9b82a8090f112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90112b6f3d31421a8ee18cbe7d6b0537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:35.178709 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-1fe23393-6563-40eb-bff2-a36eb6e4d31c tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] 10.222.0.60 "GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167" status: 200 len: 1350 microversion: 2.1 time: 0.152650 Nov 23 13:20:35.179726 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 959/1923] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:20:35 2021] GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167 => generated 1350 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:20:35.518995 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-06a09072-9c58-4648-b1b0-df0fe3629c62 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:20:35.519895 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-06a09072-9c58-4648-b1b0-df0fe3629c62 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:20:35.532865 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-06a09072-9c58-4648-b1b0-df0fe3629c62 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:35.534058 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-06a09072-9c58-4648-b1b0-df0fe3629c62 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:35.535145 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-06a09072-9c58-4648-b1b0-df0fe3629c62 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:35.535847 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-06a09072-9c58-4648-b1b0-df0fe3629c62 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:35.682255 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-06a09072-9c58-4648-b1b0-df0fe3629c62 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:35.692653 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-06a09072-9c58-4648-b1b0-df0fe3629c62 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:35.694117 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-06a09072-9c58-4648-b1b0-df0fe3629c62 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:35.695409 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-06a09072-9c58-4648-b1b0-df0fe3629c62 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1443 microversion: 2.20 time: 0.183466 Nov 23 13:20:35.695951 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 965/1924] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:20:35 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1443 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:20:36.200401 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-84f205cd-2406-4e24-8ee0-4c2e8caf2bde tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:20:36.201237 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-84f205cd-2406-4e24-8ee0-4c2e8caf2bde tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] [instance: f6d81116-5b48-433f-8c7e-88f2a9687167] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:20:36.214028 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-84f205cd-2406-4e24-8ee0-4c2e8caf2bde tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:36.214621 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-84f205cd-2406-4e24-8ee0-4c2e8caf2bde tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:36.215790 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-84f205cd-2406-4e24-8ee0-4c2e8caf2bde tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:36.216458 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-84f205cd-2406-4e24-8ee0-4c2e8caf2bde tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:36.343759 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-84f205cd-2406-4e24-8ee0-4c2e8caf2bde tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb8e090f8ae4a2381c9b82a8090f112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90112b6f3d31421a8ee18cbe7d6b0537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:36.355910 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-84f205cd-2406-4e24-8ee0-4c2e8caf2bde tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] 10.222.0.60 "GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167" status: 200 len: 1350 microversion: 2.1 time: 0.161587 Nov 23 13:20:36.356556 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 960/1925] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:20:36 2021] GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167 => generated 1350 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:20:36.726703 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-7802c7c3-526e-44c3-be6e-053ce8a86e7c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:20:36.727591 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-7802c7c3-526e-44c3-be6e-053ce8a86e7c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:20:36.739526 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7802c7c3-526e-44c3-be6e-053ce8a86e7c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:36.739971 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7802c7c3-526e-44c3-be6e-053ce8a86e7c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:36.740800 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7802c7c3-526e-44c3-be6e-053ce8a86e7c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:36.741230 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7802c7c3-526e-44c3-be6e-053ce8a86e7c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:36.865512 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-7802c7c3-526e-44c3-be6e-053ce8a86e7c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:36.875472 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-7802c7c3-526e-44c3-be6e-053ce8a86e7c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:36.877634 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-7802c7c3-526e-44c3-be6e-053ce8a86e7c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:36.878578 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-7802c7c3-526e-44c3-be6e-053ce8a86e7c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 200 len: 1443 microversion: 2.20 time: 0.158780 Nov 23 13:20:36.879144 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 966/1926] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:20:36 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 1443 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:20:37.381486 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-b08abf26-8fa8-46c0-8984-a60bf188b7d6 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:20:37.382133 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-b08abf26-8fa8-46c0-8984-a60bf188b7d6 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] [instance: f6d81116-5b48-433f-8c7e-88f2a9687167] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:20:37.390544 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b08abf26-8fa8-46c0-8984-a60bf188b7d6 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:37.391179 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b08abf26-8fa8-46c0-8984-a60bf188b7d6 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:37.392254 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b08abf26-8fa8-46c0-8984-a60bf188b7d6 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:37.392873 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b08abf26-8fa8-46c0-8984-a60bf188b7d6 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:37.467342 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b08abf26-8fa8-46c0-8984-a60bf188b7d6 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:37.467779 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b08abf26-8fa8-46c0-8984-a60bf188b7d6 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:37.468337 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.objects.instance [None req-b08abf26-8fa8-46c0-8984-a60bf188b7d6 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lazy-loading 'fault' on Instance uuid f6d81116-5b48-433f-8c7e-88f2a9687167 {{(pid=100973) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 23 13:20:37.542398 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-b08abf26-8fa8-46c0-8984-a60bf188b7d6 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb8e090f8ae4a2381c9b82a8090f112', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90112b6f3d31421a8ee18cbe7d6b0537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:37.552481 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-b08abf26-8fa8-46c0-8984-a60bf188b7d6 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] 10.222.0.60 "GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167" status: 200 len: 1444 microversion: 2.1 time: 0.175333 Nov 23 13:20:37.553092 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 961/1927] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:20:37 2021] GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167 => generated 1444 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:20:37.897019 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-452718ae-c635-4653-9765-06bb6325072c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:20:37.897642 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-452718ae-c635-4653-9765-06bb6325072c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:20:37.905587 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-452718ae-c635-4653-9765-06bb6325072c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:37.906038 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-452718ae-c635-4653-9765-06bb6325072c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:37.906870 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-452718ae-c635-4653-9765-06bb6325072c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:37.907310 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-452718ae-c635-4653-9765-06bb6325072c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:37.961332 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.wsgi [None req-452718ae-c635-4653-9765-06bb6325072c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] HTTP exception thrown: Instance b9c21729-a176-4e26-9074-f5f0bfc0ce20 could not be found. Nov 23 13:20:37.961912 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-452718ae-c635-4653-9765-06bb6325072c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Returning 404 to user: Instance b9c21729-a176-4e26-9074-f5f0bfc0ce20 could not be found. {{(pid=100974) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Nov 23 13:20:37.962760 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-452718ae-c635-4653-9765-06bb6325072c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 404 len: 111 microversion: 2.20 time: 0.069574 Nov 23 13:20:37.963332 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 967/1928] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:20:37 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 23 13:20:37.972724 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-eae65bc7-dd4b-4907-93de-9195004fefe3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '.version_select at 0x7f18706d6dc0>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:20:37.992193 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-eae65bc7-dd4b-4907-93de-9195004fefe3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1733058349" status: 204 len: 0 microversion: 2.20 time: 0.023844 Nov 23 13:20:37.992947 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 962/1929] 10.222.0.60 () {60 vars in 1261 bytes} [Tue Nov 23 13:20:37 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1733058349 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 23 13:20:38.708024 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-04547194-eb77-4630-84b2-5d6ecac94f14 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:20:38.708689 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-04547194-eb77-4630-84b2-5d6ecac94f14 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] [instance: f6d81116-5b48-433f-8c7e-88f2a9687167] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:20:38.716897 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-04547194-eb77-4630-84b2-5d6ecac94f14 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:38.717328 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-04547194-eb77-4630-84b2-5d6ecac94f14 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:38.718105 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-04547194-eb77-4630-84b2-5d6ecac94f14 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:38.718526 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-04547194-eb77-4630-84b2-5d6ecac94f14 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:38.772629 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.wsgi [None req-04547194-eb77-4630-84b2-5d6ecac94f14 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] HTTP exception thrown: Instance f6d81116-5b48-433f-8c7e-88f2a9687167 could not be found. Nov 23 13:20:38.773231 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-04547194-eb77-4630-84b2-5d6ecac94f14 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] Returning 404 to user: Instance f6d81116-5b48-433f-8c7e-88f2a9687167 could not be found. {{(pid=100974) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Nov 23 13:20:38.774059 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-04547194-eb77-4630-84b2-5d6ecac94f14 tempest-VolumesSnapshotTestJSON-598964391 tempest-VolumesSnapshotTestJSON-598964391-project] 10.222.0.60 "GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167" status: 404 len: 111 microversion: 2.1 time: 0.206317 Nov 23 13:20:38.774621 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 968/1930] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:20:38 2021] GET /compute/v2.1/servers/f6d81116-5b48-433f-8c7e-88f2a9687167 => generated 111 bytes in 208 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 13:20:39.289322 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-4ee48f3d-c666-4d5b-aebd-bc4097de599f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'create', calling method: .version_select at 0x7f1870676670>, body: {"keypair": {"name": "tempest-keypair-173820952"}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:20:39.313320 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.quota [None req-4ee48f3d-c666-4d5b-aebd-bc4097de599f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Getting quotas for project d3e13e13e1e54f208b7be1c18e3ab703. Resources: {'key_pairs'} {{(pid=100973) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 13:20:39.317816 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.quota [None req-4ee48f3d-c666-4d5b-aebd-bc4097de599f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Getting quotas for user 4540fb62ff264ba4929a567b548de846 and project d3e13e13e1e54f208b7be1c18e3ab703. Resources: {'key_pairs'} {{(pid=100973) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 13:20:39.717509 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.quota [None req-4ee48f3d-c666-4d5b-aebd-bc4097de599f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Getting quotas for project d3e13e13e1e54f208b7be1c18e3ab703. Resources: {'key_pairs'} {{(pid=100973) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 13:20:39.721642 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.quota [None req-4ee48f3d-c666-4d5b-aebd-bc4097de599f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Getting quotas for user 4540fb62ff264ba4929a567b548de846 and project d3e13e13e1e54f208b7be1c18e3ab703. Resources: {'key_pairs'} {{(pid=100973) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 13:20:39.735196 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-4ee48f3d-c666-4d5b-aebd-bc4097de599f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.20 time: 0.449891 Nov 23 13:20:39.735800 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 963/1931] 10.222.0.60 () {62 vars in 1198 bytes} [Tue Nov 23 13:20:39 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 451 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Nov 23 13:20:41.671790 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-8967e906-9c67-4221-b71f-8ccc7989085f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1688856580", "imageRef": "d01e1b62-4f14-4f64-9d63-d155732e33e8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "46c00580-7af0-47cf-b859-90a9d5ad1c01"}], "security_groups": [{"name": "tempest-securitygroup--30275746"}], "key_name": "tempest-keypair-173820952", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:20:41.823491 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.network.neutron [None req-8967e906-9c67-4221-b71f-8ccc7989085f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] validate_networks() for [('46c00580-7af0-47cf-b859-90a9d5ad1c01', None, None, None)] {{(pid=100974) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Nov 23 13:20:42.615498 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.virt.hardware [None req-8967e906-9c67-4221-b71f-8ccc7989085f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Flavor limits 0:0:0 {{(pid=100974) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 23 13:20:42.615916 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.virt.hardware [None req-8967e906-9c67-4221-b71f-8ccc7989085f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Image limits 0:0:0 {{(pid=100974) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 23 13:20:42.616426 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.virt.hardware [None req-8967e906-9c67-4221-b71f-8ccc7989085f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Flavor pref 0:0:0 {{(pid=100974) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 23 13:20:42.616836 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.virt.hardware [None req-8967e906-9c67-4221-b71f-8ccc7989085f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Image pref 0:0:0 {{(pid=100974) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 23 13:20:42.617246 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.virt.hardware [None req-8967e906-9c67-4221-b71f-8ccc7989085f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100974) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 23 13:20:42.626487 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8967e906-9c67-4221-b71f-8ccc7989085f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:42.628315 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8967e906-9c67-4221-b71f-8ccc7989085f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:42.628315 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8967e906-9c67-4221-b71f-8ccc7989085f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:42.628566 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8967e906-9c67-4221-b71f-8ccc7989085f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:42.646340 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.quota [None req-8967e906-9c67-4221-b71f-8ccc7989085f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Getting quotas for project d3e13e13e1e54f208b7be1c18e3ab703. Resources: {'ram', 'cores', 'instances'} {{(pid=100974) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 13:20:42.650480 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.quota [None req-8967e906-9c67-4221-b71f-8ccc7989085f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Getting quotas for user 4540fb62ff264ba4929a567b548de846 and project d3e13e13e1e54f208b7be1c18e3ab703. Resources: {'ram', 'cores', 'instances'} {{(pid=100974) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 13:20:42.662261 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-8967e906-9c67-4221-b71f-8ccc7989085f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Going to run 1 instances... {{(pid=100974) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Nov 23 13:20:42.664687 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-8967e906-9c67-4221-b71f-8ccc7989085f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: e7a3292e-8d9e-49ed-8529-e655dfc4e729] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d01e1b62-4f14-4f64-9d63-d155732e33e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100974) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Nov 23 13:20:42.725700 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-8967e906-9c67-4221-b71f-8ccc7989085f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 1.060646 Nov 23 13:20:42.726676 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 969/1932] 10.222.0.60 () {62 vars in 1187 bytes} [Tue Nov 23 13:20:41 2021] POST /compute/v2.1/servers => generated 400 bytes in 1063 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 23 13:20:42.738110 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-cdf81719-fc9b-4116-be02-d30af539b430 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:20:42.738811 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-cdf81719-fc9b-4116-be02-d30af539b430 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: e7a3292e-8d9e-49ed-8529-e655dfc4e729] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:20:42.834254 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-cdf81719-fc9b-4116-be02-d30af539b430 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:42.842559 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-cdf81719-fc9b-4116-be02-d30af539b430 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:42.843962 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-cdf81719-fc9b-4116-be02-d30af539b430 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:42.845080 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-cdf81719-fc9b-4116-be02-d30af539b430 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729" status: 200 len: 1281 microversion: 2.20 time: 0.111604 Nov 23 13:20:42.845898 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 964/1933] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:20:42 2021] GET /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729 => generated 1281 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:20:43.864937 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-e62c30bc-f9d9-42fc-bf7a-d7d63f11135b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:20:43.865581 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-e62c30bc-f9d9-42fc-bf7a-d7d63f11135b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: e7a3292e-8d9e-49ed-8529-e655dfc4e729] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:20:43.876992 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e62c30bc-f9d9-42fc-bf7a-d7d63f11135b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:43.877954 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e62c30bc-f9d9-42fc-bf7a-d7d63f11135b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:43.878807 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e62c30bc-f9d9-42fc-bf7a-d7d63f11135b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:43.879265 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e62c30bc-f9d9-42fc-bf7a-d7d63f11135b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:43.997227 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-e62c30bc-f9d9-42fc-bf7a-d7d63f11135b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:44.007076 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-e62c30bc-f9d9-42fc-bf7a-d7d63f11135b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:44.008667 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-e62c30bc-f9d9-42fc-bf7a-d7d63f11135b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:44.009789 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-e62c30bc-f9d9-42fc-bf7a-d7d63f11135b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729" status: 200 len: 1333 microversion: 2.20 time: 0.150064 Nov 23 13:20:44.010348 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 970/1934] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:20:43 2021] GET /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729 => generated 1333 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:20:45.027905 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-1baff15f-1637-4da0-bb8d-d6f0e9bd86ec tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:20:45.028600 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-1baff15f-1637-4da0-bb8d-d6f0e9bd86ec tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: e7a3292e-8d9e-49ed-8529-e655dfc4e729] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:20:45.037133 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-1baff15f-1637-4da0-bb8d-d6f0e9bd86ec tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:45.037593 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-1baff15f-1637-4da0-bb8d-d6f0e9bd86ec tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:45.038374 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-1baff15f-1637-4da0-bb8d-d6f0e9bd86ec tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:45.038799 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-1baff15f-1637-4da0-bb8d-d6f0e9bd86ec tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:45.278989 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-1baff15f-1637-4da0-bb8d-d6f0e9bd86ec tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:45.288377 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-1baff15f-1637-4da0-bb8d-d6f0e9bd86ec tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:45.289982 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-1baff15f-1637-4da0-bb8d-d6f0e9bd86ec tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:45.291157 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-1baff15f-1637-4da0-bb8d-d6f0e9bd86ec tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729" status: 200 len: 1405 microversion: 2.20 time: 0.267766 Nov 23 13:20:45.291781 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 965/1935] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:20:45 2021] GET /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729 => generated 1405 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:20:46.194580 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [req-af0ab5e9-5263-4ab7-a31a-f94593932f0a req-092f5b83-3e5b-4622-a3ba-e82a3c5f3c3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7a3292e-8d9e-49ed-8529-e655dfc4e729", "tag": "5d2844a3-4d6c-4f14-8943-d2b4055ff439"}]} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:20:46.196697 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 13:20:46.196697 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: warnings.warn(msg) Nov 23 13:20:46.206644 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [req-af0ab5e9-5263-4ab7-a31a-f94593932f0a req-092f5b83-3e5b-4622-a3ba-e82a3c5f3c3b service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:46.207220 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [req-af0ab5e9-5263-4ab7-a31a-f94593932f0a req-092f5b83-3e5b-4622-a3ba-e82a3c5f3c3b service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:46.225897 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.compute.server_external_events [req-af0ab5e9-5263-4ab7-a31a-f94593932f0a req-092f5b83-3e5b-4622-a3ba-e82a3c5f3c3b service nova] Creating event network-changed:5d2844a3-4d6c-4f14-8943-d2b4055ff439 for instance e7a3292e-8d9e-49ed-8529-e655dfc4e729 on hv-cinder-81888 Nov 23 13:20:46.231283 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [req-af0ab5e9-5263-4ab7-a31a-f94593932f0a req-092f5b83-3e5b-4622-a3ba-e82a3c5f3c3b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040919 Nov 23 13:20:46.232091 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 971/1936] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Nov 23 13:20:46 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 13:20:46.311708 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-3a7525c1-f93a-4b7f-b8f1-aeed6540460f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:20:46.313293 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-3a7525c1-f93a-4b7f-b8f1-aeed6540460f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: e7a3292e-8d9e-49ed-8529-e655dfc4e729] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:20:46.321464 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-3a7525c1-f93a-4b7f-b8f1-aeed6540460f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:46.321946 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-3a7525c1-f93a-4b7f-b8f1-aeed6540460f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:46.322710 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-3a7525c1-f93a-4b7f-b8f1-aeed6540460f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:46.323172 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-3a7525c1-f93a-4b7f-b8f1-aeed6540460f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:46.540583 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-3a7525c1-f93a-4b7f-b8f1-aeed6540460f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:46.551807 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-3a7525c1-f93a-4b7f-b8f1-aeed6540460f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:46.553312 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-3a7525c1-f93a-4b7f-b8f1-aeed6540460f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:46.554396 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-3a7525c1-f93a-4b7f-b8f1-aeed6540460f tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729" status: 200 len: 1405 microversion: 2.20 time: 0.246612 Nov 23 13:20:46.554956 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 966/1937] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:20:46 2021] GET /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729 => generated 1405 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:20:47.573386 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-5a192a5f-7142-4738-97c2-eb45734c2cc0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:20:47.574075 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-5a192a5f-7142-4738-97c2-eb45734c2cc0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: e7a3292e-8d9e-49ed-8529-e655dfc4e729] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:20:47.582297 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5a192a5f-7142-4738-97c2-eb45734c2cc0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:47.582798 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5a192a5f-7142-4738-97c2-eb45734c2cc0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:47.583549 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5a192a5f-7142-4738-97c2-eb45734c2cc0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:47.584045 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5a192a5f-7142-4738-97c2-eb45734c2cc0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:47.859981 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-5a192a5f-7142-4738-97c2-eb45734c2cc0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:47.869947 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-5a192a5f-7142-4738-97c2-eb45734c2cc0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:47.871460 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-5a192a5f-7142-4738-97c2-eb45734c2cc0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:47.872629 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-5a192a5f-7142-4738-97c2-eb45734c2cc0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729" status: 200 len: 1405 microversion: 2.20 time: 0.303494 Nov 23 13:20:47.873363 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 972/1938] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:20:47 2021] GET /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729 => generated 1405 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:20:48.896068 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-9b6aa9a1-587c-4d69-afcf-f0ca5d99c371 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:20:48.896730 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-9b6aa9a1-587c-4d69-afcf-f0ca5d99c371 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: e7a3292e-8d9e-49ed-8529-e655dfc4e729] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:20:48.907815 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-9b6aa9a1-587c-4d69-afcf-f0ca5d99c371 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:48.908505 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-9b6aa9a1-587c-4d69-afcf-f0ca5d99c371 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:48.909754 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-9b6aa9a1-587c-4d69-afcf-f0ca5d99c371 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:48.910256 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-9b6aa9a1-587c-4d69-afcf-f0ca5d99c371 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:49.120959 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-9b6aa9a1-587c-4d69-afcf-f0ca5d99c371 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:49.131792 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-9b6aa9a1-587c-4d69-afcf-f0ca5d99c371 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:49.133320 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-9b6aa9a1-587c-4d69-afcf-f0ca5d99c371 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:49.134419 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-9b6aa9a1-587c-4d69-afcf-f0ca5d99c371 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729" status: 200 len: 1405 microversion: 2.20 time: 0.244594 Nov 23 13:20:49.134981 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 967/1939] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:20:48 2021] GET /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729 => generated 1405 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 13:20:50.154708 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-f5d496d0-8697-4934-b809-cb2a48af2dd5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:20:50.155650 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-f5d496d0-8697-4934-b809-cb2a48af2dd5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: e7a3292e-8d9e-49ed-8529-e655dfc4e729] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:20:50.170317 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f5d496d0-8697-4934-b809-cb2a48af2dd5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:50.171062 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f5d496d0-8697-4934-b809-cb2a48af2dd5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:50.172222 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f5d496d0-8697-4934-b809-cb2a48af2dd5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:50.172750 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f5d496d0-8697-4934-b809-cb2a48af2dd5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:50.479046 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-f5d496d0-8697-4934-b809-cb2a48af2dd5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:50.489089 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-f5d496d0-8697-4934-b809-cb2a48af2dd5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:50.490591 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-f5d496d0-8697-4934-b809-cb2a48af2dd5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:50.491650 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-f5d496d0-8697-4934-b809-cb2a48af2dd5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729" status: 200 len: 1405 microversion: 2.20 time: 0.342603 Nov 23 13:20:50.492264 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 973/1940] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:20:50 2021] GET /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729 => generated 1405 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:20:51.515214 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-68c91c19-347b-448a-96f9-088bc0dc742e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:20:51.516039 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-68c91c19-347b-448a-96f9-088bc0dc742e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: e7a3292e-8d9e-49ed-8529-e655dfc4e729] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:20:51.526112 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-68c91c19-347b-448a-96f9-088bc0dc742e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:51.526560 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-68c91c19-347b-448a-96f9-088bc0dc742e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:51.527334 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-68c91c19-347b-448a-96f9-088bc0dc742e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:51.527761 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-68c91c19-347b-448a-96f9-088bc0dc742e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:51.743130 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-68c91c19-347b-448a-96f9-088bc0dc742e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:51.753046 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-68c91c19-347b-448a-96f9-088bc0dc742e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:51.754550 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-68c91c19-347b-448a-96f9-088bc0dc742e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:51.755623 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-68c91c19-347b-448a-96f9-088bc0dc742e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729" status: 200 len: 1405 microversion: 2.20 time: 0.246283 Nov 23 13:20:51.756301 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 968/1941] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:20:51 2021] GET /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729 => generated 1405 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:20:52.265252 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [req-c3599ae6-db7a-4cfb-a0f1-d7020e3c61c9 req-95aee88a-8894-4fa6-a568-91ec3f1baa7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7a3292e-8d9e-49ed-8529-e655dfc4e729", "name": "network-vif-plugged", "status": "completed", "tag": "5d2844a3-4d6c-4f14-8943-d2b4055ff439"}]} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:20:52.267307 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 13:20:52.267307 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: warnings.warn(msg) Nov 23 13:20:52.276330 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [req-c3599ae6-db7a-4cfb-a0f1-d7020e3c61c9 req-95aee88a-8894-4fa6-a568-91ec3f1baa7e service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:52.276737 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [req-c3599ae6-db7a-4cfb-a0f1-d7020e3c61c9 req-95aee88a-8894-4fa6-a568-91ec3f1baa7e service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:52.295320 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.compute.server_external_events [req-c3599ae6-db7a-4cfb-a0f1-d7020e3c61c9 req-95aee88a-8894-4fa6-a568-91ec3f1baa7e service nova] Creating event network-vif-plugged:5d2844a3-4d6c-4f14-8943-d2b4055ff439 for instance e7a3292e-8d9e-49ed-8529-e655dfc4e729 on hv-cinder-81888 Nov 23 13:20:52.301020 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [req-c3599ae6-db7a-4cfb-a0f1-d7020e3c61c9 req-95aee88a-8894-4fa6-a568-91ec3f1baa7e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102772 Nov 23 13:20:52.301620 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 974/1942] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Nov 23 13:20:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 13:20:52.781013 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-1b90f8ab-6779-461a-8516-f3ed7be19b8b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:20:52.781714 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-1b90f8ab-6779-461a-8516-f3ed7be19b8b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: e7a3292e-8d9e-49ed-8529-e655dfc4e729] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:20:52.792558 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-1b90f8ab-6779-461a-8516-f3ed7be19b8b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:52.793035 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-1b90f8ab-6779-461a-8516-f3ed7be19b8b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:52.793872 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-1b90f8ab-6779-461a-8516-f3ed7be19b8b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:52.794338 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-1b90f8ab-6779-461a-8516-f3ed7be19b8b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:53.010092 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-1b90f8ab-6779-461a-8516-f3ed7be19b8b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:53.022835 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-1b90f8ab-6779-461a-8516-f3ed7be19b8b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:53.024347 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-1b90f8ab-6779-461a-8516-f3ed7be19b8b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:53.025459 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-1b90f8ab-6779-461a-8516-f3ed7be19b8b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729" status: 200 len: 1405 microversion: 2.20 time: 0.250916 Nov 23 13:20:53.026049 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 969/1943] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:20:52 2021] GET /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729 => generated 1405 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:20:54.045397 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-25b960e9-832d-4202-9221-679668aa29d6 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:20:54.046048 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-25b960e9-832d-4202-9221-679668aa29d6 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: e7a3292e-8d9e-49ed-8529-e655dfc4e729] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:20:54.055004 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-25b960e9-832d-4202-9221-679668aa29d6 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:54.055576 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-25b960e9-832d-4202-9221-679668aa29d6 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:54.056400 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-25b960e9-832d-4202-9221-679668aa29d6 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:54.056829 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-25b960e9-832d-4202-9221-679668aa29d6 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:54.285979 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-25b960e9-832d-4202-9221-679668aa29d6 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:54.295996 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-25b960e9-832d-4202-9221-679668aa29d6 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:54.297433 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-25b960e9-832d-4202-9221-679668aa29d6 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:54.298521 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-25b960e9-832d-4202-9221-679668aa29d6 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729" status: 200 len: 1405 microversion: 2.20 time: 0.257745 Nov 23 13:20:54.299086 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 975/1944] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:20:54 2021] GET /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729 => generated 1405 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:20:55.318984 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-ce718d2d-1a24-4131-b329-e6413de73f30 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:20:55.319596 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-ce718d2d-1a24-4131-b329-e6413de73f30 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: e7a3292e-8d9e-49ed-8529-e655dfc4e729] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:20:55.327724 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ce718d2d-1a24-4131-b329-e6413de73f30 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:55.328159 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ce718d2d-1a24-4131-b329-e6413de73f30 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:55.328954 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ce718d2d-1a24-4131-b329-e6413de73f30 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:55.329379 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ce718d2d-1a24-4131-b329-e6413de73f30 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:55.540097 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-ce718d2d-1a24-4131-b329-e6413de73f30 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:55.549256 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-ce718d2d-1a24-4131-b329-e6413de73f30 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:55.550737 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-ce718d2d-1a24-4131-b329-e6413de73f30 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:20:55.551856 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-ce718d2d-1a24-4131-b329-e6413de73f30 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729" status: 200 len: 1598 microversion: 2.20 time: 0.236887 Nov 23 13:20:55.552435 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 970/1945] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:20:55 2021] GET /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729 => generated 1598 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:20:55.574952 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-5660daa1-19fe-44d4-92e2-d93d408535ae tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:20:55.575502 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-5660daa1-19fe-44d4-92e2-d93d408535ae tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: e7a3292e-8d9e-49ed-8529-e655dfc4e729] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:20:55.583463 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5660daa1-19fe-44d4-92e2-d93d408535ae tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:55.583904 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5660daa1-19fe-44d4-92e2-d93d408535ae tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:55.584713 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5660daa1-19fe-44d4-92e2-d93d408535ae tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:55.585148 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5660daa1-19fe-44d4-92e2-d93d408535ae tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:55.751631 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-5660daa1-19fe-44d4-92e2-d93d408535ae tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.180625 Nov 23 13:20:55.752249 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 976/1946] 10.222.0.60 () {60 vars in 1315 bytes} [Tue Nov 23 13:20:55 2021] GET /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729/os-interface => generated 285 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:20:57.608682 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-cd9616ce-a9a9-4258-9361-61c03fe2d97a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:20:57.610835 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-cd9616ce-a9a9-4258-9361-61c03fe2d97a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: e7a3292e-8d9e-49ed-8529-e655dfc4e729] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:20:57.611537 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [req-ceb7a514-561c-42b7-9f59-438ccf86e705 req-68ab8d74-f37f-44c2-a6be-03a34eec1b75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7a3292e-8d9e-49ed-8529-e655dfc4e729", "tag": "5d2844a3-4d6c-4f14-8943-d2b4055ff439"}]} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:20:57.614661 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 13:20:57.614661 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: warnings.warn(msg) Nov 23 13:20:57.619106 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-cd9616ce-a9a9-4258-9361-61c03fe2d97a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:57.619558 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-cd9616ce-a9a9-4258-9361-61c03fe2d97a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:57.620619 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-cd9616ce-a9a9-4258-9361-61c03fe2d97a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:57.621056 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-cd9616ce-a9a9-4258-9361-61c03fe2d97a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:57.630630 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [req-ceb7a514-561c-42b7-9f59-438ccf86e705 req-68ab8d74-f37f-44c2-a6be-03a34eec1b75 service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:57.631519 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [req-ceb7a514-561c-42b7-9f59-438ccf86e705 req-68ab8d74-f37f-44c2-a6be-03a34eec1b75 service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:57.657328 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.compute.server_external_events [req-ceb7a514-561c-42b7-9f59-438ccf86e705 req-68ab8d74-f37f-44c2-a6be-03a34eec1b75 service nova] Creating event network-changed:5d2844a3-4d6c-4f14-8943-d2b4055ff439 for instance e7a3292e-8d9e-49ed-8529-e655dfc4e729 on hv-cinder-81888 Nov 23 13:20:57.663119 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [req-ceb7a514-561c-42b7-9f59-438ccf86e705 req-68ab8d74-f37f-44c2-a6be-03a34eec1b75 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059162 Nov 23 13:20:57.664214 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 977/1947] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Nov 23 13:20:57 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 13:20:57.743154 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-cd9616ce-a9a9-4258-9361-61c03fe2d97a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729/action" status: 200 len: 14 microversion: 2.20 time: 0.139997 Nov 23 13:20:57.746484 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 971/1948] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:20:57 2021] POST /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729/action => generated 14 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 13:20:58.755113 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-67e16091-d1a5-4ded-85f5-305678da30d5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:20:58.756109 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-67e16091-d1a5-4ded-85f5-305678da30d5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: e7a3292e-8d9e-49ed-8529-e655dfc4e729] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:20:58.764080 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-67e16091-d1a5-4ded-85f5-305678da30d5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:58.764551 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-67e16091-d1a5-4ded-85f5-305678da30d5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:58.765321 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-67e16091-d1a5-4ded-85f5-305678da30d5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:58.765744 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-67e16091-d1a5-4ded-85f5-305678da30d5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:58.890704 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-67e16091-d1a5-4ded-85f5-305678da30d5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729/action" status: 200 len: 14 microversion: 2.20 time: 0.139721 Nov 23 13:20:58.891348 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 978/1949] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:20:58 2021] POST /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729/action => generated 14 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:20:59.903098 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-2017da70-5314-4453-a44c-186252a2a4ec tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:20:59.904095 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-2017da70-5314-4453-a44c-186252a2a4ec tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: e7a3292e-8d9e-49ed-8529-e655dfc4e729] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:20:59.912377 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-2017da70-5314-4453-a44c-186252a2a4ec tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:59.912819 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-2017da70-5314-4453-a44c-186252a2a4ec tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:20:59.913592 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-2017da70-5314-4453-a44c-186252a2a4ec tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:20:59.914011 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-2017da70-5314-4453-a44c-186252a2a4ec tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:21:00.031362 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-2017da70-5314-4453-a44c-186252a2a4ec tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729/action" status: 200 len: 14 microversion: 2.20 time: 0.132604 Nov 23 13:21:00.032034 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 972/1950] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:20:59 2021] POST /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729/action => generated 14 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:21:01.043794 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-a7150840-8efe-49cc-9a89-6488149e3976 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:21:01.044991 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-a7150840-8efe-49cc-9a89-6488149e3976 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: e7a3292e-8d9e-49ed-8529-e655dfc4e729] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:21:01.053421 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a7150840-8efe-49cc-9a89-6488149e3976 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:21:01.053877 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a7150840-8efe-49cc-9a89-6488149e3976 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:21:01.054672 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a7150840-8efe-49cc-9a89-6488149e3976 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:21:01.055104 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a7150840-8efe-49cc-9a89-6488149e3976 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:21:01.172301 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-a7150840-8efe-49cc-9a89-6488149e3976 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729/action" status: 200 len: 14 microversion: 2.20 time: 0.132683 Nov 23 13:21:01.172855 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 979/1951] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:21:01 2021] POST /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729/action => generated 14 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:21:02.188202 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-153cd66a-7398-40ed-963d-cec0026416e2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:21:02.189355 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-153cd66a-7398-40ed-963d-cec0026416e2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: e7a3292e-8d9e-49ed-8529-e655dfc4e729] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:21:02.198200 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-153cd66a-7398-40ed-963d-cec0026416e2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:21:02.198823 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-153cd66a-7398-40ed-963d-cec0026416e2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:21:02.199635 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-153cd66a-7398-40ed-963d-cec0026416e2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:21:02.200074 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-153cd66a-7398-40ed-963d-cec0026416e2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:21:02.316074 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-153cd66a-7398-40ed-963d-cec0026416e2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729/action" status: 200 len: 14 microversion: 2.20 time: 0.134351 Nov 23 13:21:02.316779 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 973/1952] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:21:02 2021] POST /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729/action => generated 14 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:21:03.328648 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-35e5e63d-920d-4fd6-b8bd-5b76641daf85 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:21:03.330191 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-35e5e63d-920d-4fd6-b8bd-5b76641daf85 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: e7a3292e-8d9e-49ed-8529-e655dfc4e729] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:21:03.342514 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-35e5e63d-920d-4fd6-b8bd-5b76641daf85 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:21:03.342973 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-35e5e63d-920d-4fd6-b8bd-5b76641daf85 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:21:03.343749 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-35e5e63d-920d-4fd6-b8bd-5b76641daf85 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:21:03.344177 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-35e5e63d-920d-4fd6-b8bd-5b76641daf85 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:21:03.471220 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-35e5e63d-920d-4fd6-b8bd-5b76641daf85 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729/action" status: 200 len: 14 microversion: 2.20 time: 0.146738 Nov 23 13:21:03.471763 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 980/1953] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:21:03 2021] POST /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729/action => generated 14 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:21:04.485783 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-8d72e0d6-7f4f-4999-9346-c20856aea6bb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:21:04.486734 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-8d72e0d6-7f4f-4999-9346-c20856aea6bb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: e7a3292e-8d9e-49ed-8529-e655dfc4e729] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:21:04.495056 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8d72e0d6-7f4f-4999-9346-c20856aea6bb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:21:04.495509 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8d72e0d6-7f4f-4999-9346-c20856aea6bb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:21:04.496330 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8d72e0d6-7f4f-4999-9346-c20856aea6bb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:21:04.496765 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8d72e0d6-7f4f-4999-9346-c20856aea6bb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:21:04.617582 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-8d72e0d6-7f4f-4999-9346-c20856aea6bb tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729/action" status: 200 len: 14 microversion: 2.20 time: 0.136915 Nov 23 13:21:04.618223 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 974/1954] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:21:04 2021] POST /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729/action => generated 14 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:21:05.633777 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-c0e3a515-c5aa-4d3d-829b-a7a05514676d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:21:05.635448 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-c0e3a515-c5aa-4d3d-829b-a7a05514676d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: e7a3292e-8d9e-49ed-8529-e655dfc4e729] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:21:05.645285 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c0e3a515-c5aa-4d3d-829b-a7a05514676d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:21:05.645723 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c0e3a515-c5aa-4d3d-829b-a7a05514676d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:21:05.646481 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c0e3a515-c5aa-4d3d-829b-a7a05514676d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:21:05.646895 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c0e3a515-c5aa-4d3d-829b-a7a05514676d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:21:05.774480 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-c0e3a515-c5aa-4d3d-829b-a7a05514676d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729/action" status: 200 len: 1337 microversion: 2.20 time: 0.147665 Nov 23 13:21:05.775176 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 981/1955] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:21:05 2021] POST /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729/action => generated 1337 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:21:06.786455 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-019a1af5-644d-4487-8563-ba2dfd44a767 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:21:06.787459 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-019a1af5-644d-4487-8563-ba2dfd44a767 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: e7a3292e-8d9e-49ed-8529-e655dfc4e729] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:21:06.798302 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-019a1af5-644d-4487-8563-ba2dfd44a767 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:21:06.799017 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-019a1af5-644d-4487-8563-ba2dfd44a767 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:21:06.800454 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-019a1af5-644d-4487-8563-ba2dfd44a767 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:21:06.801267 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-019a1af5-644d-4487-8563-ba2dfd44a767 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:21:06.983643 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-019a1af5-644d-4487-8563-ba2dfd44a767 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729/action" status: 200 len: 15025 microversion: 2.20 time: 0.201135 Nov 23 13:21:06.984298 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 975/1956] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:21:06 2021] POST /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729/action => generated 15025 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:21:07.996197 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-d0dec339-5615-4227-ae6a-afbccfb881ad tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:21:07.997222 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-d0dec339-5615-4227-ae6a-afbccfb881ad tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: e7a3292e-8d9e-49ed-8529-e655dfc4e729] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:21:08.005602 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d0dec339-5615-4227-ae6a-afbccfb881ad tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:21:08.006044 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d0dec339-5615-4227-ae6a-afbccfb881ad tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:21:08.006815 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d0dec339-5615-4227-ae6a-afbccfb881ad tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:21:08.007244 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d0dec339-5615-4227-ae6a-afbccfb881ad tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:21:08.141855 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-d0dec339-5615-4227-ae6a-afbccfb881ad tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729/action" status: 200 len: 18663 microversion: 2.20 time: 0.149473 Nov 23 13:21:08.142428 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 982/1957] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:21:07 2021] POST /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729/action => generated 18663 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:21:09.155121 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-9827d1e1-4c55-43c5-adc5-600cde3ff6e1 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:21:09.156037 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-9827d1e1-4c55-43c5-adc5-600cde3ff6e1 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: e7a3292e-8d9e-49ed-8529-e655dfc4e729] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:21:09.164988 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-9827d1e1-4c55-43c5-adc5-600cde3ff6e1 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:21:09.165444 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-9827d1e1-4c55-43c5-adc5-600cde3ff6e1 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:21:09.166222 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-9827d1e1-4c55-43c5-adc5-600cde3ff6e1 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:21:09.166645 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-9827d1e1-4c55-43c5-adc5-600cde3ff6e1 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:21:09.297125 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-9827d1e1-4c55-43c5-adc5-600cde3ff6e1 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729/action" status: 200 len: 20173 microversion: 2.20 time: 0.146511 Nov 23 13:21:09.297797 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 976/1958] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:21:09 2021] POST /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729/action => generated 20173 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:21:10.310201 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-72ec1230-c153-4366-9c4b-0da6cd3f3b9b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:21:10.311268 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-72ec1230-c153-4366-9c4b-0da6cd3f3b9b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: e7a3292e-8d9e-49ed-8529-e655dfc4e729] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:21:10.319386 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-72ec1230-c153-4366-9c4b-0da6cd3f3b9b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:21:10.319827 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-72ec1230-c153-4366-9c4b-0da6cd3f3b9b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:21:10.320627 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-72ec1230-c153-4366-9c4b-0da6cd3f3b9b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:21:10.321049 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-72ec1230-c153-4366-9c4b-0da6cd3f3b9b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:21:10.450077 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-72ec1230-c153-4366-9c4b-0da6cd3f3b9b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729/action" status: 200 len: 22897 microversion: 2.20 time: 0.143144 Nov 23 13:21:10.450873 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 983/1959] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:21:10 2021] POST /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729/action => generated 22897 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:21:11.462205 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-f9e69558-e487-4a44-b93b-ddf7a04da50c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:21:11.463257 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-f9e69558-e487-4a44-b93b-ddf7a04da50c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: e7a3292e-8d9e-49ed-8529-e655dfc4e729] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:21:11.472589 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f9e69558-e487-4a44-b93b-ddf7a04da50c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:21:11.473029 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f9e69558-e487-4a44-b93b-ddf7a04da50c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:21:11.473802 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f9e69558-e487-4a44-b93b-ddf7a04da50c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:21:11.474222 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f9e69558-e487-4a44-b93b-ddf7a04da50c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:21:11.601763 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-f9e69558-e487-4a44-b93b-ddf7a04da50c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729/action" status: 200 len: 24043 microversion: 2.20 time: 0.143708 Nov 23 13:21:11.602413 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 977/1960] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:21:11 2021] POST /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729/action => generated 24043 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:21:12.615072 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-562ddc12-e21f-44e9-ae38-8422c45059d2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:21:12.616098 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-562ddc12-e21f-44e9-ae38-8422c45059d2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: e7a3292e-8d9e-49ed-8529-e655dfc4e729] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:21:12.625089 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-562ddc12-e21f-44e9-ae38-8422c45059d2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:21:12.625528 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-562ddc12-e21f-44e9-ae38-8422c45059d2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:21:12.626323 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-562ddc12-e21f-44e9-ae38-8422c45059d2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:21:12.626759 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-562ddc12-e21f-44e9-ae38-8422c45059d2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:21:12.755688 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-562ddc12-e21f-44e9-ae38-8422c45059d2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729/action" status: 200 len: 25849 microversion: 2.20 time: 0.144908 Nov 23 13:21:12.756339 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 984/1961] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:21:12 2021] POST /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729/action => generated 25849 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:21:13.768126 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-d99ed50c-259d-4650-8b97-6a140c695282 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:21:13.769244 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-d99ed50c-259d-4650-8b97-6a140c695282 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: e7a3292e-8d9e-49ed-8529-e655dfc4e729] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:21:13.777483 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d99ed50c-259d-4650-8b97-6a140c695282 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:21:13.777942 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d99ed50c-259d-4650-8b97-6a140c695282 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:21:13.778812 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d99ed50c-259d-4650-8b97-6a140c695282 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:21:13.779246 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d99ed50c-259d-4650-8b97-6a140c695282 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:21:13.923958 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-d99ed50c-259d-4650-8b97-6a140c695282 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729/action" status: 200 len: 27174 microversion: 2.20 time: 0.159904 Nov 23 13:21:13.924676 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 978/1962] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:21:13 2021] POST /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729/action => generated 27174 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:21:14.937224 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-09994f9e-a14f-4f54-a3f1-da784a9c4968 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:21:14.938142 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-09994f9e-a14f-4f54-a3f1-da784a9c4968 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: e7a3292e-8d9e-49ed-8529-e655dfc4e729] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:21:14.946376 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-09994f9e-a14f-4f54-a3f1-da784a9c4968 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:21:14.946814 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-09994f9e-a14f-4f54-a3f1-da784a9c4968 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:21:14.947574 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-09994f9e-a14f-4f54-a3f1-da784a9c4968 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:21:14.947997 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-09994f9e-a14f-4f54-a3f1-da784a9c4968 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:21:15.073552 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-09994f9e-a14f-4f54-a3f1-da784a9c4968 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729/action" status: 200 len: 27752 microversion: 2.20 time: 0.140866 Nov 23 13:21:15.074199 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 985/1963] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:21:14 2021] POST /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729/action => generated 27752 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:21:16.086777 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-14b74d15-8906-4cdc-a56d-580419b0cb21 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:21:16.087781 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-14b74d15-8906-4cdc-a56d-580419b0cb21 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: e7a3292e-8d9e-49ed-8529-e655dfc4e729] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:21:16.096542 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-14b74d15-8906-4cdc-a56d-580419b0cb21 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:21:16.096990 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-14b74d15-8906-4cdc-a56d-580419b0cb21 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:21:16.097768 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-14b74d15-8906-4cdc-a56d-580419b0cb21 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:21:16.098201 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-14b74d15-8906-4cdc-a56d-580419b0cb21 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:21:16.222977 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-14b74d15-8906-4cdc-a56d-580419b0cb21 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729/action" status: 200 len: 28175 microversion: 2.20 time: 0.140252 Nov 23 13:21:16.223570 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 979/1964] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:21:16 2021] POST /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729/action => generated 28175 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:21:17.236088 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-94fb46e2-d654-45b9-b9d6-78abd077cec4 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:21:17.237156 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-94fb46e2-d654-45b9-b9d6-78abd077cec4 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: e7a3292e-8d9e-49ed-8529-e655dfc4e729] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:21:17.245529 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-94fb46e2-d654-45b9-b9d6-78abd077cec4 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:21:17.245974 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-94fb46e2-d654-45b9-b9d6-78abd077cec4 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:21:17.247275 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-94fb46e2-d654-45b9-b9d6-78abd077cec4 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:21:17.247275 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-94fb46e2-d654-45b9-b9d6-78abd077cec4 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:21:17.369878 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-94fb46e2-d654-45b9-b9d6-78abd077cec4 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729/action" status: 200 len: 28175 microversion: 2.20 time: 0.138352 Nov 23 13:21:17.370533 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 986/1965] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:21:17 2021] POST /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729/action => generated 28175 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:21:18.385132 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-1667bda2-dd5a-4c52-b0ac-0eebc8c15677 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:21:18.386209 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-1667bda2-dd5a-4c52-b0ac-0eebc8c15677 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: e7a3292e-8d9e-49ed-8529-e655dfc4e729] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:21:18.397280 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-1667bda2-dd5a-4c52-b0ac-0eebc8c15677 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:21:18.397725 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-1667bda2-dd5a-4c52-b0ac-0eebc8c15677 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:21:18.398501 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-1667bda2-dd5a-4c52-b0ac-0eebc8c15677 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:21:18.398930 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-1667bda2-dd5a-4c52-b0ac-0eebc8c15677 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:21:18.520488 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-1667bda2-dd5a-4c52-b0ac-0eebc8c15677 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729/action" status: 200 len: 28175 microversion: 2.20 time: 0.141487 Nov 23 13:21:18.521285 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 980/1966] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:21:18 2021] POST /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729/action => generated 28175 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:21:19.533930 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-368cf7b1-f32c-4a98-a4a2-8ccd0be11914 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:21:19.534952 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-368cf7b1-f32c-4a98-a4a2-8ccd0be11914 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: e7a3292e-8d9e-49ed-8529-e655dfc4e729] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:21:19.543468 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-368cf7b1-f32c-4a98-a4a2-8ccd0be11914 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:21:19.543993 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-368cf7b1-f32c-4a98-a4a2-8ccd0be11914 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:21:19.544807 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-368cf7b1-f32c-4a98-a4a2-8ccd0be11914 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:21:19.545892 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-368cf7b1-f32c-4a98-a4a2-8ccd0be11914 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:21:19.661698 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-368cf7b1-f32c-4a98-a4a2-8ccd0be11914 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729/action" status: 200 len: 28175 microversion: 2.20 time: 0.132240 Nov 23 13:21:19.662356 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 987/1967] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:21:19 2021] POST /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729/action => generated 28175 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:21:20.674102 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-f83a937d-3dea-4b70-9d06-2d18211c7838 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:21:20.675142 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-f83a937d-3dea-4b70-9d06-2d18211c7838 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: e7a3292e-8d9e-49ed-8529-e655dfc4e729] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:21:20.683943 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f83a937d-3dea-4b70-9d06-2d18211c7838 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:21:20.684605 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f83a937d-3dea-4b70-9d06-2d18211c7838 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:21:20.685397 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f83a937d-3dea-4b70-9d06-2d18211c7838 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:21:20.685821 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f83a937d-3dea-4b70-9d06-2d18211c7838 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:21:20.811283 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-f83a937d-3dea-4b70-9d06-2d18211c7838 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729/action" status: 200 len: 28175 microversion: 2.20 time: 0.141076 Nov 23 13:21:20.811954 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 981/1968] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:21:20 2021] POST /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729/action => generated 28175 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:21:21.824562 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-7fa54f85-5a58-4c0b-80e8-4a05362faa9a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:21:21.825873 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-7fa54f85-5a58-4c0b-80e8-4a05362faa9a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: e7a3292e-8d9e-49ed-8529-e655dfc4e729] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:21:21.834348 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7fa54f85-5a58-4c0b-80e8-4a05362faa9a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:21:21.834818 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7fa54f85-5a58-4c0b-80e8-4a05362faa9a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:21:21.835859 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7fa54f85-5a58-4c0b-80e8-4a05362faa9a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:21:21.836321 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7fa54f85-5a58-4c0b-80e8-4a05362faa9a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:21:21.958809 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-7fa54f85-5a58-4c0b-80e8-4a05362faa9a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729/action" status: 200 len: 28175 microversion: 2.20 time: 0.138801 Nov 23 13:21:21.959463 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 988/1969] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:21:21 2021] POST /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729/action => generated 28175 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:21:22.972460 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-78a5e585-446d-41b0-a11a-c5b3a86b4062 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:21:22.973488 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-78a5e585-446d-41b0-a11a-c5b3a86b4062 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: e7a3292e-8d9e-49ed-8529-e655dfc4e729] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:21:22.982280 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-78a5e585-446d-41b0-a11a-c5b3a86b4062 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:21:22.982814 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-78a5e585-446d-41b0-a11a-c5b3a86b4062 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:21:22.983604 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-78a5e585-446d-41b0-a11a-c5b3a86b4062 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:21:22.984028 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-78a5e585-446d-41b0-a11a-c5b3a86b4062 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:21:23.107362 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-78a5e585-446d-41b0-a11a-c5b3a86b4062 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729/action" status: 200 len: 28175 microversion: 2.20 time: 0.138605 Nov 23 13:21:23.107996 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 982/1970] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:21:22 2021] POST /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729/action => generated 28175 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:21:24.120622 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-d5b7ec20-3a1a-416a-81ed-8157bf9ac934 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:21:24.121693 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-d5b7ec20-3a1a-416a-81ed-8157bf9ac934 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: e7a3292e-8d9e-49ed-8529-e655dfc4e729] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:21:24.130572 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d5b7ec20-3a1a-416a-81ed-8157bf9ac934 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:21:24.130912 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d5b7ec20-3a1a-416a-81ed-8157bf9ac934 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:21:24.131560 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d5b7ec20-3a1a-416a-81ed-8157bf9ac934 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:21:24.132042 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d5b7ec20-3a1a-416a-81ed-8157bf9ac934 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:21:24.253826 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-d5b7ec20-3a1a-416a-81ed-8157bf9ac934 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729/action" status: 200 len: 28175 microversion: 2.20 time: 0.137893 Nov 23 13:21:24.254498 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 989/1971] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:21:24 2021] POST /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729/action => generated 28175 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:21:25.267251 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-3ec34dce-76b9-4ea5-ade6-21ad6c53855b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:21:25.268254 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-3ec34dce-76b9-4ea5-ade6-21ad6c53855b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: e7a3292e-8d9e-49ed-8529-e655dfc4e729] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:21:25.276665 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-3ec34dce-76b9-4ea5-ade6-21ad6c53855b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:21:25.277101 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-3ec34dce-76b9-4ea5-ade6-21ad6c53855b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:21:25.277935 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-3ec34dce-76b9-4ea5-ade6-21ad6c53855b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:21:25.278495 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-3ec34dce-76b9-4ea5-ade6-21ad6c53855b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:21:25.400447 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-3ec34dce-76b9-4ea5-ade6-21ad6c53855b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729/action" status: 200 len: 28175 microversion: 2.20 time: 0.137493 Nov 23 13:21:25.401111 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 983/1972] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:21:25 2021] POST /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729/action => generated 28175 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:21:26.413703 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-5a359a19-9fd8-4408-a785-61f0934b9e64 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:21:26.414605 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-5a359a19-9fd8-4408-a785-61f0934b9e64 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: e7a3292e-8d9e-49ed-8529-e655dfc4e729] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:21:26.423730 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5a359a19-9fd8-4408-a785-61f0934b9e64 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:21:26.424179 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5a359a19-9fd8-4408-a785-61f0934b9e64 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:21:26.425005 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5a359a19-9fd8-4408-a785-61f0934b9e64 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:21:26.425440 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5a359a19-9fd8-4408-a785-61f0934b9e64 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:21:26.565927 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-5a359a19-9fd8-4408-a785-61f0934b9e64 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729/action" status: 200 len: 28175 microversion: 2.20 time: 0.156316 Nov 23 13:21:26.566606 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 990/1973] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:21:26 2021] POST /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729/action => generated 28175 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:21:27.579620 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-946604a8-cec5-47f0-ae96-49a2de01d829 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:21:27.580678 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-946604a8-cec5-47f0-ae96-49a2de01d829 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: e7a3292e-8d9e-49ed-8529-e655dfc4e729] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:21:27.589118 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-946604a8-cec5-47f0-ae96-49a2de01d829 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:21:27.589557 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-946604a8-cec5-47f0-ae96-49a2de01d829 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:21:27.590371 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-946604a8-cec5-47f0-ae96-49a2de01d829 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:21:27.591108 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-946604a8-cec5-47f0-ae96-49a2de01d829 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:21:27.720500 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-946604a8-cec5-47f0-ae96-49a2de01d829 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729/action" status: 200 len: 28466 microversion: 2.20 time: 0.145286 Nov 23 13:21:27.721174 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 984/1974] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:21:27 2021] POST /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729/action => generated 28466 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:21:28.733351 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-2a476597-a71a-4fa7-a811-2008e58e063c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:21:28.734381 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-2a476597-a71a-4fa7-a811-2008e58e063c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: e7a3292e-8d9e-49ed-8529-e655dfc4e729] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:21:28.742704 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2a476597-a71a-4fa7-a811-2008e58e063c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:21:28.743152 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2a476597-a71a-4fa7-a811-2008e58e063c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:21:28.743921 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2a476597-a71a-4fa7-a811-2008e58e063c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:21:28.744397 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2a476597-a71a-4fa7-a811-2008e58e063c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:21:28.868414 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-2a476597-a71a-4fa7-a811-2008e58e063c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729/action" status: 200 len: 28466 microversion: 2.20 time: 0.139070 Nov 23 13:21:28.869459 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 991/1975] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:21:28 2021] POST /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729/action => generated 28466 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:21:29.883661 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-ae9ef13e-5fae-4f8d-b270-b47d97e2a44d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:21:29.884670 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-ae9ef13e-5fae-4f8d-b270-b47d97e2a44d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: e7a3292e-8d9e-49ed-8529-e655dfc4e729] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:21:29.893340 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ae9ef13e-5fae-4f8d-b270-b47d97e2a44d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:21:29.893778 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ae9ef13e-5fae-4f8d-b270-b47d97e2a44d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:21:29.894859 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ae9ef13e-5fae-4f8d-b270-b47d97e2a44d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:21:29.894989 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ae9ef13e-5fae-4f8d-b270-b47d97e2a44d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:21:30.019620 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-ae9ef13e-5fae-4f8d-b270-b47d97e2a44d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729/action" status: 200 len: 28634 microversion: 2.20 time: 0.139955 Nov 23 13:21:30.020274 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 985/1976] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:21:29 2021] POST /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729/action => generated 28634 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:21:31.032967 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-e3c261d0-de11-4b9f-bfb3-7480ab66809e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:21:31.034040 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-e3c261d0-de11-4b9f-bfb3-7480ab66809e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: e7a3292e-8d9e-49ed-8529-e655dfc4e729] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:21:31.042714 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e3c261d0-de11-4b9f-bfb3-7480ab66809e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:21:31.043162 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e3c261d0-de11-4b9f-bfb3-7480ab66809e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:21:31.043969 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e3c261d0-de11-4b9f-bfb3-7480ab66809e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:21:31.044442 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e3c261d0-de11-4b9f-bfb3-7480ab66809e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:21:31.166633 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-e3c261d0-de11-4b9f-bfb3-7480ab66809e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729/action" status: 200 len: 28634 microversion: 2.20 time: 0.137672 Nov 23 13:21:31.167198 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 992/1977] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:21:31 2021] POST /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729/action => generated 28634 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:21:32.179388 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-43cb141a-a471-4280-9bf4-e92e35599ad5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:21:32.180352 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-43cb141a-a471-4280-9bf4-e92e35599ad5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: e7a3292e-8d9e-49ed-8529-e655dfc4e729] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:21:32.188988 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-43cb141a-a471-4280-9bf4-e92e35599ad5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:21:32.189435 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-43cb141a-a471-4280-9bf4-e92e35599ad5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:21:32.190211 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-43cb141a-a471-4280-9bf4-e92e35599ad5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:21:32.190640 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-43cb141a-a471-4280-9bf4-e92e35599ad5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:21:32.308282 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-43cb141a-a471-4280-9bf4-e92e35599ad5 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729/action" status: 200 len: 28634 microversion: 2.20 time: 0.133129 Nov 23 13:21:32.309017 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 986/1978] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:21:32 2021] POST /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729/action => generated 28634 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:21:33.320973 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-c0092d5a-7616-418d-bdf6-997a1372f072 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:21:33.321977 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-c0092d5a-7616-418d-bdf6-997a1372f072 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: e7a3292e-8d9e-49ed-8529-e655dfc4e729] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:21:33.330683 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c0092d5a-7616-418d-bdf6-997a1372f072 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:21:33.331130 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c0092d5a-7616-418d-bdf6-997a1372f072 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:21:33.331924 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c0092d5a-7616-418d-bdf6-997a1372f072 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:21:33.332381 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c0092d5a-7616-418d-bdf6-997a1372f072 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:21:33.453384 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-c0092d5a-7616-418d-bdf6-997a1372f072 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729/action" status: 200 len: 28634 microversion: 2.20 time: 0.136526 Nov 23 13:21:33.454083 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 993/1979] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:21:33 2021] POST /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729/action => generated 28634 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:21:34.466507 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-7f369486-d480-47bb-ad47-8fac098f5e5a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:21:34.467718 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-7f369486-d480-47bb-ad47-8fac098f5e5a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: e7a3292e-8d9e-49ed-8529-e655dfc4e729] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:21:34.476055 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-7f369486-d480-47bb-ad47-8fac098f5e5a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:21:34.476541 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-7f369486-d480-47bb-ad47-8fac098f5e5a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:21:34.477350 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-7f369486-d480-47bb-ad47-8fac098f5e5a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:21:34.477761 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-7f369486-d480-47bb-ad47-8fac098f5e5a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:21:34.598232 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-7f369486-d480-47bb-ad47-8fac098f5e5a tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729/action" status: 200 len: 28634 microversion: 2.20 time: 0.136225 Nov 23 13:21:34.598849 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 987/1980] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:21:34 2021] POST /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729/action => generated 28634 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:21:35.612413 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-9ee304a7-6263-470b-acc2-985fbfe97ae1 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:21:35.613522 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-9ee304a7-6263-470b-acc2-985fbfe97ae1 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: e7a3292e-8d9e-49ed-8529-e655dfc4e729] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:21:35.622295 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-9ee304a7-6263-470b-acc2-985fbfe97ae1 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:21:35.622833 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-9ee304a7-6263-470b-acc2-985fbfe97ae1 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:21:35.623615 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-9ee304a7-6263-470b-acc2-985fbfe97ae1 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:21:35.624049 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-9ee304a7-6263-470b-acc2-985fbfe97ae1 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:21:35.743825 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-9ee304a7-6263-470b-acc2-985fbfe97ae1 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729/action" status: 200 len: 28634 microversion: 2.20 time: 0.135552 Nov 23 13:21:35.744426 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 994/1981] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:21:35 2021] POST /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729/action => generated 28634 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:21:36.756688 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-efc60029-ba73-46a0-9182-5ab18ea26ac7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:21:36.757699 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-efc60029-ba73-46a0-9182-5ab18ea26ac7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: e7a3292e-8d9e-49ed-8529-e655dfc4e729] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:21:36.766151 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-efc60029-ba73-46a0-9182-5ab18ea26ac7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:21:36.766583 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-efc60029-ba73-46a0-9182-5ab18ea26ac7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:21:36.767344 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-efc60029-ba73-46a0-9182-5ab18ea26ac7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:21:36.767764 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-efc60029-ba73-46a0-9182-5ab18ea26ac7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:21:36.887131 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-efc60029-ba73-46a0-9182-5ab18ea26ac7 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729/action" status: 200 len: 28634 microversion: 2.20 time: 0.134531 Nov 23 13:21:36.888058 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 988/1982] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:21:36 2021] POST /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729/action => generated 28634 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:21:37.900132 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-2ebc220c-ea88-43ec-83a8-eab98bd72d03 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:21:37.901196 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-2ebc220c-ea88-43ec-83a8-eab98bd72d03 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: e7a3292e-8d9e-49ed-8529-e655dfc4e729] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:21:37.911457 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2ebc220c-ea88-43ec-83a8-eab98bd72d03 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:21:37.911900 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2ebc220c-ea88-43ec-83a8-eab98bd72d03 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:21:37.912709 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2ebc220c-ea88-43ec-83a8-eab98bd72d03 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:21:37.913143 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2ebc220c-ea88-43ec-83a8-eab98bd72d03 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:21:38.038216 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-2ebc220c-ea88-43ec-83a8-eab98bd72d03 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729/action" status: 200 len: 28634 microversion: 2.20 time: 0.142244 Nov 23 13:21:38.038904 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 995/1983] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:21:37 2021] POST /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729/action => generated 28634 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:21:39.052008 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-da045923-5052-468d-8f0b-a0f39e5db2ab tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:21:39.053071 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-da045923-5052-468d-8f0b-a0f39e5db2ab tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: e7a3292e-8d9e-49ed-8529-e655dfc4e729] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:21:39.062183 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-da045923-5052-468d-8f0b-a0f39e5db2ab tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:21:39.062634 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-da045923-5052-468d-8f0b-a0f39e5db2ab tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:21:39.063448 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-da045923-5052-468d-8f0b-a0f39e5db2ab tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:21:39.063878 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-da045923-5052-468d-8f0b-a0f39e5db2ab tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:21:39.187172 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-da045923-5052-468d-8f0b-a0f39e5db2ab tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729/action" status: 200 len: 28634 microversion: 2.20 time: 0.139303 Nov 23 13:21:39.187876 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 989/1984] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:21:39 2021] POST /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729/action => generated 28634 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:21:40.200436 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-5b3dcb4f-6a8d-49ac-9c82-6863f2686044 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:21:40.201688 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-5b3dcb4f-6a8d-49ac-9c82-6863f2686044 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: e7a3292e-8d9e-49ed-8529-e655dfc4e729] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:21:40.210945 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5b3dcb4f-6a8d-49ac-9c82-6863f2686044 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:21:40.211421 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5b3dcb4f-6a8d-49ac-9c82-6863f2686044 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:21:40.212285 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5b3dcb4f-6a8d-49ac-9c82-6863f2686044 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:21:40.212767 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5b3dcb4f-6a8d-49ac-9c82-6863f2686044 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:21:40.352262 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-5b3dcb4f-6a8d-49ac-9c82-6863f2686044 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729/action" status: 200 len: 28634 microversion: 2.20 time: 0.156323 Nov 23 13:21:40.353207 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 996/1985] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:21:40 2021] POST /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729/action => generated 28634 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:21:41.365887 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-6726bb66-7c4f-4b06-9d85-a29c6abfeacd tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:21:41.367165 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-6726bb66-7c4f-4b06-9d85-a29c6abfeacd tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: e7a3292e-8d9e-49ed-8529-e655dfc4e729] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:21:41.376093 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6726bb66-7c4f-4b06-9d85-a29c6abfeacd tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:21:41.376566 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6726bb66-7c4f-4b06-9d85-a29c6abfeacd tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:21:41.377352 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6726bb66-7c4f-4b06-9d85-a29c6abfeacd tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:21:41.377777 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6726bb66-7c4f-4b06-9d85-a29c6abfeacd tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:21:41.505783 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-6726bb66-7c4f-4b06-9d85-a29c6abfeacd tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729/action" status: 200 len: 28634 microversion: 2.20 time: 0.143701 Nov 23 13:21:41.506995 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 990/1986] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:21:41 2021] POST /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729/action => generated 28634 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:21:42.519584 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-9bf3b49e-3bb7-42a3-9799-fb1d8bf146c6 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:21:42.520623 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-9bf3b49e-3bb7-42a3-9799-fb1d8bf146c6 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: e7a3292e-8d9e-49ed-8529-e655dfc4e729] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:21:42.529208 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-9bf3b49e-3bb7-42a3-9799-fb1d8bf146c6 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:21:42.529659 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-9bf3b49e-3bb7-42a3-9799-fb1d8bf146c6 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:21:42.530540 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-9bf3b49e-3bb7-42a3-9799-fb1d8bf146c6 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:21:42.530963 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-9bf3b49e-3bb7-42a3-9799-fb1d8bf146c6 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:21:42.650841 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-9bf3b49e-3bb7-42a3-9799-fb1d8bf146c6 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729/action" status: 200 len: 28634 microversion: 2.20 time: 0.134915 Nov 23 13:21:42.651799 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 997/1987] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:21:42 2021] POST /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729/action => generated 28634 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:21:43.665165 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-6bfba0ef-a841-4da3-a920-d9aa918af8b8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:21:43.666169 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-6bfba0ef-a841-4da3-a920-d9aa918af8b8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: e7a3292e-8d9e-49ed-8529-e655dfc4e729] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:21:43.674659 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6bfba0ef-a841-4da3-a920-d9aa918af8b8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:21:43.675088 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6bfba0ef-a841-4da3-a920-d9aa918af8b8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:21:43.675868 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6bfba0ef-a841-4da3-a920-d9aa918af8b8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:21:43.676326 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6bfba0ef-a841-4da3-a920-d9aa918af8b8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:21:43.791885 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-6bfba0ef-a841-4da3-a920-d9aa918af8b8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729/action" status: 200 len: 28634 microversion: 2.20 time: 0.130683 Nov 23 13:21:43.792574 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 991/1988] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:21:43 2021] POST /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729/action => generated 28634 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:21:44.804179 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-7ff4bdae-aa38-44db-8093-e5c702533bc8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:21:44.805189 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-7ff4bdae-aa38-44db-8093-e5c702533bc8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: e7a3292e-8d9e-49ed-8529-e655dfc4e729] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:21:44.813759 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7ff4bdae-aa38-44db-8093-e5c702533bc8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:21:44.814199 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7ff4bdae-aa38-44db-8093-e5c702533bc8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:21:44.814969 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7ff4bdae-aa38-44db-8093-e5c702533bc8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:21:44.815388 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-7ff4bdae-aa38-44db-8093-e5c702533bc8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:21:44.951967 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-7ff4bdae-aa38-44db-8093-e5c702533bc8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729/action" status: 200 len: 28634 microversion: 2.20 time: 0.151550 Nov 23 13:21:44.952655 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 998/1989] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:21:44 2021] POST /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729/action => generated 28634 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:21:45.964419 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-4c62bb66-8f8c-4c2c-810c-8321d9973c5b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:21:45.965568 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-4c62bb66-8f8c-4c2c-810c-8321d9973c5b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: e7a3292e-8d9e-49ed-8529-e655dfc4e729] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:21:45.974253 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4c62bb66-8f8c-4c2c-810c-8321d9973c5b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:21:45.974695 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4c62bb66-8f8c-4c2c-810c-8321d9973c5b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:21:45.975472 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4c62bb66-8f8c-4c2c-810c-8321d9973c5b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:21:45.975897 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4c62bb66-8f8c-4c2c-810c-8321d9973c5b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:21:46.100342 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-4c62bb66-8f8c-4c2c-810c-8321d9973c5b tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729/action" status: 200 len: 28634 microversion: 2.20 time: 0.140179 Nov 23 13:21:46.101023 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 992/1990] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:21:45 2021] POST /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729/action => generated 28634 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:21:47.113874 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-0926751d-a63f-4528-af68-f790c5a9a699 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:21:47.114766 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-0926751d-a63f-4528-af68-f790c5a9a699 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: e7a3292e-8d9e-49ed-8529-e655dfc4e729] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:21:47.123145 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0926751d-a63f-4528-af68-f790c5a9a699 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:21:47.123586 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0926751d-a63f-4528-af68-f790c5a9a699 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:21:47.124388 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0926751d-a63f-4528-af68-f790c5a9a699 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:21:47.124812 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0926751d-a63f-4528-af68-f790c5a9a699 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:21:47.242184 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-0926751d-a63f-4528-af68-f790c5a9a699 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729/action" status: 200 len: 28634 microversion: 2.20 time: 0.132458 Nov 23 13:21:47.242874 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 999/1991] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:21:47 2021] POST /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729/action => generated 28634 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:21:48.256788 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-c912f7a1-4ff0-44f3-85d1-5760b02b5b21 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:21:48.258482 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-c912f7a1-4ff0-44f3-85d1-5760b02b5b21 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: e7a3292e-8d9e-49ed-8529-e655dfc4e729] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:21:48.271583 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c912f7a1-4ff0-44f3-85d1-5760b02b5b21 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:21:48.272073 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c912f7a1-4ff0-44f3-85d1-5760b02b5b21 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:21:48.272879 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c912f7a1-4ff0-44f3-85d1-5760b02b5b21 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:21:48.273307 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c912f7a1-4ff0-44f3-85d1-5760b02b5b21 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:21:48.412254 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-c912f7a1-4ff0-44f3-85d1-5760b02b5b21 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729/action" status: 200 len: 28634 microversion: 2.20 time: 0.160985 Nov 23 13:21:48.412943 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 993/1992] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:21:48 2021] POST /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729/action => generated 28634 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:21:49.425424 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-f1e95bbe-86b7-4308-984a-48ebec93a632 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:21:49.426574 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-f1e95bbe-86b7-4308-984a-48ebec93a632 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: e7a3292e-8d9e-49ed-8529-e655dfc4e729] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:21:49.435328 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f1e95bbe-86b7-4308-984a-48ebec93a632 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:21:49.435770 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f1e95bbe-86b7-4308-984a-48ebec93a632 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:21:49.436565 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f1e95bbe-86b7-4308-984a-48ebec93a632 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:21:49.436996 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f1e95bbe-86b7-4308-984a-48ebec93a632 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:21:49.556934 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-f1e95bbe-86b7-4308-984a-48ebec93a632 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729/action" status: 200 len: 28634 microversion: 2.20 time: 0.135902 Nov 23 13:21:49.557590 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1000/1993] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:21:49 2021] POST /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729/action => generated 28634 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:21:50.570402 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-bc567b37-f91d-40a7-bbcc-06882182b4b6 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:21:50.571470 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-bc567b37-f91d-40a7-bbcc-06882182b4b6 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: e7a3292e-8d9e-49ed-8529-e655dfc4e729] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:21:50.580719 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-bc567b37-f91d-40a7-bbcc-06882182b4b6 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:21:50.581165 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-bc567b37-f91d-40a7-bbcc-06882182b4b6 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:21:50.581939 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-bc567b37-f91d-40a7-bbcc-06882182b4b6 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:21:50.582367 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-bc567b37-f91d-40a7-bbcc-06882182b4b6 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:21:50.705413 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-bc567b37-f91d-40a7-bbcc-06882182b4b6 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729/action" status: 200 len: 28634 microversion: 2.20 time: 0.139104 Nov 23 13:21:50.706116 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 994/1994] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:21:50 2021] POST /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729/action => generated 28634 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:21:51.718733 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-af5b1e7d-cfeb-4fc6-97e7-f61178497026 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:21:51.719734 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-af5b1e7d-cfeb-4fc6-97e7-f61178497026 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: e7a3292e-8d9e-49ed-8529-e655dfc4e729] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:21:51.728611 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-af5b1e7d-cfeb-4fc6-97e7-f61178497026 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:21:51.729082 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-af5b1e7d-cfeb-4fc6-97e7-f61178497026 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:21:51.729870 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-af5b1e7d-cfeb-4fc6-97e7-f61178497026 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:21:51.730307 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-af5b1e7d-cfeb-4fc6-97e7-f61178497026 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:21:51.850945 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-af5b1e7d-cfeb-4fc6-97e7-f61178497026 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729/action" status: 200 len: 28634 microversion: 2.20 time: 0.136439 Nov 23 13:21:51.851905 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1001/1995] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:21:51 2021] POST /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729/action => generated 28634 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:21:52.866164 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-3b6de0e0-18eb-4719-abe5-2d22457d31bc tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:21:52.867235 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-3b6de0e0-18eb-4719-abe5-2d22457d31bc tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: e7a3292e-8d9e-49ed-8529-e655dfc4e729] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:21:52.875939 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-3b6de0e0-18eb-4719-abe5-2d22457d31bc tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:21:52.876413 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-3b6de0e0-18eb-4719-abe5-2d22457d31bc tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:21:52.877196 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-3b6de0e0-18eb-4719-abe5-2d22457d31bc tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:21:52.877631 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-3b6de0e0-18eb-4719-abe5-2d22457d31bc tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:21:52.997368 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-3b6de0e0-18eb-4719-abe5-2d22457d31bc tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729/action" status: 200 len: 28634 microversion: 2.20 time: 0.136674 Nov 23 13:21:52.998170 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 995/1996] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:21:52 2021] POST /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729/action => generated 28634 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:21:54.009865 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-3a364761-c624-42fd-9570-534c877810f8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:21:54.010938 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-3a364761-c624-42fd-9570-534c877810f8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: e7a3292e-8d9e-49ed-8529-e655dfc4e729] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:21:54.020656 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3a364761-c624-42fd-9570-534c877810f8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:21:54.021113 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3a364761-c624-42fd-9570-534c877810f8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:21:54.021917 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3a364761-c624-42fd-9570-534c877810f8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:21:54.022345 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3a364761-c624-42fd-9570-534c877810f8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:21:54.154889 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-3a364761-c624-42fd-9570-534c877810f8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729/action" status: 200 len: 29953 microversion: 2.20 time: 0.148585 Nov 23 13:21:54.155714 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1002/1997] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:21:54 2021] POST /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729/action => generated 29953 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:21:55.168462 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-f493dda8-f38e-4d27-aa4d-e9e6b13ffd7c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:21:55.169410 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-f493dda8-f38e-4d27-aa4d-e9e6b13ffd7c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: e7a3292e-8d9e-49ed-8529-e655dfc4e729] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:21:55.178163 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f493dda8-f38e-4d27-aa4d-e9e6b13ffd7c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:21:55.178610 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f493dda8-f38e-4d27-aa4d-e9e6b13ffd7c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:21:55.179395 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f493dda8-f38e-4d27-aa4d-e9e6b13ffd7c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:21:55.179827 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f493dda8-f38e-4d27-aa4d-e9e6b13ffd7c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:21:55.458300 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-f493dda8-f38e-4d27-aa4d-e9e6b13ffd7c tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729/action" status: 200 len: 32419 microversion: 2.20 time: 0.294091 Nov 23 13:21:55.458880 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 996/1998] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:21:55 2021] POST /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729/action => generated 32419 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:21:56.470923 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-a2be1f3b-c462-4e37-a601-bb0f0ed94bfa tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:21:56.472166 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-a2be1f3b-c462-4e37-a601-bb0f0ed94bfa tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: e7a3292e-8d9e-49ed-8529-e655dfc4e729] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:21:56.482065 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a2be1f3b-c462-4e37-a601-bb0f0ed94bfa tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:21:56.482520 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a2be1f3b-c462-4e37-a601-bb0f0ed94bfa tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:21:56.483333 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a2be1f3b-c462-4e37-a601-bb0f0ed94bfa tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:21:56.483765 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a2be1f3b-c462-4e37-a601-bb0f0ed94bfa tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:21:56.620429 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-a2be1f3b-c462-4e37-a601-bb0f0ed94bfa tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729/action" status: 200 len: 33605 microversion: 2.20 time: 0.153574 Nov 23 13:21:56.621108 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1003/1999] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:21:56 2021] POST /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729/action => generated 33605 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:21:57.633704 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-bc441edd-e724-40cd-9139-41b148d010d2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:21:57.634611 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-bc441edd-e724-40cd-9139-41b148d010d2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: e7a3292e-8d9e-49ed-8529-e655dfc4e729] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:21:57.643353 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-bc441edd-e724-40cd-9139-41b148d010d2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:21:57.643795 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-bc441edd-e724-40cd-9139-41b148d010d2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:21:57.644585 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-bc441edd-e724-40cd-9139-41b148d010d2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:21:57.644994 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-bc441edd-e724-40cd-9139-41b148d010d2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:21:57.765458 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-bc441edd-e724-40cd-9139-41b148d010d2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729/action" status: 200 len: 34931 microversion: 2.20 time: 0.135982 Nov 23 13:21:57.766109 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 997/2000] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:21:57 2021] POST /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729/action => generated 34931 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 13:21:58.778976 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-37931f9d-8944-4d0f-b2df-37d5327998b0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:21:58.780062 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-37931f9d-8944-4d0f-b2df-37d5327998b0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: e7a3292e-8d9e-49ed-8529-e655dfc4e729] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:21:58.788677 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-37931f9d-8944-4d0f-b2df-37d5327998b0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:21:58.789116 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-37931f9d-8944-4d0f-b2df-37d5327998b0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:21:58.789909 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-37931f9d-8944-4d0f-b2df-37d5327998b0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:21:58.790329 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-37931f9d-8944-4d0f-b2df-37d5327998b0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:21:58.941304 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-37931f9d-8944-4d0f-b2df-37d5327998b0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729/action" status: 200 len: 36307 microversion: 2.20 time: 0.166978 Nov 23 13:21:58.941993 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1004/2001] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:21:58 2021] POST /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729/action => generated 36307 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:21:59.954070 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-4c78848c-98aa-46fc-882a-876f4063c9c8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:21:59.955123 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-4c78848c-98aa-46fc-882a-876f4063c9c8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: e7a3292e-8d9e-49ed-8529-e655dfc4e729] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:21:59.963667 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4c78848c-98aa-46fc-882a-876f4063c9c8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:21:59.964096 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4c78848c-98aa-46fc-882a-876f4063c9c8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:21:59.964957 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4c78848c-98aa-46fc-882a-876f4063c9c8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:21:59.965423 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4c78848c-98aa-46fc-882a-876f4063c9c8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:22:00.094674 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-4c78848c-98aa-46fc-882a-876f4063c9c8 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729/action" status: 200 len: 38013 microversion: 2.20 time: 0.144582 Nov 23 13:22:00.095352 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 998/2002] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:21:59 2021] POST /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729/action => generated 38013 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:22:01.108857 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-5dd5b7c7-56dd-48b2-ae8b-c16bda12631d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:22:01.109847 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-5dd5b7c7-56dd-48b2-ae8b-c16bda12631d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: e7a3292e-8d9e-49ed-8529-e655dfc4e729] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:22:01.118202 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5dd5b7c7-56dd-48b2-ae8b-c16bda12631d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:22:01.118575 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5dd5b7c7-56dd-48b2-ae8b-c16bda12631d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:22:01.119346 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5dd5b7c7-56dd-48b2-ae8b-c16bda12631d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:22:01.119771 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5dd5b7c7-56dd-48b2-ae8b-c16bda12631d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:22:01.241245 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-5dd5b7c7-56dd-48b2-ae8b-c16bda12631d tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729/action" status: 200 len: 38193 microversion: 2.20 time: 0.136769 Nov 23 13:22:01.241968 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1005/2003] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:22:01 2021] POST /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729/action => generated 38193 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:22:02.254361 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-c56e043d-dd06-45f2-9805-4cdfdf99d2f0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:22:02.255292 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-c56e043d-dd06-45f2-9805-4cdfdf99d2f0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: e7a3292e-8d9e-49ed-8529-e655dfc4e729] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:22:02.264286 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c56e043d-dd06-45f2-9805-4cdfdf99d2f0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:22:02.264735 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c56e043d-dd06-45f2-9805-4cdfdf99d2f0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:22:02.265525 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c56e043d-dd06-45f2-9805-4cdfdf99d2f0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:22:02.265954 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c56e043d-dd06-45f2-9805-4cdfdf99d2f0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:22:02.382844 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-c56e043d-dd06-45f2-9805-4cdfdf99d2f0 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729/action" status: 200 len: 38193 microversion: 2.20 time: 0.132614 Nov 23 13:22:02.383571 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 999/2004] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:22:02 2021] POST /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729/action => generated 38193 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:22:03.396471 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-bd6e7271-5f80-4750-bb7b-3f7477c513f3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:22:03.397519 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-bd6e7271-5f80-4750-bb7b-3f7477c513f3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: e7a3292e-8d9e-49ed-8529-e655dfc4e729] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:22:03.406156 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-bd6e7271-5f80-4750-bb7b-3f7477c513f3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:22:03.406599 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-bd6e7271-5f80-4750-bb7b-3f7477c513f3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:22:03.407374 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-bd6e7271-5f80-4750-bb7b-3f7477c513f3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:22:03.407793 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-bd6e7271-5f80-4750-bb7b-3f7477c513f3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:22:03.546315 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-bd6e7271-5f80-4750-bb7b-3f7477c513f3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729/action" status: 200 len: 38193 microversion: 2.20 time: 0.153937 Nov 23 13:22:03.546982 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1006/2005] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:22:03 2021] POST /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729/action => generated 38193 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 13:22:04.559558 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-d87fc01c-9c3a-413b-adfb-8830551835f2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:22:04.560614 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-d87fc01c-9c3a-413b-adfb-8830551835f2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: e7a3292e-8d9e-49ed-8529-e655dfc4e729] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:22:04.572814 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d87fc01c-9c3a-413b-adfb-8830551835f2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:22:04.573264 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d87fc01c-9c3a-413b-adfb-8830551835f2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:22:04.574020 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d87fc01c-9c3a-413b-adfb-8830551835f2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:22:04.574816 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d87fc01c-9c3a-413b-adfb-8830551835f2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:22:04.702521 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-d87fc01c-9c3a-413b-adfb-8830551835f2 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729/action" status: 200 len: 38212 microversion: 2.20 time: 0.147035 Nov 23 13:22:04.703460 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1000/2006] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:22:04 2021] POST /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729/action => generated 38212 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:22:05.715615 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-85659b1e-a7e8-4b2d-ba13-e488b26c58a4 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:22:05.716862 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-85659b1e-a7e8-4b2d-ba13-e488b26c58a4 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: e7a3292e-8d9e-49ed-8529-e655dfc4e729] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:22:05.725193 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-85659b1e-a7e8-4b2d-ba13-e488b26c58a4 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:22:05.725637 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-85659b1e-a7e8-4b2d-ba13-e488b26c58a4 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:22:05.726407 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-85659b1e-a7e8-4b2d-ba13-e488b26c58a4 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:22:05.726863 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-85659b1e-a7e8-4b2d-ba13-e488b26c58a4 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:22:05.854872 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-85659b1e-a7e8-4b2d-ba13-e488b26c58a4 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "POST /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729/action" status: 200 len: 38336 microversion: 2.20 time: 0.143215 Nov 23 13:22:05.855953 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1007/2007] 10.222.0.60 () {62 vars in 1318 bytes} [Tue Nov 23 13:22:05 2021] POST /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729/action => generated 38336 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:22:05.867087 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-ee3e4223-e7c7-4a51-a2a6-50a4fe7ca5fd tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:22:05.867640 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-ee3e4223-e7c7-4a51-a2a6-50a4fe7ca5fd tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: e7a3292e-8d9e-49ed-8529-e655dfc4e729] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:22:05.875674 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ee3e4223-e7c7-4a51-a2a6-50a4fe7ca5fd tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:22:05.876149 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ee3e4223-e7c7-4a51-a2a6-50a4fe7ca5fd tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:22:05.876936 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ee3e4223-e7c7-4a51-a2a6-50a4fe7ca5fd tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:22:05.877360 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ee3e4223-e7c7-4a51-a2a6-50a4fe7ca5fd tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:22:05.936475 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-ee3e4223-e7c7-4a51-a2a6-50a4fe7ca5fd tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729/ips" status: 200 len: 152 microversion: 2.20 time: 0.073559 Nov 23 13:22:05.937028 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1001/2008] 10.222.0.60 () {60 vars in 1288 bytes} [Tue Nov 23 13:22:05 2021] GET /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729/ips => generated 152 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:22:45.047344 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 13:22:45.048137 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: Tue Nov 23 13:22:45 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 23 13:22:47.954525 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 13:22:47.955226 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: Tue Nov 23 13:22:47 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 23 13:22:48.579037 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 13:22:48.579715 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: Tue Nov 23 13:22:48 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 23 13:23:50.441204 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 13:23:50.441204 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: Tue Nov 23 13:23:50 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 23 13:24:45.301310 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 13:24:45.302162 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: Tue Nov 23 13:24:45 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 23 13:24:52.238596 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 13:24:52.239575 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: Tue Nov 23 13:24:52 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 23 13:26:05.066745 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 13:26:05.066745 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: Tue Nov 23 13:26:05 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 23 13:26:07.981902 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 13:26:07.982511 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: Tue Nov 23 13:26:07 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 23 13:26:08.598870 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 13:26:08.599457 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: Tue Nov 23 13:26:08 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 23 13:27:10.461606 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 13:27:10.462286 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: Tue Nov 23 13:27:10 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 23 13:28:05.326895 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 13:28:05.327559 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: Tue Nov 23 13:28:05 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 23 13:28:06.964917 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a7b7a666-a1ad-48b3-bbff-ac4178364592] AMQP server on 10.222.0.60:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 23 13:28:06.969348 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-d9038452-400d-435f-a99a-13dd150a2c89 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:28:06.969967 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-d9038452-400d-435f-a99a-13dd150a2c89 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: e7a3292e-8d9e-49ed-8529-e655dfc4e729] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:28:06.978489 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d9038452-400d-435f-a99a-13dd150a2c89 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:28:06.978949 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d9038452-400d-435f-a99a-13dd150a2c89 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:28:06.980026 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d9038452-400d-435f-a99a-13dd150a2c89 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:28:06.980503 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d9038452-400d-435f-a99a-13dd150a2c89 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:28:07.041386 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-d9038452-400d-435f-a99a-13dd150a2c89 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: e7a3292e-8d9e-49ed-8529-e655dfc4e729] Going to try to terminate instance {{(pid=100974) delete /opt/stack/nova/nova/compute/api.py:2562}} Nov 23 13:28:07.139710 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d9038452-400d-435f-a99a-13dd150a2c89 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [84671955-b4c7-4173-ab59-59cf4c4e4fb0] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 23 13:28:07.992903 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO oslo.messaging._drivers.impl_rabbit [-] [a7b7a666-a1ad-48b3-bbff-ac4178364592] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 53974. Nov 23 13:28:08.158511 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO oslo.messaging._drivers.impl_rabbit [None req-d9038452-400d-435f-a99a-13dd150a2c89 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [84671955-b4c7-4173-ab59-59cf4c4e4fb0] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 53976. Nov 23 13:28:08.182477 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-d9038452-400d-435f-a99a-13dd150a2c89 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "DELETE /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729" status: 204 len: 0 microversion: 2.20 time: 1.219010 Nov 23 13:28:08.183278 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1008/2009] 10.222.0.60 () {60 vars in 1279 bytes} [Tue Nov 23 13:28:06 2021] DELETE /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729 => generated 0 bytes in 1221 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 23 13:28:08.189715 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8c3a1481-9693-4499-8478-a55e09a5b02f] AMQP server on 10.222.0.60:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 23 13:28:08.193238 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-08d70644-26ca-4d1a-aa7e-66609ba455f1 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:28:08.193703 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-08d70644-26ca-4d1a-aa7e-66609ba455f1 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: e7a3292e-8d9e-49ed-8529-e655dfc4e729] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:28:08.201648 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-08d70644-26ca-4d1a-aa7e-66609ba455f1 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:28:08.202092 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-08d70644-26ca-4d1a-aa7e-66609ba455f1 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:28:08.202865 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-08d70644-26ca-4d1a-aa7e-66609ba455f1 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:28:08.203293 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-08d70644-26ca-4d1a-aa7e-66609ba455f1 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:28:08.490307 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-08d70644-26ca-4d1a-aa7e-66609ba455f1 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:28:08.499391 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-08d70644-26ca-4d1a-aa7e-66609ba455f1 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:28:08.500981 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-08d70644-26ca-4d1a-aa7e-66609ba455f1 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:28:08.502137 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-08d70644-26ca-4d1a-aa7e-66609ba455f1 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729" status: 200 len: 1722 microversion: 2.20 time: 0.314539 Nov 23 13:28:08.502724 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1002/2010] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:28:08 2021] GET /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729 => generated 1722 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:28:09.522941 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-0f9b1798-247c-4818-bf63-2058402a960e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:28:09.523643 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-0f9b1798-247c-4818-bf63-2058402a960e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: e7a3292e-8d9e-49ed-8529-e655dfc4e729] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:28:09.532729 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0f9b1798-247c-4818-bf63-2058402a960e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:28:09.533170 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0f9b1798-247c-4818-bf63-2058402a960e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:28:09.533952 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0f9b1798-247c-4818-bf63-2058402a960e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:28:09.534541 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0f9b1798-247c-4818-bf63-2058402a960e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:28:10.112188 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-0f9b1798-247c-4818-bf63-2058402a960e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:28:10.125338 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-0f9b1798-247c-4818-bf63-2058402a960e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:28:10.127452 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-0f9b1798-247c-4818-bf63-2058402a960e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:28:10.129973 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-0f9b1798-247c-4818-bf63-2058402a960e tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729" status: 200 len: 1722 microversion: 2.20 time: 0.611426 Nov 23 13:28:10.131626 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1009/2011] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:28:09 2021] GET /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729 => generated 1722 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:28:10.713479 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO oslo.messaging._drivers.impl_rabbit [-] [8c3a1481-9693-4499-8478-a55e09a5b02f] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 53996. Nov 23 13:28:10.789507 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [req-c67d3cb1-2630-416d-a12d-1b2fcbb38a32 req-8bc03626-4f28-4c9a-835e-0020b81d13b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7a3292e-8d9e-49ed-8529-e655dfc4e729", "name": "network-vif-deleted", "tag": "5d2844a3-4d6c-4f14-8943-d2b4055ff439"}]} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:28:10.791091 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 13:28:10.791091 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: warnings.warn(msg) Nov 23 13:28:10.806604 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [req-c67d3cb1-2630-416d-a12d-1b2fcbb38a32 req-8bc03626-4f28-4c9a-835e-0020b81d13b5 service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:28:10.807470 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [req-c67d3cb1-2630-416d-a12d-1b2fcbb38a32 req-8bc03626-4f28-4c9a-835e-0020b81d13b5 service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:28:10.827236 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.compute.server_external_events [req-c67d3cb1-2630-416d-a12d-1b2fcbb38a32 req-8bc03626-4f28-4c9a-835e-0020b81d13b5 service nova] Creating event network-vif-deleted:5d2844a3-4d6c-4f14-8943-d2b4055ff439 for instance e7a3292e-8d9e-49ed-8529-e655dfc4e729 on hv-cinder-81888 Nov 23 13:28:10.836159 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [req-c67d3cb1-2630-416d-a12d-1b2fcbb38a32 req-8bc03626-4f28-4c9a-835e-0020b81d13b5 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149800 Nov 23 13:28:10.837525 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1003/2012] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Nov 23 13:28:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 13:28:11.153548 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-f450eb1a-35d6-4373-863b-8e4e0fcf88e3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:28:11.154224 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-f450eb1a-35d6-4373-863b-8e4e0fcf88e3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: e7a3292e-8d9e-49ed-8529-e655dfc4e729] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:28:11.165406 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f450eb1a-35d6-4373-863b-8e4e0fcf88e3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:28:11.165928 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f450eb1a-35d6-4373-863b-8e4e0fcf88e3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:28:11.166866 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f450eb1a-35d6-4373-863b-8e4e0fcf88e3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:28:11.167393 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f450eb1a-35d6-4373-863b-8e4e0fcf88e3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:28:11.241054 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f450eb1a-35d6-4373-863b-8e4e0fcf88e3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:28:11.242436 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f450eb1a-35d6-4373-863b-8e4e0fcf88e3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:28:11.242436 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.objects.instance [None req-f450eb1a-35d6-4373-863b-8e4e0fcf88e3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lazy-loading 'fault' on Instance uuid e7a3292e-8d9e-49ed-8529-e655dfc4e729 {{(pid=100974) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 23 13:28:11.326012 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-f450eb1a-35d6-4373-863b-8e4e0fcf88e3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:28:11.337667 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-f450eb1a-35d6-4373-863b-8e4e0fcf88e3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:28:11.339110 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-f450eb1a-35d6-4373-863b-8e4e0fcf88e3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4540fb62ff264ba4929a567b548de846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e13e13e1e54f208b7be1c18e3ab703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:28:11.341098 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-f450eb1a-35d6-4373-863b-8e4e0fcf88e3 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729" status: 200 len: 1371 microversion: 2.20 time: 0.191889 Nov 23 13:28:11.341688 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1010/2013] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:28:11 2021] GET /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729 => generated 1371 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 13:28:12.361946 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-a0f28d1d-a4a2-4ded-92ba-267a11987429 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:28:12.362638 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-a0f28d1d-a4a2-4ded-92ba-267a11987429 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: e7a3292e-8d9e-49ed-8529-e655dfc4e729] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:28:12.372450 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a0f28d1d-a4a2-4ded-92ba-267a11987429 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:28:12.372892 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a0f28d1d-a4a2-4ded-92ba-267a11987429 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:28:12.373666 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a0f28d1d-a4a2-4ded-92ba-267a11987429 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:28:12.374097 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a0f28d1d-a4a2-4ded-92ba-267a11987429 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:28:12.425061 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.wsgi [None req-a0f28d1d-a4a2-4ded-92ba-267a11987429 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] HTTP exception thrown: Instance e7a3292e-8d9e-49ed-8529-e655dfc4e729 could not be found. Nov 23 13:28:12.425660 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-a0f28d1d-a4a2-4ded-92ba-267a11987429 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Returning 404 to user: Instance e7a3292e-8d9e-49ed-8529-e655dfc4e729 could not be found. {{(pid=100973) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Nov 23 13:28:12.426486 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-a0f28d1d-a4a2-4ded-92ba-267a11987429 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729" status: 404 len: 111 microversion: 2.20 time: 0.069197 Nov 23 13:28:12.427123 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1004/2014] 10.222.0.60 () {60 vars in 1276 bytes} [Tue Nov 23 13:28:12 2021] GET /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 23 13:28:12.436753 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-b9ddcd97-dad5-4df8-ab6e-f10ca0281473 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '.version_select at 0x7f18703591f0>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:28:12.460696 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-b9ddcd97-dad5-4df8-ab6e-f10ca0281473 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-173820952" status: 204 len: 0 microversion: 2.20 time: 0.028559 Nov 23 13:28:12.461184 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1011/2015] 10.222.0.60 () {60 vars in 1258 bytes} [Tue Nov 23 13:28:12 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-173820952 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 23 13:29:25.087022 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 13:29:25.088037 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: Tue Nov 23 13:29:25 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 23 13:29:28.001207 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 13:29:28.001780 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: Tue Nov 23 13:29:28 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 23 13:29:28.616871 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 13:29:28.617469 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: Tue Nov 23 13:29:28 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 23 13:31:25.346091 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 13:31:25.347043 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: Tue Nov 23 13:31:25 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 23 13:32:45.110760 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 13:32:45.111554 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: Tue Nov 23 13:32:45 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 23 13:32:48.020844 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 13:32:48.021484 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: Tue Nov 23 13:32:48 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 23 13:32:48.634764 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 13:32:48.635385 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: Tue Nov 23 13:32:48 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 23 13:33:12.267888 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 13:33:12.268448 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: Tue Nov 23 13:33:12 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 23 13:33:50.486178 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 13:33:50.486960 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: Tue Nov 23 13:33:50 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 23 13:34:14.041780 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8c3a1481-9693-4499-8478-a55e09a5b02f] AMQP server on 10.222.0.60:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 23 13:34:14.045708 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-d205040f-6eed-4392-a577-3492fc02ea91 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:34:14.046211 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-d205040f-6eed-4392-a577-3492fc02ea91 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: e7a3292e-8d9e-49ed-8529-e655dfc4e729] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:34:14.053798 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d205040f-6eed-4392-a577-3492fc02ea91 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:34:14.054238 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d205040f-6eed-4392-a577-3492fc02ea91 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:34:14.055006 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d205040f-6eed-4392-a577-3492fc02ea91 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:34:14.055430 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d205040f-6eed-4392-a577-3492fc02ea91 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:34:14.112371 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.wsgi [None req-d205040f-6eed-4392-a577-3492fc02ea91 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] HTTP exception thrown: Instance e7a3292e-8d9e-49ed-8529-e655dfc4e729 could not be found. Nov 23 13:34:14.113076 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-d205040f-6eed-4392-a577-3492fc02ea91 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Returning 404 to user: Instance e7a3292e-8d9e-49ed-8529-e655dfc4e729 could not be found. {{(pid=100973) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Nov 23 13:34:14.113990 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-d205040f-6eed-4392-a577-3492fc02ea91 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "DELETE /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729" status: 404 len: 111 microversion: 2.1 time: 0.073885 Nov 23 13:34:14.114577 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1005/2016] 10.222.0.60 () {58 vars in 1238 bytes} [Tue Nov 23 13:34:14 2021] DELETE /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 13:34:14.120612 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a7b7a666-a1ad-48b3-bbff-ac4178364592] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 23 13:34:14.124008 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-c0ff7041-912a-4aef-a931-f8dbf981a3ca tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:34:14.124650 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-c0ff7041-912a-4aef-a931-f8dbf981a3ca tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: e7a3292e-8d9e-49ed-8529-e655dfc4e729] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:34:14.132781 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c0ff7041-912a-4aef-a931-f8dbf981a3ca tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:34:14.133221 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c0ff7041-912a-4aef-a931-f8dbf981a3ca tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:34:14.134011 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c0ff7041-912a-4aef-a931-f8dbf981a3ca tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:34:14.134444 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c0ff7041-912a-4aef-a931-f8dbf981a3ca tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:34:14.184321 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.wsgi [None req-c0ff7041-912a-4aef-a931-f8dbf981a3ca tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] HTTP exception thrown: Instance e7a3292e-8d9e-49ed-8529-e655dfc4e729 could not be found. Nov 23 13:34:14.184940 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-c0ff7041-912a-4aef-a931-f8dbf981a3ca tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Returning 404 to user: Instance e7a3292e-8d9e-49ed-8529-e655dfc4e729 could not be found. {{(pid=100974) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Nov 23 13:34:14.185785 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-c0ff7041-912a-4aef-a931-f8dbf981a3ca tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729" status: 404 len: 111 microversion: 2.1 time: 0.066664 Nov 23 13:34:14.186351 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1012/2017] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:34:14 2021] GET /compute/v2.1/servers/e7a3292e-8d9e-49ed-8529-e655dfc4e729 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 13:34:45.366448 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 13:34:45.367225 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: Tue Nov 23 13:34:45 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 23 13:36:05.128978 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 13:36:05.129907 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: Tue Nov 23 13:36:05 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 23 13:36:08.045209 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 13:36:08.045841 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: Tue Nov 23 13:36:08 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 23 13:36:08.653654 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 13:36:08.654259 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: Tue Nov 23 13:36:08 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 23 13:36:32.287664 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 13:36:32.288612 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: Tue Nov 23 13:36:32 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 23 13:37:10.504389 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 13:37:10.504389 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: Tue Nov 23 13:37:10 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 23 13:38:05.385238 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 13:38:05.385819 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: Tue Nov 23 13:38:05 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 23 13:39:25.150246 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 13:39:25.150994 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: Tue Nov 23 13:39:25 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 23 13:39:28.063478 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 13:39:28.064155 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: Tue Nov 23 13:39:28 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 23 13:39:28.673367 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 13:39:28.673367 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: Tue Nov 23 13:39:28 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 23 13:39:52.306104 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 13:39:52.306788 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: Tue Nov 23 13:39:52 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 23 13:40:14.720654 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-9fffbd1a-36c4-4f0a-b421-6f74d71f0f33 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:40:14.721240 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-9fffbd1a-36c4-4f0a-b421-6f74d71f0f33 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:40:14.739175 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-9fffbd1a-36c4-4f0a-b421-6f74d71f0f33 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:40:14.739613 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-9fffbd1a-36c4-4f0a-b421-6f74d71f0f33 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:40:14.740418 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-9fffbd1a-36c4-4f0a-b421-6f74d71f0f33 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:40:14.741061 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-9fffbd1a-36c4-4f0a-b421-6f74d71f0f33 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:40:14.778598 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO oslo.messaging._drivers.impl_rabbit [-] [8c3a1481-9693-4499-8478-a55e09a5b02f] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 56698. Nov 23 13:40:14.795787 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.wsgi [None req-9fffbd1a-36c4-4f0a-b421-6f74d71f0f33 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] HTTP exception thrown: Instance b9c21729-a176-4e26-9074-f5f0bfc0ce20 could not be found. Nov 23 13:40:14.796410 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-9fffbd1a-36c4-4f0a-b421-6f74d71f0f33 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Returning 404 to user: Instance b9c21729-a176-4e26-9074-f5f0bfc0ce20 could not be found. {{(pid=100973) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Nov 23 13:40:14.797230 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-9fffbd1a-36c4-4f0a-b421-6f74d71f0f33 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "DELETE /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 404 len: 111 microversion: 2.1 time: 0.081121 Nov 23 13:40:14.797780 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1006/2018] 10.222.0.60 () {58 vars in 1238 bytes} [Tue Nov 23 13:40:14 2021] DELETE /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 13:40:14.806753 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-17e5b714-3173-4676-bf66-300df7a21da9 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:40:14.807342 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-17e5b714-3173-4676-bf66-300df7a21da9 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] [instance: b9c21729-a176-4e26-9074-f5f0bfc0ce20] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:40:14.827374 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-17e5b714-3173-4676-bf66-300df7a21da9 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:40:14.827857 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-17e5b714-3173-4676-bf66-300df7a21da9 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:40:14.828646 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-17e5b714-3173-4676-bf66-300df7a21da9 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:40:14.829072 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-17e5b714-3173-4676-bf66-300df7a21da9 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:40:14.881753 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO oslo.messaging._drivers.impl_rabbit [-] [a7b7a666-a1ad-48b3-bbff-ac4178364592] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 56702. Nov 23 13:40:14.883535 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.wsgi [None req-17e5b714-3173-4676-bf66-300df7a21da9 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] HTTP exception thrown: Instance b9c21729-a176-4e26-9074-f5f0bfc0ce20 could not be found. Nov 23 13:40:14.884137 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-17e5b714-3173-4676-bf66-300df7a21da9 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] Returning 404 to user: Instance b9c21729-a176-4e26-9074-f5f0bfc0ce20 could not be found. {{(pid=100974) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Nov 23 13:40:14.884982 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-17e5b714-3173-4676-bf66-300df7a21da9 tempest-AttachVolumeShelveTestJSON-1578572717 tempest-AttachVolumeShelveTestJSON-1578572717-project] 10.222.0.60 "GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20" status: 404 len: 111 microversion: 2.1 time: 0.082863 Nov 23 13:40:14.885545 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1013/2019] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:40:14 2021] GET /compute/v2.1/servers/b9c21729-a176-4e26-9074-f5f0bfc0ce20 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 13:40:28.035498 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-51957a82-1f4d-4921-9a93-9b37913a60bb tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'create', calling method: .version_select at 0x7f18706d6940>, body: {"keypair": {"name": "tempest-keypair-356432591"}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:40:28.058920 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.quota [None req-51957a82-1f4d-4921-9a93-9b37913a60bb tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Getting quotas for project c610ba775aca44aa85aaf415f96bb37e. Resources: {'key_pairs'} {{(pid=100973) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 13:40:28.063613 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.quota [None req-51957a82-1f4d-4921-9a93-9b37913a60bb tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Getting quotas for user 5e5e06990f874a099eb9f92dde95e85d and project c610ba775aca44aa85aaf415f96bb37e. Resources: {'key_pairs'} {{(pid=100973) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 13:40:28.206149 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.quota [None req-51957a82-1f4d-4921-9a93-9b37913a60bb tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Getting quotas for project c610ba775aca44aa85aaf415f96bb37e. Resources: {'key_pairs'} {{(pid=100973) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 13:40:28.210242 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.quota [None req-51957a82-1f4d-4921-9a93-9b37913a60bb tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Getting quotas for user 5e5e06990f874a099eb9f92dde95e85d and project c610ba775aca44aa85aaf415f96bb37e. Resources: {'key_pairs'} {{(pid=100973) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 13:40:28.223238 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-51957a82-1f4d-4921-9a93-9b37913a60bb tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.356093 Nov 23 13:40:28.223957 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1007/2020] 10.222.0.60 () {60 vars in 1157 bytes} [Tue Nov 23 13:40:27 2021] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:40:30.047663 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-bb018e3b-0b78-4ddd-9571-41c02af2a819 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-849240610", "imageRef": "d01e1b62-4f14-4f64-9d63-d155732e33e8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6ce3e0b3-e6c6-467a-9ba7-e43df6950165"}], "security_groups": [{"name": "tempest-securitygroup--309239893"}], "key_name": "tempest-keypair-356432591", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:40:30.333649 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.network.neutron [None req-bb018e3b-0b78-4ddd-9571-41c02af2a819 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] validate_networks() for [('6ce3e0b3-e6c6-467a-9ba7-e43df6950165', None, None, None)] {{(pid=100974) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Nov 23 13:40:30.523758 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 13:40:30.524042 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: Tue Nov 23 13:40:30 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.60) !!! Nov 23 13:40:31.064375 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.virt.hardware [None req-bb018e3b-0b78-4ddd-9571-41c02af2a819 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Flavor limits 0:0:0 {{(pid=100974) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 23 13:40:31.065030 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.virt.hardware [None req-bb018e3b-0b78-4ddd-9571-41c02af2a819 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Image limits 0:0:0 {{(pid=100974) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 23 13:40:31.065255 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.virt.hardware [None req-bb018e3b-0b78-4ddd-9571-41c02af2a819 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Flavor pref 0:0:0 {{(pid=100974) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 23 13:40:31.065661 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.virt.hardware [None req-bb018e3b-0b78-4ddd-9571-41c02af2a819 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Image pref 0:0:0 {{(pid=100974) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 23 13:40:31.066042 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.virt.hardware [None req-bb018e3b-0b78-4ddd-9571-41c02af2a819 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100974) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 23 13:40:31.079567 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-bb018e3b-0b78-4ddd-9571-41c02af2a819 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:40:31.080007 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-bb018e3b-0b78-4ddd-9571-41c02af2a819 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:40:31.080920 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-bb018e3b-0b78-4ddd-9571-41c02af2a819 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:40:31.081377 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-bb018e3b-0b78-4ddd-9571-41c02af2a819 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:40:31.099644 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.quota [None req-bb018e3b-0b78-4ddd-9571-41c02af2a819 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Getting quotas for project c610ba775aca44aa85aaf415f96bb37e. Resources: {'ram', 'cores', 'instances'} {{(pid=100974) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 13:40:31.104119 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.quota [None req-bb018e3b-0b78-4ddd-9571-41c02af2a819 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Getting quotas for user 5e5e06990f874a099eb9f92dde95e85d and project c610ba775aca44aa85aaf415f96bb37e. Resources: {'ram', 'cores', 'instances'} {{(pid=100974) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 13:40:31.115929 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-bb018e3b-0b78-4ddd-9571-41c02af2a819 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Going to run 1 instances... {{(pid=100974) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Nov 23 13:40:31.118300 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-bb018e3b-0b78-4ddd-9571-41c02af2a819 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d01e1b62-4f14-4f64-9d63-d155732e33e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100974) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Nov 23 13:40:31.167695 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-bb018e3b-0b78-4ddd-9571-41c02af2a819 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.124655 Nov 23 13:40:31.173539 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1014/2021] 10.222.0.60 () {60 vars in 1146 bytes} [Tue Nov 23 13:40:30 2021] POST /compute/v2.1/servers => generated 401 bytes in 1126 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 23 13:40:31.179126 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-8995a568-c2f7-420c-9017-c9f334d6ab37 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:40:31.180015 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-8995a568-c2f7-420c-9017-c9f334d6ab37 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:40:31.335482 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-8995a568-c2f7-420c-9017-c9f334d6ab37 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5e06990f874a099eb9f92dde95e85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c610ba775aca44aa85aaf415f96bb37e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:40:31.344075 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-8995a568-c2f7-420c-9017-c9f334d6ab37 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "GET /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455" status: 200 len: 1236 microversion: 2.1 time: 0.168835 Nov 23 13:40:31.354383 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1008/2022] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:40:31 2021] GET /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455 => generated 1236 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 13:40:32.362091 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-8de4bc9f-1048-440f-9fda-084f06703da8 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:40:32.362726 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-8de4bc9f-1048-440f-9fda-084f06703da8 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:40:32.370528 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8de4bc9f-1048-440f-9fda-084f06703da8 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:40:32.370944 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8de4bc9f-1048-440f-9fda-084f06703da8 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:40:32.372057 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8de4bc9f-1048-440f-9fda-084f06703da8 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:40:32.372720 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8de4bc9f-1048-440f-9fda-084f06703da8 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:40:32.502051 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-8de4bc9f-1048-440f-9fda-084f06703da8 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5e06990f874a099eb9f92dde95e85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c610ba775aca44aa85aaf415f96bb37e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:40:32.511984 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-8de4bc9f-1048-440f-9fda-084f06703da8 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "GET /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455" status: 200 len: 1288 microversion: 2.1 time: 0.153720 Nov 23 13:40:32.513163 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1015/2023] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:40:32 2021] GET /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455 => generated 1288 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:40:33.529815 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-622615ac-1bd3-4821-bbf2-92afe9b953a3 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:40:33.530788 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-622615ac-1bd3-4821-bbf2-92afe9b953a3 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:40:33.539583 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-622615ac-1bd3-4821-bbf2-92afe9b953a3 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:40:33.540022 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-622615ac-1bd3-4821-bbf2-92afe9b953a3 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:40:33.540967 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-622615ac-1bd3-4821-bbf2-92afe9b953a3 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:40:33.541396 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-622615ac-1bd3-4821-bbf2-92afe9b953a3 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:40:33.759824 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-622615ac-1bd3-4821-bbf2-92afe9b953a3 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5e06990f874a099eb9f92dde95e85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c610ba775aca44aa85aaf415f96bb37e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:40:33.768333 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-622615ac-1bd3-4821-bbf2-92afe9b953a3 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "GET /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455" status: 200 len: 1361 microversion: 2.1 time: 0.242444 Nov 23 13:40:33.769440 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1009/2024] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:40:33 2021] GET /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455 => generated 1361 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:40:34.702974 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [req-d60100e1-3959-49de-b01f-2d1da63d8c96 req-9a6fd1ba-d8ab-4931-96a5-2580c38bd0f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "932d4c6a-60ed-44a3-b9af-627f70d7f455", "tag": "15ea991a-b6b7-4ecc-ba66-da81571f3429"}]} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:40:34.704599 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 13:40:34.704599 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: warnings.warn(msg) Nov 23 13:40:34.713527 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [req-d60100e1-3959-49de-b01f-2d1da63d8c96 req-9a6fd1ba-d8ab-4931-96a5-2580c38bd0f9 service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:40:34.713956 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [req-d60100e1-3959-49de-b01f-2d1da63d8c96 req-9a6fd1ba-d8ab-4931-96a5-2580c38bd0f9 service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:40:34.730163 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.compute.server_external_events [req-d60100e1-3959-49de-b01f-2d1da63d8c96 req-9a6fd1ba-d8ab-4931-96a5-2580c38bd0f9 service nova] Creating event network-changed:15ea991a-b6b7-4ecc-ba66-da81571f3429 for instance 932d4c6a-60ed-44a3-b9af-627f70d7f455 on hv-cinder-81888 Nov 23 13:40:34.736348 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [req-d60100e1-3959-49de-b01f-2d1da63d8c96 req-9a6fd1ba-d8ab-4931-96a5-2580c38bd0f9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105262 Nov 23 13:40:34.736943 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1016/2025] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Nov 23 13:40:34 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 13:40:34.786094 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-f403c821-1920-4cff-b78d-b5095fac2374 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:40:34.786711 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-f403c821-1920-4cff-b78d-b5095fac2374 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:40:34.794533 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f403c821-1920-4cff-b78d-b5095fac2374 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:40:34.794973 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f403c821-1920-4cff-b78d-b5095fac2374 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:40:34.796104 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f403c821-1920-4cff-b78d-b5095fac2374 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:40:34.796795 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f403c821-1920-4cff-b78d-b5095fac2374 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:40:35.004924 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-f403c821-1920-4cff-b78d-b5095fac2374 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5e06990f874a099eb9f92dde95e85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c610ba775aca44aa85aaf415f96bb37e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:40:35.013606 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-f403c821-1920-4cff-b78d-b5095fac2374 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "GET /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455" status: 200 len: 1361 microversion: 2.1 time: 0.231366 Nov 23 13:40:35.014172 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1010/2026] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:40:34 2021] GET /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455 => generated 1361 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:40:36.031738 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-f185377d-0288-45d6-aae1-79b1a6b26c37 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:40:36.032567 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-f185377d-0288-45d6-aae1-79b1a6b26c37 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:40:36.040827 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f185377d-0288-45d6-aae1-79b1a6b26c37 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:40:36.041268 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f185377d-0288-45d6-aae1-79b1a6b26c37 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:40:36.042029 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f185377d-0288-45d6-aae1-79b1a6b26c37 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:40:36.042459 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f185377d-0288-45d6-aae1-79b1a6b26c37 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:40:36.364967 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-f185377d-0288-45d6-aae1-79b1a6b26c37 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5e06990f874a099eb9f92dde95e85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c610ba775aca44aa85aaf415f96bb37e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:40:36.377427 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-f185377d-0288-45d6-aae1-79b1a6b26c37 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "GET /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455" status: 200 len: 1361 microversion: 2.1 time: 0.349837 Nov 23 13:40:36.378084 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1017/2027] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:40:36 2021] GET /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455 => generated 1361 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:40:37.400673 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-8818bdd3-e52e-43ba-8122-d0c4e9ceaf20 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:40:37.401342 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-8818bdd3-e52e-43ba-8122-d0c4e9ceaf20 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:40:37.410351 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8818bdd3-e52e-43ba-8122-d0c4e9ceaf20 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:40:37.410793 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8818bdd3-e52e-43ba-8122-d0c4e9ceaf20 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:40:37.411583 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8818bdd3-e52e-43ba-8122-d0c4e9ceaf20 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:40:37.412013 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8818bdd3-e52e-43ba-8122-d0c4e9ceaf20 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:40:37.610747 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-8818bdd3-e52e-43ba-8122-d0c4e9ceaf20 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5e06990f874a099eb9f92dde95e85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c610ba775aca44aa85aaf415f96bb37e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:40:37.619099 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-8818bdd3-e52e-43ba-8122-d0c4e9ceaf20 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "GET /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455" status: 200 len: 1361 microversion: 2.1 time: 0.222905 Nov 23 13:40:37.619664 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1011/2028] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:40:37 2021] GET /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455 => generated 1361 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:40:38.640437 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-152857ce-ac33-4b3c-9bb5-fbe6c2b8ba95 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:40:38.641087 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-152857ce-ac33-4b3c-9bb5-fbe6c2b8ba95 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:40:38.649259 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-152857ce-ac33-4b3c-9bb5-fbe6c2b8ba95 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:40:38.649700 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-152857ce-ac33-4b3c-9bb5-fbe6c2b8ba95 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:40:38.650501 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-152857ce-ac33-4b3c-9bb5-fbe6c2b8ba95 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:40:38.650951 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-152857ce-ac33-4b3c-9bb5-fbe6c2b8ba95 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:40:38.858558 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-152857ce-ac33-4b3c-9bb5-fbe6c2b8ba95 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5e06990f874a099eb9f92dde95e85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c610ba775aca44aa85aaf415f96bb37e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:40:38.867121 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-152857ce-ac33-4b3c-9bb5-fbe6c2b8ba95 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "GET /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455" status: 200 len: 1361 microversion: 2.1 time: 0.232893 Nov 23 13:40:38.867692 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1018/2029] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:40:38 2021] GET /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455 => generated 1361 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:40:39.884164 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-8d0b82c6-b369-4fb5-8544-ed01a168c540 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:40:39.884797 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-8d0b82c6-b369-4fb5-8544-ed01a168c540 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:40:39.892628 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8d0b82c6-b369-4fb5-8544-ed01a168c540 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:40:39.893075 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8d0b82c6-b369-4fb5-8544-ed01a168c540 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:40:39.893839 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8d0b82c6-b369-4fb5-8544-ed01a168c540 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:40:39.894295 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8d0b82c6-b369-4fb5-8544-ed01a168c540 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:40:40.094974 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-8d0b82c6-b369-4fb5-8544-ed01a168c540 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5e06990f874a099eb9f92dde95e85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c610ba775aca44aa85aaf415f96bb37e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:40:40.104126 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-8d0b82c6-b369-4fb5-8544-ed01a168c540 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "GET /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455" status: 200 len: 1361 microversion: 2.1 time: 0.223676 Nov 23 13:40:40.104806 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1012/2030] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:40:39 2021] GET /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455 => generated 1361 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:40:41.122959 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-6c05da1e-2357-4a69-9145-725560f66ea1 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:40:41.123824 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-6c05da1e-2357-4a69-9145-725560f66ea1 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:40:41.133043 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-6c05da1e-2357-4a69-9145-725560f66ea1 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:40:41.133495 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-6c05da1e-2357-4a69-9145-725560f66ea1 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:40:41.134272 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-6c05da1e-2357-4a69-9145-725560f66ea1 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:40:41.134819 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-6c05da1e-2357-4a69-9145-725560f66ea1 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:40:41.350330 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-6c05da1e-2357-4a69-9145-725560f66ea1 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5e06990f874a099eb9f92dde95e85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c610ba775aca44aa85aaf415f96bb37e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:40:41.358984 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-6c05da1e-2357-4a69-9145-725560f66ea1 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "GET /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455" status: 200 len: 1361 microversion: 2.1 time: 0.241007 Nov 23 13:40:41.359650 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1019/2031] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:40:41 2021] GET /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455 => generated 1361 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:40:42.156481 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [req-598de0df-7f6d-4ae2-93c0-bb89a956287a req-ae6d093a-77bb-4d38-aaa7-03aaf9b9c745 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "932d4c6a-60ed-44a3-b9af-627f70d7f455", "name": "network-vif-plugged", "status": "completed", "tag": "15ea991a-b6b7-4ecc-ba66-da81571f3429"}]} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:40:42.158856 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 13:40:42.158856 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: warnings.warn(msg) Nov 23 13:40:42.166731 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [req-598de0df-7f6d-4ae2-93c0-bb89a956287a req-ae6d093a-77bb-4d38-aaa7-03aaf9b9c745 service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:40:42.167187 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [req-598de0df-7f6d-4ae2-93c0-bb89a956287a req-ae6d093a-77bb-4d38-aaa7-03aaf9b9c745 service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:40:42.185810 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.compute.server_external_events [req-598de0df-7f6d-4ae2-93c0-bb89a956287a req-ae6d093a-77bb-4d38-aaa7-03aaf9b9c745 service nova] Creating event network-vif-plugged:15ea991a-b6b7-4ecc-ba66-da81571f3429 for instance 932d4c6a-60ed-44a3-b9af-627f70d7f455 on hv-cinder-81888 Nov 23 13:40:42.191685 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [req-598de0df-7f6d-4ae2-93c0-bb89a956287a req-ae6d093a-77bb-4d38-aaa7-03aaf9b9c745 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100399 Nov 23 13:40:42.192300 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1013/2032] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Nov 23 13:40:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 13:40:42.379858 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-1be84ff6-81df-44f1-9fb4-f13c68fcef1d tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:40:42.380472 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-1be84ff6-81df-44f1-9fb4-f13c68fcef1d tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:40:42.387737 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1be84ff6-81df-44f1-9fb4-f13c68fcef1d tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:40:42.388188 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1be84ff6-81df-44f1-9fb4-f13c68fcef1d tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:40:42.389063 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1be84ff6-81df-44f1-9fb4-f13c68fcef1d tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:40:42.389613 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1be84ff6-81df-44f1-9fb4-f13c68fcef1d tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:40:42.636192 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-1be84ff6-81df-44f1-9fb4-f13c68fcef1d tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5e06990f874a099eb9f92dde95e85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c610ba775aca44aa85aaf415f96bb37e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:40:42.649805 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-1be84ff6-81df-44f1-9fb4-f13c68fcef1d tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "GET /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455" status: 200 len: 1361 microversion: 2.1 time: 0.275311 Nov 23 13:40:42.650678 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1020/2033] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:40:42 2021] GET /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455 => generated 1361 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:40:43.674191 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-af568c78-31a8-4937-b3df-3574d9035ad6 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:40:43.675031 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-af568c78-31a8-4937-b3df-3574d9035ad6 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:40:43.684418 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-af568c78-31a8-4937-b3df-3574d9035ad6 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:40:43.684943 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-af568c78-31a8-4937-b3df-3574d9035ad6 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:40:43.686011 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-af568c78-31a8-4937-b3df-3574d9035ad6 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:40:43.686519 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-af568c78-31a8-4937-b3df-3574d9035ad6 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:40:43.897424 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-af568c78-31a8-4937-b3df-3574d9035ad6 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5e06990f874a099eb9f92dde95e85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c610ba775aca44aa85aaf415f96bb37e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:40:43.908432 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-af568c78-31a8-4937-b3df-3574d9035ad6 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "GET /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455" status: 200 len: 1361 microversion: 2.1 time: 0.240909 Nov 23 13:40:43.909007 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1014/2034] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:40:43 2021] GET /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455 => generated 1361 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:40:44.930346 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-da5cd3d0-e4c6-4e8b-ad60-ea86f537d64c tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:40:44.931315 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-da5cd3d0-e4c6-4e8b-ad60-ea86f537d64c tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:40:44.942301 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-da5cd3d0-e4c6-4e8b-ad60-ea86f537d64c tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:40:44.942741 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-da5cd3d0-e4c6-4e8b-ad60-ea86f537d64c tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:40:44.943494 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-da5cd3d0-e4c6-4e8b-ad60-ea86f537d64c tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:40:44.943915 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-da5cd3d0-e4c6-4e8b-ad60-ea86f537d64c tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:40:45.162254 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-da5cd3d0-e4c6-4e8b-ad60-ea86f537d64c tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5e06990f874a099eb9f92dde95e85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c610ba775aca44aa85aaf415f96bb37e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:40:45.171167 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-da5cd3d0-e4c6-4e8b-ad60-ea86f537d64c tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "GET /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455" status: 200 len: 1547 microversion: 2.1 time: 0.247835 Nov 23 13:40:45.171745 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1021/2035] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:40:44 2021] GET /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455 => generated 1547 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:40:45.189885 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-8e02c430-09ca-4838-9f47-b7fc71b3baff tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:40:45.190614 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-8e02c430-09ca-4838-9f47-b7fc71b3baff tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:40:45.198219 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8e02c430-09ca-4838-9f47-b7fc71b3baff tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:40:45.198647 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8e02c430-09ca-4838-9f47-b7fc71b3baff tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:40:45.199526 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8e02c430-09ca-4838-9f47-b7fc71b3baff tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:40:45.200016 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8e02c430-09ca-4838-9f47-b7fc71b3baff tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:40:45.363759 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-8e02c430-09ca-4838-9f47-b7fc71b3baff tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "GET /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.179329 Nov 23 13:40:45.364394 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1015/2036] 10.222.0.60 () {58 vars in 1274 bytes} [Tue Nov 23 13:40:45 2021] GET /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/os-interface => generated 284 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 13:40:47.112681 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-532aae27-188a-4f4b-a169-f02c02834b95 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:40:47.113683 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-532aae27-188a-4f4b-a169-f02c02834b95 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:40:47.121145 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-532aae27-188a-4f4b-a169-f02c02834b95 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:40:47.121594 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-532aae27-188a-4f4b-a169-f02c02834b95 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:40:47.122373 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-532aae27-188a-4f4b-a169-f02c02834b95 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:40:47.123027 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-532aae27-188a-4f4b-a169-f02c02834b95 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:40:47.176600 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [req-49c95872-43cb-4115-adce-44ff958d1129 req-a2e66453-bcd0-4d03-a3ec-4ae6ff62f936 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "932d4c6a-60ed-44a3-b9af-627f70d7f455", "tag": "15ea991a-b6b7-4ecc-ba66-da81571f3429"}]} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:40:47.178373 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 13:40:47.178373 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: warnings.warn(msg) Nov 23 13:40:47.187400 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [req-49c95872-43cb-4115-adce-44ff958d1129 req-a2e66453-bcd0-4d03-a3ec-4ae6ff62f936 service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:40:47.187809 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [req-49c95872-43cb-4115-adce-44ff958d1129 req-a2e66453-bcd0-4d03-a3ec-4ae6ff62f936 service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:40:47.205327 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.compute.server_external_events [req-49c95872-43cb-4115-adce-44ff958d1129 req-a2e66453-bcd0-4d03-a3ec-4ae6ff62f936 service nova] Creating event network-changed:15ea991a-b6b7-4ecc-ba66-da81571f3429 for instance 932d4c6a-60ed-44a3-b9af-627f70d7f455 on hv-cinder-81888 Nov 23 13:40:47.210795 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [req-49c95872-43cb-4115-adce-44ff958d1129 req-a2e66453-bcd0-4d03-a3ec-4ae6ff62f936 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098775 Nov 23 13:40:47.211450 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1016/2037] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Nov 23 13:40:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 13:40:47.264122 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-532aae27-188a-4f4b-a169-f02c02834b95 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action" status: 200 len: 14 microversion: 2.1 time: 0.155041 Nov 23 13:40:47.265036 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1022/2038] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:40:47 2021] POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action => generated 14 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 13:40:48.279144 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-114ef3c9-f37e-4e00-b067-b49024ada943 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:40:48.280458 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-114ef3c9-f37e-4e00-b067-b49024ada943 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:40:48.289764 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-114ef3c9-f37e-4e00-b067-b49024ada943 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:40:48.290207 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-114ef3c9-f37e-4e00-b067-b49024ada943 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:40:48.290976 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-114ef3c9-f37e-4e00-b067-b49024ada943 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:40:48.291389 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-114ef3c9-f37e-4e00-b067-b49024ada943 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:40:48.409290 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-114ef3c9-f37e-4e00-b067-b49024ada943 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action" status: 200 len: 14 microversion: 2.1 time: 0.136790 Nov 23 13:40:48.409935 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1017/2039] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:40:48 2021] POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action => generated 14 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 13:40:49.424859 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-97cae45e-58e8-4da1-9c58-0df3864fae51 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:40:49.426661 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-97cae45e-58e8-4da1-9c58-0df3864fae51 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:40:49.436218 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-97cae45e-58e8-4da1-9c58-0df3864fae51 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:40:49.436717 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-97cae45e-58e8-4da1-9c58-0df3864fae51 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:40:49.437510 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-97cae45e-58e8-4da1-9c58-0df3864fae51 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:40:49.437940 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-97cae45e-58e8-4da1-9c58-0df3864fae51 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:40:49.554773 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-97cae45e-58e8-4da1-9c58-0df3864fae51 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action" status: 200 len: 14 microversion: 2.1 time: 0.137336 Nov 23 13:40:49.555776 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1023/2040] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:40:49 2021] POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action => generated 14 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 13:40:50.573037 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-0bb24bf4-e0cf-40e4-9659-848edbf79e99 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:40:50.574644 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-0bb24bf4-e0cf-40e4-9659-848edbf79e99 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:40:50.585363 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0bb24bf4-e0cf-40e4-9659-848edbf79e99 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:40:50.585793 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0bb24bf4-e0cf-40e4-9659-848edbf79e99 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:40:50.586541 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0bb24bf4-e0cf-40e4-9659-848edbf79e99 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:40:50.586960 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0bb24bf4-e0cf-40e4-9659-848edbf79e99 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:40:50.699402 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-0bb24bf4-e0cf-40e4-9659-848edbf79e99 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action" status: 200 len: 14 microversion: 2.1 time: 0.132788 Nov 23 13:40:50.700282 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1018/2041] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:40:50 2021] POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action => generated 14 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 13:40:51.715676 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-8dfac7b6-00a0-4a04-80a8-a248cf9cfce6 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:40:51.716933 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-8dfac7b6-00a0-4a04-80a8-a248cf9cfce6 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:40:51.728157 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8dfac7b6-00a0-4a04-80a8-a248cf9cfce6 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:40:51.728755 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8dfac7b6-00a0-4a04-80a8-a248cf9cfce6 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:40:51.729748 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8dfac7b6-00a0-4a04-80a8-a248cf9cfce6 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:40:51.730279 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8dfac7b6-00a0-4a04-80a8-a248cf9cfce6 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:40:51.842978 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-8dfac7b6-00a0-4a04-80a8-a248cf9cfce6 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action" status: 200 len: 14 microversion: 2.1 time: 0.132460 Nov 23 13:40:51.843770 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1024/2042] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:40:51 2021] POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action => generated 14 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 13:40:52.855279 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-3cdd4c9b-b8a9-47e7-bec1-e1d1c7edb874 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:40:52.856347 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-3cdd4c9b-b8a9-47e7-bec1-e1d1c7edb874 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:40:52.864706 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-3cdd4c9b-b8a9-47e7-bec1-e1d1c7edb874 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:40:52.865113 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-3cdd4c9b-b8a9-47e7-bec1-e1d1c7edb874 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:40:52.865908 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-3cdd4c9b-b8a9-47e7-bec1-e1d1c7edb874 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:40:52.867058 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-3cdd4c9b-b8a9-47e7-bec1-e1d1c7edb874 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:40:52.992291 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-3cdd4c9b-b8a9-47e7-bec1-e1d1c7edb874 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action" status: 200 len: 14 microversion: 2.1 time: 0.140581 Nov 23 13:40:52.993396 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1019/2043] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:40:52 2021] POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action => generated 14 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 13:40:54.007164 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-84a91d33-30f2-4055-9f75-e32a48ccffb0 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:40:54.008211 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-84a91d33-30f2-4055-9f75-e32a48ccffb0 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:40:54.017404 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-84a91d33-30f2-4055-9f75-e32a48ccffb0 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:40:54.018016 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-84a91d33-30f2-4055-9f75-e32a48ccffb0 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:40:54.019226 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-84a91d33-30f2-4055-9f75-e32a48ccffb0 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:40:54.019874 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-84a91d33-30f2-4055-9f75-e32a48ccffb0 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:40:54.136774 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-84a91d33-30f2-4055-9f75-e32a48ccffb0 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action" status: 200 len: 14 microversion: 2.1 time: 0.133986 Nov 23 13:40:54.137424 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1025/2044] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:40:54 2021] POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action => generated 14 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 13:40:55.148285 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-9c0494cf-4cb8-4410-a798-459e4e8dbf8d tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:40:55.149189 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-9c0494cf-4cb8-4410-a798-459e4e8dbf8d tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:40:55.157651 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-9c0494cf-4cb8-4410-a798-459e4e8dbf8d tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:40:55.158087 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-9c0494cf-4cb8-4410-a798-459e4e8dbf8d tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:40:55.158840 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-9c0494cf-4cb8-4410-a798-459e4e8dbf8d tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:40:55.159288 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-9c0494cf-4cb8-4410-a798-459e4e8dbf8d tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:40:55.281449 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-9c0494cf-4cb8-4410-a798-459e4e8dbf8d tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action" status: 200 len: 14 microversion: 2.1 time: 0.137445 Nov 23 13:40:55.282109 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1020/2045] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:40:55 2021] POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action => generated 14 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 13:40:56.299084 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-519dc32c-1075-4eba-9fc0-7f2970730d76 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:40:56.300809 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-519dc32c-1075-4eba-9fc0-7f2970730d76 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:40:56.310288 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-519dc32c-1075-4eba-9fc0-7f2970730d76 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:40:56.310744 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-519dc32c-1075-4eba-9fc0-7f2970730d76 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:40:56.311524 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-519dc32c-1075-4eba-9fc0-7f2970730d76 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:40:56.311950 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-519dc32c-1075-4eba-9fc0-7f2970730d76 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:40:56.449487 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-519dc32c-1075-4eba-9fc0-7f2970730d76 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action" status: 200 len: 6964 microversion: 2.1 time: 0.156680 Nov 23 13:40:56.450369 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1026/2046] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:40:56 2021] POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action => generated 6964 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:40:57.466796 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-33315d96-b974-4b21-b12a-753a21e2e2e9 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:40:57.468440 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-33315d96-b974-4b21-b12a-753a21e2e2e9 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:40:57.479552 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-33315d96-b974-4b21-b12a-753a21e2e2e9 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:40:57.479994 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-33315d96-b974-4b21-b12a-753a21e2e2e9 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:40:57.480879 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-33315d96-b974-4b21-b12a-753a21e2e2e9 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:40:57.481311 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-33315d96-b974-4b21-b12a-753a21e2e2e9 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:40:57.605083 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-33315d96-b974-4b21-b12a-753a21e2e2e9 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action" status: 200 len: 16123 microversion: 2.1 time: 0.144467 Nov 23 13:40:57.606058 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1021/2047] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:40:57 2021] POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action => generated 16123 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:40:58.621183 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-c1835292-2ab9-41f4-a06b-e503bcaeba6d tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:40:58.622185 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-c1835292-2ab9-41f4-a06b-e503bcaeba6d tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:40:58.630669 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c1835292-2ab9-41f4-a06b-e503bcaeba6d tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:40:58.631123 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c1835292-2ab9-41f4-a06b-e503bcaeba6d tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:40:58.632008 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c1835292-2ab9-41f4-a06b-e503bcaeba6d tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:40:58.632481 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c1835292-2ab9-41f4-a06b-e503bcaeba6d tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:40:58.751600 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-c1835292-2ab9-41f4-a06b-e503bcaeba6d tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action" status: 200 len: 18608 microversion: 2.1 time: 0.134727 Nov 23 13:40:58.752705 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1027/2048] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:40:58 2021] POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action => generated 18608 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:40:59.771395 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-9f0bea3e-a023-4b07-93f9-c8e58124c1d6 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:40:59.773175 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-9f0bea3e-a023-4b07-93f9-c8e58124c1d6 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:40:59.786487 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-9f0bea3e-a023-4b07-93f9-c8e58124c1d6 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:40:59.787225 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-9f0bea3e-a023-4b07-93f9-c8e58124c1d6 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:40:59.788491 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-9f0bea3e-a023-4b07-93f9-c8e58124c1d6 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:40:59.788922 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-9f0bea3e-a023-4b07-93f9-c8e58124c1d6 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:40:59.919907 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-9f0bea3e-a023-4b07-93f9-c8e58124c1d6 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action" status: 200 len: 21288 microversion: 2.1 time: 0.155022 Nov 23 13:40:59.921000 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1022/2049] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:40:59 2021] POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action => generated 21288 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:41:00.935278 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-83f68969-b241-4b9e-bb41-7bc2a37b8104 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:41:00.936411 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-83f68969-b241-4b9e-bb41-7bc2a37b8104 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:41:00.945405 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-83f68969-b241-4b9e-bb41-7bc2a37b8104 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:41:00.945856 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-83f68969-b241-4b9e-bb41-7bc2a37b8104 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:41:00.946626 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-83f68969-b241-4b9e-bb41-7bc2a37b8104 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:41:00.947069 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-83f68969-b241-4b9e-bb41-7bc2a37b8104 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:41:01.079225 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-83f68969-b241-4b9e-bb41-7bc2a37b8104 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action" status: 200 len: 23228 microversion: 2.1 time: 0.147815 Nov 23 13:41:01.080428 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1028/2050] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:41:00 2021] POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action => generated 23228 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:41:02.095192 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-a7f67fe4-ee1f-4b6e-80e3-8cdf8d5f06f8 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:41:02.096473 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-a7f67fe4-ee1f-4b6e-80e3-8cdf8d5f06f8 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:41:02.106206 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a7f67fe4-ee1f-4b6e-80e3-8cdf8d5f06f8 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:41:02.106658 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a7f67fe4-ee1f-4b6e-80e3-8cdf8d5f06f8 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:41:02.107432 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a7f67fe4-ee1f-4b6e-80e3-8cdf8d5f06f8 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:41:02.107864 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a7f67fe4-ee1f-4b6e-80e3-8cdf8d5f06f8 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:41:02.419899 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-a7f67fe4-ee1f-4b6e-80e3-8cdf8d5f06f8 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action" status: 200 len: 24732 microversion: 2.1 time: 0.329358 Nov 23 13:41:02.420843 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1023/2051] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:41:02 2021] POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action => generated 24732 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:41:03.440157 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-fc89bb5b-5fef-4627-86cd-b9b7f00e4bba tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:41:03.441819 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-fc89bb5b-5fef-4627-86cd-b9b7f00e4bba tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:41:03.451166 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-fc89bb5b-5fef-4627-86cd-b9b7f00e4bba tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:41:03.451612 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-fc89bb5b-5fef-4627-86cd-b9b7f00e4bba tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:41:03.452411 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-fc89bb5b-5fef-4627-86cd-b9b7f00e4bba tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:41:03.452843 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-fc89bb5b-5fef-4627-86cd-b9b7f00e4bba tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:41:03.575583 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-fc89bb5b-5fef-4627-86cd-b9b7f00e4bba tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action" status: 200 len: 26441 microversion: 2.1 time: 0.142148 Nov 23 13:41:03.576348 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1029/2052] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:41:03 2021] POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action => generated 26441 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:41:04.590668 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-fe53e05c-e0bc-4902-b223-eb0f02c0ce76 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:41:04.591855 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-fe53e05c-e0bc-4902-b223-eb0f02c0ce76 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:41:04.600201 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-fe53e05c-e0bc-4902-b223-eb0f02c0ce76 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:41:04.600673 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-fe53e05c-e0bc-4902-b223-eb0f02c0ce76 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:41:04.601476 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-fe53e05c-e0bc-4902-b223-eb0f02c0ce76 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:41:04.601884 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-fe53e05c-e0bc-4902-b223-eb0f02c0ce76 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:41:04.727124 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-fe53e05c-e0bc-4902-b223-eb0f02c0ce76 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action" status: 200 len: 27586 microversion: 2.1 time: 0.140245 Nov 23 13:41:04.727911 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1024/2053] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:41:04 2021] POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action => generated 27586 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 13:41:05.744443 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-dd9e3dba-f5cb-4765-938a-b34e1cb96f3a tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:41:05.746083 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-dd9e3dba-f5cb-4765-938a-b34e1cb96f3a tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:41:05.758682 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-dd9e3dba-f5cb-4765-938a-b34e1cb96f3a tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:41:05.759132 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-dd9e3dba-f5cb-4765-938a-b34e1cb96f3a tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:41:05.759906 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-dd9e3dba-f5cb-4765-938a-b34e1cb96f3a tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:41:05.760369 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-dd9e3dba-f5cb-4765-938a-b34e1cb96f3a tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:41:05.890875 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-dd9e3dba-f5cb-4765-938a-b34e1cb96f3a tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action" status: 200 len: 28006 microversion: 2.1 time: 0.153027 Nov 23 13:41:05.891792 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1030/2054] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:41:05 2021] POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action => generated 28006 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:41:06.908184 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-777a7b61-81c4-456c-9021-f438d1e184b2 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:41:06.909903 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-777a7b61-81c4-456c-9021-f438d1e184b2 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:41:06.923062 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-777a7b61-81c4-456c-9021-f438d1e184b2 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:41:06.923795 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-777a7b61-81c4-456c-9021-f438d1e184b2 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:41:06.925116 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-777a7b61-81c4-456c-9021-f438d1e184b2 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:41:06.925833 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-777a7b61-81c4-456c-9021-f438d1e184b2 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:41:07.076053 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-777a7b61-81c4-456c-9021-f438d1e184b2 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action" status: 200 len: 28192 microversion: 2.1 time: 0.174163 Nov 23 13:41:07.077102 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1025/2055] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:41:06 2021] POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action => generated 28192 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:41:08.090818 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-bffca67a-b946-4572-bfd9-b825efab31b7 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:41:08.091911 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-bffca67a-b946-4572-bfd9-b825efab31b7 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:41:08.100830 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-bffca67a-b946-4572-bfd9-b825efab31b7 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:41:08.101599 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-bffca67a-b946-4572-bfd9-b825efab31b7 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:41:08.102422 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-bffca67a-b946-4572-bfd9-b825efab31b7 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:41:08.102852 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-bffca67a-b946-4572-bfd9-b825efab31b7 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:41:08.221291 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-bffca67a-b946-4572-bfd9-b825efab31b7 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action" status: 200 len: 28192 microversion: 2.1 time: 0.134147 Nov 23 13:41:08.222627 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1031/2056] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:41:08 2021] POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action => generated 28192 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:41:09.241075 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-ee84a42d-bff4-4abe-adfc-53641b9f4159 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:41:09.242519 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-ee84a42d-bff4-4abe-adfc-53641b9f4159 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:41:09.251149 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ee84a42d-bff4-4abe-adfc-53641b9f4159 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:41:09.251595 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ee84a42d-bff4-4abe-adfc-53641b9f4159 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:41:09.252394 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ee84a42d-bff4-4abe-adfc-53641b9f4159 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:41:09.252824 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ee84a42d-bff4-4abe-adfc-53641b9f4159 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:41:09.371721 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-ee84a42d-bff4-4abe-adfc-53641b9f4159 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action" status: 200 len: 28192 microversion: 2.1 time: 0.137590 Nov 23 13:41:09.372581 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1026/2057] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:41:09 2021] POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action => generated 28192 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:41:10.388997 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-ab0560c9-2d55-4b1f-981e-acf439bd28ea tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:41:10.390199 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-ab0560c9-2d55-4b1f-981e-acf439bd28ea tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:41:10.400605 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ab0560c9-2d55-4b1f-981e-acf439bd28ea tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:41:10.401049 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ab0560c9-2d55-4b1f-981e-acf439bd28ea tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:41:10.401787 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ab0560c9-2d55-4b1f-981e-acf439bd28ea tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:41:10.402226 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-ab0560c9-2d55-4b1f-981e-acf439bd28ea tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:41:10.519967 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-ab0560c9-2d55-4b1f-981e-acf439bd28ea tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action" status: 200 len: 28192 microversion: 2.1 time: 0.136491 Nov 23 13:41:10.520626 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1032/2058] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:41:10 2021] POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action => generated 28192 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:41:11.537154 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-a7c780e3-63cd-4c56-9946-9ae8e3c266c3 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:41:11.538566 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-a7c780e3-63cd-4c56-9946-9ae8e3c266c3 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:41:11.547869 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a7c780e3-63cd-4c56-9946-9ae8e3c266c3 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:41:11.548345 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a7c780e3-63cd-4c56-9946-9ae8e3c266c3 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:41:11.549112 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a7c780e3-63cd-4c56-9946-9ae8e3c266c3 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:41:11.549542 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a7c780e3-63cd-4c56-9946-9ae8e3c266c3 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:41:11.672313 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-a7c780e3-63cd-4c56-9946-9ae8e3c266c3 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action" status: 200 len: 28192 microversion: 2.1 time: 0.141638 Nov 23 13:41:11.673215 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1027/2059] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:41:11 2021] POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action => generated 28192 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:41:12.691901 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-4f5fca83-2761-4aad-9daa-e8b362b383d5 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:41:12.693561 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-4f5fca83-2761-4aad-9daa-e8b362b383d5 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:41:12.711043 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-4f5fca83-2761-4aad-9daa-e8b362b383d5 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:41:12.712071 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-4f5fca83-2761-4aad-9daa-e8b362b383d5 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:41:12.712964 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-4f5fca83-2761-4aad-9daa-e8b362b383d5 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:41:12.713403 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-4f5fca83-2761-4aad-9daa-e8b362b383d5 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:41:12.827866 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-4f5fca83-2761-4aad-9daa-e8b362b383d5 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action" status: 200 len: 28192 microversion: 2.1 time: 0.142703 Nov 23 13:41:12.828520 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1033/2060] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:41:12 2021] POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action => generated 28192 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:41:13.840485 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-277702d1-4278-44ac-9fb1-07336bcfd81a tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:41:13.841534 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-277702d1-4278-44ac-9fb1-07336bcfd81a tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:41:13.849655 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-277702d1-4278-44ac-9fb1-07336bcfd81a tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:41:13.850098 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-277702d1-4278-44ac-9fb1-07336bcfd81a tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:41:13.850857 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-277702d1-4278-44ac-9fb1-07336bcfd81a tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:41:13.851280 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-277702d1-4278-44ac-9fb1-07336bcfd81a tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:41:13.977107 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-277702d1-4278-44ac-9fb1-07336bcfd81a tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action" status: 200 len: 28192 microversion: 2.1 time: 0.140578 Nov 23 13:41:13.977808 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1028/2061] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:41:13 2021] POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action => generated 28192 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:41:14.994763 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-d81a4d95-0c6a-466b-84ce-d35750bdb722 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:41:14.995784 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-d81a4d95-0c6a-466b-84ce-d35750bdb722 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:41:15.004087 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d81a4d95-0c6a-466b-84ce-d35750bdb722 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:41:15.004570 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d81a4d95-0c6a-466b-84ce-d35750bdb722 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:41:15.005339 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d81a4d95-0c6a-466b-84ce-d35750bdb722 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:41:15.005773 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d81a4d95-0c6a-466b-84ce-d35750bdb722 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:41:15.128107 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-d81a4d95-0c6a-466b-84ce-d35750bdb722 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action" status: 200 len: 28192 microversion: 2.1 time: 0.139462 Nov 23 13:41:15.129637 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1034/2062] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:41:14 2021] POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action => generated 28192 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:41:16.152397 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-bc15c045-ab87-417c-affd-22ddb419d858 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:41:16.153518 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-bc15c045-ab87-417c-affd-22ddb419d858 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:41:16.165843 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-bc15c045-ab87-417c-affd-22ddb419d858 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:41:16.166323 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-bc15c045-ab87-417c-affd-22ddb419d858 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:41:16.167440 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-bc15c045-ab87-417c-affd-22ddb419d858 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:41:16.167876 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-bc15c045-ab87-417c-affd-22ddb419d858 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:41:16.298749 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-bc15c045-ab87-417c-affd-22ddb419d858 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action" status: 200 len: 28192 microversion: 2.1 time: 0.152763 Nov 23 13:41:16.299507 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1029/2063] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:41:16 2021] POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action => generated 28192 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:41:17.314052 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-fae062bf-915e-46ba-9bc6-71233bf19fe2 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:41:17.315319 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-fae062bf-915e-46ba-9bc6-71233bf19fe2 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:41:17.325519 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-fae062bf-915e-46ba-9bc6-71233bf19fe2 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:41:17.326068 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-fae062bf-915e-46ba-9bc6-71233bf19fe2 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:41:17.327011 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-fae062bf-915e-46ba-9bc6-71233bf19fe2 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:41:17.327559 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-fae062bf-915e-46ba-9bc6-71233bf19fe2 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:41:17.452931 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-fae062bf-915e-46ba-9bc6-71233bf19fe2 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action" status: 200 len: 28192 microversion: 2.1 time: 0.144015 Nov 23 13:41:17.453704 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1035/2064] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:41:17 2021] POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action => generated 28192 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:41:18.470432 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-69b5a3f2-bbaf-46cf-a178-546cbfbbcfc2 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:41:18.471952 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-69b5a3f2-bbaf-46cf-a178-546cbfbbcfc2 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:41:18.482747 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-69b5a3f2-bbaf-46cf-a178-546cbfbbcfc2 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:41:18.483190 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-69b5a3f2-bbaf-46cf-a178-546cbfbbcfc2 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:41:18.483953 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-69b5a3f2-bbaf-46cf-a178-546cbfbbcfc2 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:41:18.484419 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-69b5a3f2-bbaf-46cf-a178-546cbfbbcfc2 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:41:18.606083 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-69b5a3f2-bbaf-46cf-a178-546cbfbbcfc2 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action" status: 200 len: 28192 microversion: 2.1 time: 0.142681 Nov 23 13:41:18.606804 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1030/2065] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:41:18 2021] POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action => generated 28192 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:41:19.620387 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-56672e37-4e63-46c8-92b6-0a15d3f40998 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:41:19.621377 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-56672e37-4e63-46c8-92b6-0a15d3f40998 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:41:19.629656 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-56672e37-4e63-46c8-92b6-0a15d3f40998 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:41:19.630113 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-56672e37-4e63-46c8-92b6-0a15d3f40998 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:41:19.630873 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-56672e37-4e63-46c8-92b6-0a15d3f40998 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:41:19.631315 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-56672e37-4e63-46c8-92b6-0a15d3f40998 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:41:19.761532 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-56672e37-4e63-46c8-92b6-0a15d3f40998 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action" status: 200 len: 28317 microversion: 2.1 time: 0.145606 Nov 23 13:41:19.762166 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1036/2066] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:41:19 2021] POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action => generated 28317 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:41:20.778818 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-0a986faa-7e75-44dc-a901-e6c842df95ef tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:41:20.780538 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-0a986faa-7e75-44dc-a901-e6c842df95ef tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:41:20.792754 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0a986faa-7e75-44dc-a901-e6c842df95ef tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:41:20.793199 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0a986faa-7e75-44dc-a901-e6c842df95ef tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:41:20.793961 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0a986faa-7e75-44dc-a901-e6c842df95ef tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:41:20.794396 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0a986faa-7e75-44dc-a901-e6c842df95ef tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:41:20.919349 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-0a986faa-7e75-44dc-a901-e6c842df95ef tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action" status: 200 len: 28483 microversion: 2.1 time: 0.147022 Nov 23 13:41:20.920422 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1031/2067] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:41:20 2021] POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action => generated 28483 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:41:21.938430 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-f47d59a0-8716-4a59-859f-2ba966f1ae53 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:41:21.939789 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-f47d59a0-8716-4a59-859f-2ba966f1ae53 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:41:21.951008 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f47d59a0-8716-4a59-859f-2ba966f1ae53 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:41:21.951644 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f47d59a0-8716-4a59-859f-2ba966f1ae53 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:41:21.952719 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f47d59a0-8716-4a59-859f-2ba966f1ae53 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:41:21.953297 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f47d59a0-8716-4a59-859f-2ba966f1ae53 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:41:22.094588 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-f47d59a0-8716-4a59-859f-2ba966f1ae53 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action" status: 200 len: 28651 microversion: 2.1 time: 0.161470 Nov 23 13:41:22.095557 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1037/2068] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:41:21 2021] POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action => generated 28651 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:41:23.113893 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-e53f2445-ab8b-44fe-8c60-61c44e0962dd tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:41:23.115531 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-e53f2445-ab8b-44fe-8c60-61c44e0962dd tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:41:23.125395 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e53f2445-ab8b-44fe-8c60-61c44e0962dd tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:41:23.125772 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e53f2445-ab8b-44fe-8c60-61c44e0962dd tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:41:23.126530 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e53f2445-ab8b-44fe-8c60-61c44e0962dd tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:41:23.126956 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e53f2445-ab8b-44fe-8c60-61c44e0962dd tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:41:23.265231 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-e53f2445-ab8b-44fe-8c60-61c44e0962dd tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action" status: 200 len: 28651 microversion: 2.1 time: 0.157720 Nov 23 13:41:23.266278 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1032/2069] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:41:23 2021] POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action => generated 28651 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:41:24.285072 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-134c396c-1a72-4743-b344-49f25b310523 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:41:24.286704 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-134c396c-1a72-4743-b344-49f25b310523 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:41:24.296623 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-134c396c-1a72-4743-b344-49f25b310523 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:41:24.297077 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-134c396c-1a72-4743-b344-49f25b310523 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:41:24.297842 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-134c396c-1a72-4743-b344-49f25b310523 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:41:24.298274 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-134c396c-1a72-4743-b344-49f25b310523 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:41:24.416277 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-134c396c-1a72-4743-b344-49f25b310523 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action" status: 200 len: 28651 microversion: 2.1 time: 0.137747 Nov 23 13:41:24.416951 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1038/2070] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:41:24 2021] POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action => generated 28651 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:41:25.433167 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-c9d2e14f-3175-420e-82b9-57a12ed4af72 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:41:25.434275 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-c9d2e14f-3175-420e-82b9-57a12ed4af72 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:41:25.442559 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c9d2e14f-3175-420e-82b9-57a12ed4af72 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:41:25.443007 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c9d2e14f-3175-420e-82b9-57a12ed4af72 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:41:25.443790 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c9d2e14f-3175-420e-82b9-57a12ed4af72 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:41:25.444212 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c9d2e14f-3175-420e-82b9-57a12ed4af72 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:41:25.560936 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-c9d2e14f-3175-420e-82b9-57a12ed4af72 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action" status: 200 len: 28651 microversion: 2.1 time: 0.133910 Nov 23 13:41:25.561572 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1033/2071] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:41:25 2021] POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action => generated 28651 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:41:26.578854 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-9cca168c-209c-44df-9f31-9c727818d7f8 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:41:26.580477 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-9cca168c-209c-44df-9f31-9c727818d7f8 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:41:26.593635 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-9cca168c-209c-44df-9f31-9c727818d7f8 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:41:26.594372 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-9cca168c-209c-44df-9f31-9c727818d7f8 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:41:26.595661 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-9cca168c-209c-44df-9f31-9c727818d7f8 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:41:26.596363 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-9cca168c-209c-44df-9f31-9c727818d7f8 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:41:26.757592 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-9cca168c-209c-44df-9f31-9c727818d7f8 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action" status: 200 len: 28651 microversion: 2.1 time: 0.185628 Nov 23 13:41:26.758250 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1039/2072] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:41:26 2021] POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action => generated 28651 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:41:27.775422 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-a0c65dde-5696-45a0-bbd8-6efab3b0ef13 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:41:27.776426 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-a0c65dde-5696-45a0-bbd8-6efab3b0ef13 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:41:27.784821 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a0c65dde-5696-45a0-bbd8-6efab3b0ef13 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:41:27.785269 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a0c65dde-5696-45a0-bbd8-6efab3b0ef13 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:41:27.786072 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a0c65dde-5696-45a0-bbd8-6efab3b0ef13 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:41:27.786502 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a0c65dde-5696-45a0-bbd8-6efab3b0ef13 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:41:27.903590 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-a0c65dde-5696-45a0-bbd8-6efab3b0ef13 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action" status: 200 len: 28651 microversion: 2.1 time: 0.134602 Nov 23 13:41:27.904654 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1034/2073] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:41:27 2021] POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action => generated 28651 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:41:28.921061 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-e1aad5cf-d880-4c61-98e9-cc054ede142b tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:41:28.922244 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-e1aad5cf-d880-4c61-98e9-cc054ede142b tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:41:28.931705 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e1aad5cf-d880-4c61-98e9-cc054ede142b tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:41:28.932364 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e1aad5cf-d880-4c61-98e9-cc054ede142b tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:41:28.933223 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e1aad5cf-d880-4c61-98e9-cc054ede142b tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:41:28.933869 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e1aad5cf-d880-4c61-98e9-cc054ede142b tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:41:29.054201 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-e1aad5cf-d880-4c61-98e9-cc054ede142b tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action" status: 200 len: 28651 microversion: 2.1 time: 0.138659 Nov 23 13:41:29.055244 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1040/2074] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:41:28 2021] POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action => generated 28651 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:41:30.069978 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-d4cb77cf-fec6-40aa-be8d-699286b467ab tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:41:30.070996 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-d4cb77cf-fec6-40aa-be8d-699286b467ab tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:41:30.079460 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d4cb77cf-fec6-40aa-be8d-699286b467ab tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:41:30.079918 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d4cb77cf-fec6-40aa-be8d-699286b467ab tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:41:30.080749 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d4cb77cf-fec6-40aa-be8d-699286b467ab tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:41:30.081192 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d4cb77cf-fec6-40aa-be8d-699286b467ab tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:41:30.201323 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-d4cb77cf-fec6-40aa-be8d-699286b467ab tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action" status: 200 len: 28651 microversion: 2.1 time: 0.135349 Nov 23 13:41:30.201980 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1035/2075] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:41:30 2021] POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action => generated 28651 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:41:31.220596 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-dbee203c-264a-4a5a-8f62-bf53be10ac47 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:41:31.222066 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-dbee203c-264a-4a5a-8f62-bf53be10ac47 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:41:31.234317 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-dbee203c-264a-4a5a-8f62-bf53be10ac47 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:41:31.234774 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-dbee203c-264a-4a5a-8f62-bf53be10ac47 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:41:31.235519 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-dbee203c-264a-4a5a-8f62-bf53be10ac47 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:41:31.235940 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-dbee203c-264a-4a5a-8f62-bf53be10ac47 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:41:31.357365 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-dbee203c-264a-4a5a-8f62-bf53be10ac47 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action" status: 200 len: 28651 microversion: 2.1 time: 0.143276 Nov 23 13:41:31.358431 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1041/2076] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:41:31 2021] POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action => generated 28651 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:41:32.374740 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-320a9451-44e7-4ff7-a2bc-3c3263cf8214 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:41:32.375783 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-320a9451-44e7-4ff7-a2bc-3c3263cf8214 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:41:32.383977 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-320a9451-44e7-4ff7-a2bc-3c3263cf8214 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:41:32.384450 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-320a9451-44e7-4ff7-a2bc-3c3263cf8214 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:41:32.385230 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-320a9451-44e7-4ff7-a2bc-3c3263cf8214 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:41:32.385649 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-320a9451-44e7-4ff7-a2bc-3c3263cf8214 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:41:32.507811 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-320a9451-44e7-4ff7-a2bc-3c3263cf8214 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action" status: 200 len: 28651 microversion: 2.1 time: 0.138300 Nov 23 13:41:32.508715 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1036/2077] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:41:32 2021] POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action => generated 28651 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:41:33.527277 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-e01e57fd-8753-47bc-8b6e-f246044a6447 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:41:33.529154 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-e01e57fd-8753-47bc-8b6e-f246044a6447 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:41:33.537724 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e01e57fd-8753-47bc-8b6e-f246044a6447 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:41:33.538170 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e01e57fd-8753-47bc-8b6e-f246044a6447 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:41:33.538929 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e01e57fd-8753-47bc-8b6e-f246044a6447 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:41:33.539354 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e01e57fd-8753-47bc-8b6e-f246044a6447 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:41:33.663417 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-e01e57fd-8753-47bc-8b6e-f246044a6447 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action" status: 200 len: 28651 microversion: 2.1 time: 0.142662 Nov 23 13:41:33.664439 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1042/2078] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:41:33 2021] POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action => generated 28651 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:41:34.679335 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-d2daec72-33b5-48ca-a3d7-aba70b873c0b tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:41:34.680369 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-d2daec72-33b5-48ca-a3d7-aba70b873c0b tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:41:34.689161 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d2daec72-33b5-48ca-a3d7-aba70b873c0b tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:41:34.689605 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d2daec72-33b5-48ca-a3d7-aba70b873c0b tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:41:34.690371 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d2daec72-33b5-48ca-a3d7-aba70b873c0b tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:41:34.690798 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d2daec72-33b5-48ca-a3d7-aba70b873c0b tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:41:34.835136 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-d2daec72-33b5-48ca-a3d7-aba70b873c0b tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action" status: 200 len: 28651 microversion: 2.1 time: 0.159932 Nov 23 13:41:34.835778 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1037/2079] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:41:34 2021] POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action => generated 28651 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:41:35.848197 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-792761c0-5aa5-404f-987e-4bd77a88634a tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:41:35.849232 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-792761c0-5aa5-404f-987e-4bd77a88634a tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:41:35.857516 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-792761c0-5aa5-404f-987e-4bd77a88634a tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:41:35.858016 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-792761c0-5aa5-404f-987e-4bd77a88634a tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:41:35.858767 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-792761c0-5aa5-404f-987e-4bd77a88634a tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:41:35.859193 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-792761c0-5aa5-404f-987e-4bd77a88634a tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:41:36.014048 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-792761c0-5aa5-404f-987e-4bd77a88634a tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action" status: 200 len: 28651 microversion: 2.1 time: 0.169550 Nov 23 13:41:36.015179 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1043/2080] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:41:35 2021] POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action => generated 28651 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:41:37.034749 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-61c1606b-bd6a-49a6-a64d-78ed9d4d7328 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:41:37.036473 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-61c1606b-bd6a-49a6-a64d-78ed9d4d7328 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:41:37.048603 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-61c1606b-bd6a-49a6-a64d-78ed9d4d7328 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:41:37.049051 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-61c1606b-bd6a-49a6-a64d-78ed9d4d7328 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:41:37.049820 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-61c1606b-bd6a-49a6-a64d-78ed9d4d7328 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:41:37.050269 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-61c1606b-bd6a-49a6-a64d-78ed9d4d7328 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:41:37.174118 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-61c1606b-bd6a-49a6-a64d-78ed9d4d7328 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action" status: 200 len: 28651 microversion: 2.1 time: 0.145974 Nov 23 13:41:37.174871 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1038/2081] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:41:37 2021] POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action => generated 28651 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:41:38.191077 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-c190ce02-6839-4dfb-b0c9-7270492c8fef tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:41:38.192281 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-c190ce02-6839-4dfb-b0c9-7270492c8fef tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:41:38.202110 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c190ce02-6839-4dfb-b0c9-7270492c8fef tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:41:38.202634 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c190ce02-6839-4dfb-b0c9-7270492c8fef tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:41:38.203559 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c190ce02-6839-4dfb-b0c9-7270492c8fef tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:41:38.204065 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c190ce02-6839-4dfb-b0c9-7270492c8fef tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:41:38.327903 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-c190ce02-6839-4dfb-b0c9-7270492c8fef tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action" status: 200 len: 28651 microversion: 2.1 time: 0.142167 Nov 23 13:41:38.328840 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1044/2082] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:41:38 2021] POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action => generated 28651 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:41:39.345524 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-8b4c8767-aa7b-44d6-b147-e7ae42bf50cc tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:41:39.347145 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-8b4c8767-aa7b-44d6-b147-e7ae42bf50cc tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:41:39.359706 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8b4c8767-aa7b-44d6-b147-e7ae42bf50cc tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:41:39.360176 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8b4c8767-aa7b-44d6-b147-e7ae42bf50cc tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:41:39.360978 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8b4c8767-aa7b-44d6-b147-e7ae42bf50cc tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:41:39.361405 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8b4c8767-aa7b-44d6-b147-e7ae42bf50cc tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:41:39.481916 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-8b4c8767-aa7b-44d6-b147-e7ae42bf50cc tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action" status: 200 len: 28651 microversion: 2.1 time: 0.142846 Nov 23 13:41:39.482797 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1039/2083] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:41:39 2021] POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action => generated 28651 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:41:40.500947 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-41c49c8c-cafa-482b-8d40-79bdb75f583a tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:41:40.501895 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-41c49c8c-cafa-482b-8d40-79bdb75f583a tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:41:40.510236 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-41c49c8c-cafa-482b-8d40-79bdb75f583a tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:41:40.510689 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-41c49c8c-cafa-482b-8d40-79bdb75f583a tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:41:40.511458 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-41c49c8c-cafa-482b-8d40-79bdb75f583a tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:41:40.511888 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-41c49c8c-cafa-482b-8d40-79bdb75f583a tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:41:40.779256 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-41c49c8c-cafa-482b-8d40-79bdb75f583a tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action" status: 200 len: 28651 microversion: 2.1 time: 0.284734 Nov 23 13:41:40.780301 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1045/2084] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:41:40 2021] POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action => generated 28651 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:41:41.795334 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-b470e38f-4b0f-4f2c-ad08-186d31f9b817 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:41:41.796547 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-b470e38f-4b0f-4f2c-ad08-186d31f9b817 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:41:41.805117 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b470e38f-4b0f-4f2c-ad08-186d31f9b817 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:41:41.805578 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b470e38f-4b0f-4f2c-ad08-186d31f9b817 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:41:41.806366 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b470e38f-4b0f-4f2c-ad08-186d31f9b817 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:41:41.806806 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b470e38f-4b0f-4f2c-ad08-186d31f9b817 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:41:41.927912 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-b470e38f-4b0f-4f2c-ad08-186d31f9b817 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action" status: 200 len: 28651 microversion: 2.1 time: 0.137148 Nov 23 13:41:41.928562 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1040/2085] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:41:41 2021] POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action => generated 28651 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:41:42.946647 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-1fff9530-5b46-4877-a66e-f643c27a88de tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:41:42.948291 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-1fff9530-5b46-4877-a66e-f643c27a88de tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:41:42.969970 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1fff9530-5b46-4877-a66e-f643c27a88de tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:41:42.970429 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1fff9530-5b46-4877-a66e-f643c27a88de tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:41:42.971203 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1fff9530-5b46-4877-a66e-f643c27a88de tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:41:42.971637 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-1fff9530-5b46-4877-a66e-f643c27a88de tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:41:43.090061 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-1fff9530-5b46-4877-a66e-f643c27a88de tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action" status: 200 len: 28651 microversion: 2.1 time: 0.150082 Nov 23 13:41:43.090867 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1046/2086] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:41:42 2021] POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action => generated 28651 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:41:44.104110 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-e32a76c3-b48b-4d7a-9ad6-0865267b2699 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:41:44.105139 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-e32a76c3-b48b-4d7a-9ad6-0865267b2699 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:41:44.113700 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e32a76c3-b48b-4d7a-9ad6-0865267b2699 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:41:44.114101 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e32a76c3-b48b-4d7a-9ad6-0865267b2699 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:41:44.114864 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e32a76c3-b48b-4d7a-9ad6-0865267b2699 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:41:44.115300 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-e32a76c3-b48b-4d7a-9ad6-0865267b2699 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:41:44.247688 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-e32a76c3-b48b-4d7a-9ad6-0865267b2699 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action" status: 200 len: 28651 microversion: 2.1 time: 0.147205 Nov 23 13:41:44.248752 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1041/2087] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:41:44 2021] POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action => generated 28651 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:41:45.263514 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-d74c19fb-2f4c-4351-86b3-af4fc33f98bf tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:41:45.264642 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-d74c19fb-2f4c-4351-86b3-af4fc33f98bf tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:41:45.273161 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d74c19fb-2f4c-4351-86b3-af4fc33f98bf tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:41:45.273609 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d74c19fb-2f4c-4351-86b3-af4fc33f98bf tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:41:45.274369 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d74c19fb-2f4c-4351-86b3-af4fc33f98bf tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:41:45.274773 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d74c19fb-2f4c-4351-86b3-af4fc33f98bf tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:41:45.394233 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-d74c19fb-2f4c-4351-86b3-af4fc33f98bf tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action" status: 200 len: 28651 microversion: 2.1 time: 0.134550 Nov 23 13:41:45.395278 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1047/2088] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:41:45 2021] POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action => generated 28651 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:41:46.413091 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-4acf0ded-b4f2-45a9-8e67-7d1d6c9f4ae0 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:41:46.414679 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-4acf0ded-b4f2-45a9-8e67-7d1d6c9f4ae0 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:41:46.425409 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4acf0ded-b4f2-45a9-8e67-7d1d6c9f4ae0 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:41:46.425848 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4acf0ded-b4f2-45a9-8e67-7d1d6c9f4ae0 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:41:46.426601 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4acf0ded-b4f2-45a9-8e67-7d1d6c9f4ae0 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:41:46.427022 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4acf0ded-b4f2-45a9-8e67-7d1d6c9f4ae0 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:41:46.543486 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-4acf0ded-b4f2-45a9-8e67-7d1d6c9f4ae0 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action" status: 200 len: 28651 microversion: 2.1 time: 0.137398 Nov 23 13:41:46.544099 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1042/2089] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:41:46 2021] POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action => generated 28651 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:41:47.561159 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-3c36a922-49b2-404d-baeb-a8543f792c92 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:41:47.562668 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-3c36a922-49b2-404d-baeb-a8543f792c92 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:41:47.571130 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3c36a922-49b2-404d-baeb-a8543f792c92 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:41:47.571555 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3c36a922-49b2-404d-baeb-a8543f792c92 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:41:47.572358 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3c36a922-49b2-404d-baeb-a8543f792c92 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:41:47.572785 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3c36a922-49b2-404d-baeb-a8543f792c92 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:41:47.688469 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-3c36a922-49b2-404d-baeb-a8543f792c92 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action" status: 200 len: 28651 microversion: 2.1 time: 0.134136 Nov 23 13:41:47.689156 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1048/2090] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:41:47 2021] POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action => generated 28651 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:41:48.703331 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-5821136f-9217-479d-892c-953c980e5b39 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:41:48.704672 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-5821136f-9217-479d-892c-953c980e5b39 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:41:48.713354 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5821136f-9217-479d-892c-953c980e5b39 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:41:48.713803 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5821136f-9217-479d-892c-953c980e5b39 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:41:48.714578 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5821136f-9217-479d-892c-953c980e5b39 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:41:48.715008 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5821136f-9217-479d-892c-953c980e5b39 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:41:48.833916 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-5821136f-9217-479d-892c-953c980e5b39 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action" status: 200 len: 28651 microversion: 2.1 time: 0.135781 Nov 23 13:41:48.834600 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1043/2091] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:41:48 2021] POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action => generated 28651 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:41:49.847470 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-fc7a9dd9-2baa-442c-afa9-7d36e2acac16 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:41:49.848573 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-fc7a9dd9-2baa-442c-afa9-7d36e2acac16 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:41:49.857587 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-fc7a9dd9-2baa-442c-afa9-7d36e2acac16 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:41:49.858029 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-fc7a9dd9-2baa-442c-afa9-7d36e2acac16 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:41:49.858898 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-fc7a9dd9-2baa-442c-afa9-7d36e2acac16 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:41:49.859330 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-fc7a9dd9-2baa-442c-afa9-7d36e2acac16 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:41:49.978692 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-fc7a9dd9-2baa-442c-afa9-7d36e2acac16 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action" status: 200 len: 28651 microversion: 2.1 time: 0.135599 Nov 23 13:41:49.979323 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1049/2092] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:41:49 2021] POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action => generated 28651 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:41:50.991515 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-731bd32c-0d0b-423c-928c-bdc617d4e43c tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:41:50.992487 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-731bd32c-0d0b-423c-928c-bdc617d4e43c tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:41:51.000721 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-731bd32c-0d0b-423c-928c-bdc617d4e43c tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:41:51.001160 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-731bd32c-0d0b-423c-928c-bdc617d4e43c tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:41:51.001922 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-731bd32c-0d0b-423c-928c-bdc617d4e43c tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:41:51.002342 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-731bd32c-0d0b-423c-928c-bdc617d4e43c tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:41:51.134541 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-731bd32c-0d0b-423c-928c-bdc617d4e43c tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action" status: 200 len: 28651 microversion: 2.1 time: 0.146439 Nov 23 13:41:51.135436 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1044/2093] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:41:50 2021] POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action => generated 28651 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:41:52.153943 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-d88033de-6913-4bb3-b23f-4848a9bb422f tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:41:52.155616 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-d88033de-6913-4bb3-b23f-4848a9bb422f tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:41:52.164724 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d88033de-6913-4bb3-b23f-4848a9bb422f tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:41:52.165171 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d88033de-6913-4bb3-b23f-4848a9bb422f tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:41:52.165943 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d88033de-6913-4bb3-b23f-4848a9bb422f tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:41:52.166364 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d88033de-6913-4bb3-b23f-4848a9bb422f tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:41:52.293396 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-d88033de-6913-4bb3-b23f-4848a9bb422f tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action" status: 200 len: 28651 microversion: 2.1 time: 0.145536 Nov 23 13:41:52.294429 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1050/2094] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:41:52 2021] POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action => generated 28651 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:41:53.312023 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-442f9b23-3825-4c81-9542-e104a6f10c29 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:41:53.313722 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-442f9b23-3825-4c81-9542-e104a6f10c29 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:41:53.326890 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-442f9b23-3825-4c81-9542-e104a6f10c29 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:41:53.327621 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-442f9b23-3825-4c81-9542-e104a6f10c29 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:41:53.329108 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-442f9b23-3825-4c81-9542-e104a6f10c29 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:41:53.329486 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-442f9b23-3825-4c81-9542-e104a6f10c29 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:41:53.464054 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-442f9b23-3825-4c81-9542-e104a6f10c29 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action" status: 200 len: 30739 microversion: 2.1 time: 0.158783 Nov 23 13:41:53.464727 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1045/2095] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:41:53 2021] POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action => generated 30739 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:41:54.481520 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-e0248e16-8ea5-42d2-b55b-bddf8c606676 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:41:54.483029 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-e0248e16-8ea5-42d2-b55b-bddf8c606676 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:41:54.493493 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e0248e16-8ea5-42d2-b55b-bddf8c606676 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:41:54.493936 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e0248e16-8ea5-42d2-b55b-bddf8c606676 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:41:54.494688 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e0248e16-8ea5-42d2-b55b-bddf8c606676 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:41:54.495141 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e0248e16-8ea5-42d2-b55b-bddf8c606676 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:41:54.619997 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-e0248e16-8ea5-42d2-b55b-bddf8c606676 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action" status: 200 len: 32798 microversion: 2.1 time: 0.145225 Nov 23 13:41:54.620845 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1051/2096] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:41:54 2021] POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action => generated 32798 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:41:55.635742 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-d764f2d9-5096-45ea-8ece-f077ed26a03c tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:41:55.636919 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-d764f2d9-5096-45ea-8ece-f077ed26a03c tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:41:55.645536 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d764f2d9-5096-45ea-8ece-f077ed26a03c tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:41:55.645991 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d764f2d9-5096-45ea-8ece-f077ed26a03c tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:41:55.646806 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d764f2d9-5096-45ea-8ece-f077ed26a03c tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:41:55.647236 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d764f2d9-5096-45ea-8ece-f077ed26a03c tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:41:55.773919 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-d764f2d9-5096-45ea-8ece-f077ed26a03c tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action" status: 200 len: 33864 microversion: 2.1 time: 0.142048 Nov 23 13:41:55.774474 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1046/2097] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:41:55 2021] POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action => generated 33864 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:41:56.790872 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-bf8ebebf-a847-4917-abd6-c700ba4531f9 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:41:56.792565 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-bf8ebebf-a847-4917-abd6-c700ba4531f9 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:41:56.802931 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-bf8ebebf-a847-4917-abd6-c700ba4531f9 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:41:56.803400 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-bf8ebebf-a847-4917-abd6-c700ba4531f9 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:41:56.804188 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-bf8ebebf-a847-4917-abd6-c700ba4531f9 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:41:56.804758 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-bf8ebebf-a847-4917-abd6-c700ba4531f9 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:41:56.932261 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-bf8ebebf-a847-4917-abd6-c700ba4531f9 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action" status: 200 len: 35181 microversion: 2.1 time: 0.147742 Nov 23 13:41:56.933046 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1052/2098] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:41:56 2021] POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action => generated 35181 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:41:57.951085 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-71f5f701-1290-47fd-a6d1-7f6ea6547691 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:41:57.952571 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-71f5f701-1290-47fd-a6d1-7f6ea6547691 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:41:57.966227 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-71f5f701-1290-47fd-a6d1-7f6ea6547691 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:41:57.967309 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-71f5f701-1290-47fd-a6d1-7f6ea6547691 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:41:57.968492 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-71f5f701-1290-47fd-a6d1-7f6ea6547691 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:41:57.969068 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-71f5f701-1290-47fd-a6d1-7f6ea6547691 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:41:58.097030 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-71f5f701-1290-47fd-a6d1-7f6ea6547691 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action" status: 200 len: 36690 microversion: 2.1 time: 0.152652 Nov 23 13:41:58.097784 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1047/2099] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:41:57 2021] POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action => generated 36690 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:41:59.113669 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-13607809-9525-42ca-b561-c647a8b1e112 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:41:59.114735 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-13607809-9525-42ca-b561-c647a8b1e112 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:41:59.123525 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-13607809-9525-42ca-b561-c647a8b1e112 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:41:59.123920 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-13607809-9525-42ca-b561-c647a8b1e112 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:41:59.124773 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-13607809-9525-42ca-b561-c647a8b1e112 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:41:59.125249 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-13607809-9525-42ca-b561-c647a8b1e112 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:41:59.253106 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-13607809-9525-42ca-b561-c647a8b1e112 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action" status: 200 len: 38182 microversion: 2.1 time: 0.144491 Nov 23 13:41:59.254302 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1053/2100] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:41:59 2021] POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action => generated 38182 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:42:00.272231 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-fe466a6c-0f2e-4d01-b7e4-c17e6384e2a7 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:42:00.273772 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-fe466a6c-0f2e-4d01-b7e4-c17e6384e2a7 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:42:00.285005 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-fe466a6c-0f2e-4d01-b7e4-c17e6384e2a7 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:42:00.285462 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-fe466a6c-0f2e-4d01-b7e4-c17e6384e2a7 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:42:00.286285 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-fe466a6c-0f2e-4d01-b7e4-c17e6384e2a7 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:42:00.286719 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-fe466a6c-0f2e-4d01-b7e4-c17e6384e2a7 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:42:00.419199 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-fe466a6c-0f2e-4d01-b7e4-c17e6384e2a7 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action" status: 200 len: 38182 microversion: 2.1 time: 0.153462 Nov 23 13:42:00.420167 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1048/2101] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:42:00 2021] POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action => generated 38182 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:42:01.438969 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-d8b9a9a0-e775-43dd-8510-2a2bb5ba358e tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:42:01.440836 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-d8b9a9a0-e775-43dd-8510-2a2bb5ba358e tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:42:01.453959 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d8b9a9a0-e775-43dd-8510-2a2bb5ba358e tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:42:01.454820 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d8b9a9a0-e775-43dd-8510-2a2bb5ba358e tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:42:01.455764 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d8b9a9a0-e775-43dd-8510-2a2bb5ba358e tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:42:01.456212 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d8b9a9a0-e775-43dd-8510-2a2bb5ba358e tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:42:01.572924 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-d8b9a9a0-e775-43dd-8510-2a2bb5ba358e tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action" status: 200 len: 38182 microversion: 2.1 time: 0.140711 Nov 23 13:42:01.573582 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1054/2102] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:42:01 2021] POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action => generated 38182 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:42:02.589074 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-5db7a7f4-b2ce-4ede-932c-7b985c00f47c tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:42:02.590106 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-5db7a7f4-b2ce-4ede-932c-7b985c00f47c tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:42:02.599391 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5db7a7f4-b2ce-4ede-932c-7b985c00f47c tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:42:02.599856 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5db7a7f4-b2ce-4ede-932c-7b985c00f47c tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:42:02.600697 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5db7a7f4-b2ce-4ede-932c-7b985c00f47c tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:42:02.601121 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5db7a7f4-b2ce-4ede-932c-7b985c00f47c tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:42:02.729607 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-5db7a7f4-b2ce-4ede-932c-7b985c00f47c tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action" status: 200 len: 38182 microversion: 2.1 time: 0.145671 Nov 23 13:42:02.730328 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1049/2103] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:42:02 2021] POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action => generated 38182 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:42:03.748291 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-702b089d-ab3c-4a8a-b2f6-eaf3caf9c63d tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:42:03.750042 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-702b089d-ab3c-4a8a-b2f6-eaf3caf9c63d tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:42:03.763952 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-702b089d-ab3c-4a8a-b2f6-eaf3caf9c63d tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:42:03.764710 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-702b089d-ab3c-4a8a-b2f6-eaf3caf9c63d tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:42:03.766022 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-702b089d-ab3c-4a8a-b2f6-eaf3caf9c63d tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:42:03.766744 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-702b089d-ab3c-4a8a-b2f6-eaf3caf9c63d tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:42:03.894485 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-702b089d-ab3c-4a8a-b2f6-eaf3caf9c63d tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action" status: 200 len: 38311 microversion: 2.1 time: 0.152831 Nov 23 13:42:03.896656 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1055/2104] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:42:03 2021] POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action => generated 38311 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:42:03.911542 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-6b794051-01bc-48d3-a07e-bf5787bcc8f4 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:42:03.912146 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-6b794051-01bc-48d3-a07e-bf5787bcc8f4 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:42:03.920101 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6b794051-01bc-48d3-a07e-bf5787bcc8f4 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:42:03.920588 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6b794051-01bc-48d3-a07e-bf5787bcc8f4 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:42:03.921369 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6b794051-01bc-48d3-a07e-bf5787bcc8f4 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:42:03.921793 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6b794051-01bc-48d3-a07e-bf5787bcc8f4 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:42:03.982081 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-6b794051-01bc-48d3-a07e-bf5787bcc8f4 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "GET /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/ips" status: 200 len: 145 microversion: 2.1 time: 0.076329 Nov 23 13:42:03.982837 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1050/2105] 10.222.0.60 () {58 vars in 1247 bytes} [Tue Nov 23 13:42:03 2021] GET /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/ips => generated 145 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 13:42:06.528492 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-883a7831-b419-47d0-a94b-8a5bb4811de1 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "38d1d5d6-79f5-4d23-abfa-c21062c7b63d"}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:42:06.529658 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-883a7831-b419-47d0-a94b-8a5bb4811de1 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:42:06.538265 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-883a7831-b419-47d0-a94b-8a5bb4811de1 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:42:06.538706 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-883a7831-b419-47d0-a94b-8a5bb4811de1 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:42:06.539460 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-883a7831-b419-47d0-a94b-8a5bb4811de1 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:42:06.539897 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-883a7831-b419-47d0-a94b-8a5bb4811de1 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:42:06.935155 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-883a7831-b419-47d0-a94b-8a5bb4811de1 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.410833 Nov 23 13:42:06.935793 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1056/2106] 10.222.0.60 () {60 vars in 1322 bytes} [Tue Nov 23 13:42:06 2021] POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/os-volume_attachments => generated 194 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 13:42:14.908589 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-fe5f45a8-135c-41ff-af54-588d118f43f9 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:42:14.916561 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-fe5f45a8-135c-41ff-af54-588d118f43f9 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:42:14.917007 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-fe5f45a8-135c-41ff-af54-588d118f43f9 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:42:14.973592 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-fe5f45a8-135c-41ff-af54-588d118f43f9 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Going to try to stop instance {{(pid=100973) force_stop /opt/stack/nova/nova/compute/api.py:2602}} Nov 23 13:42:15.053980 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-fe5f45a8-135c-41ff-af54-588d118f43f9 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action" status: 202 len: 0 microversion: 2.1 time: 0.148956 Nov 23 13:42:15.055135 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1051/2107] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:42:14 2021] POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:42:15.067362 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-6804b0e9-5446-4a8e-b704-c46a39a490b3 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:42:15.068067 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-6804b0e9-5446-4a8e-b704-c46a39a490b3 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:42:15.077704 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-6804b0e9-5446-4a8e-b704-c46a39a490b3 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:42:15.078156 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-6804b0e9-5446-4a8e-b704-c46a39a490b3 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:42:15.078968 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-6804b0e9-5446-4a8e-b704-c46a39a490b3 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:42:15.079508 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-6804b0e9-5446-4a8e-b704-c46a39a490b3 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:42:15.285423 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-6804b0e9-5446-4a8e-b704-c46a39a490b3 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5e06990f874a099eb9f92dde95e85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c610ba775aca44aa85aaf415f96bb37e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:42:15.295238 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-6804b0e9-5446-4a8e-b704-c46a39a490b3 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "GET /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455" status: 200 len: 1721 microversion: 2.1 time: 0.235109 Nov 23 13:42:15.295791 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1057/2108] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:42:15 2021] GET /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455 => generated 1721 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:42:16.316604 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-2c537ee4-ef3b-45d5-b23d-b6f1a25c972c tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:42:16.317591 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-2c537ee4-ef3b-45d5-b23d-b6f1a25c972c tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:42:16.328133 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-2c537ee4-ef3b-45d5-b23d-b6f1a25c972c tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:42:16.328782 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-2c537ee4-ef3b-45d5-b23d-b6f1a25c972c tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:42:16.329810 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-2c537ee4-ef3b-45d5-b23d-b6f1a25c972c tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:42:16.330378 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-2c537ee4-ef3b-45d5-b23d-b6f1a25c972c tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:42:16.541268 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-2c537ee4-ef3b-45d5-b23d-b6f1a25c972c tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5e06990f874a099eb9f92dde95e85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c610ba775aca44aa85aaf415f96bb37e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:42:16.555419 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-2c537ee4-ef3b-45d5-b23d-b6f1a25c972c tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "GET /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455" status: 200 len: 1721 microversion: 2.1 time: 0.244023 Nov 23 13:42:16.556207 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1052/2109] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:42:16 2021] GET /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455 => generated 1721 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:42:17.575893 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-156c2931-646e-43d2-b738-741b2cf08715 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:42:17.576687 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-156c2931-646e-43d2-b738-741b2cf08715 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:42:17.586560 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-156c2931-646e-43d2-b738-741b2cf08715 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:42:17.587005 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-156c2931-646e-43d2-b738-741b2cf08715 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:42:17.587774 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-156c2931-646e-43d2-b738-741b2cf08715 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:42:17.588206 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-156c2931-646e-43d2-b738-741b2cf08715 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:42:17.787702 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-156c2931-646e-43d2-b738-741b2cf08715 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5e06990f874a099eb9f92dde95e85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c610ba775aca44aa85aaf415f96bb37e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:42:17.796565 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-156c2931-646e-43d2-b738-741b2cf08715 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "GET /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455" status: 200 len: 1721 microversion: 2.1 time: 0.225354 Nov 23 13:42:17.797131 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1058/2110] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:42:17 2021] GET /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455 => generated 1721 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:42:18.813974 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-5853890e-acf4-472f-a949-8282e6f583a9 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:42:18.814684 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-5853890e-acf4-472f-a949-8282e6f583a9 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:42:18.823328 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5853890e-acf4-472f-a949-8282e6f583a9 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:42:18.823783 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5853890e-acf4-472f-a949-8282e6f583a9 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:42:18.824598 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5853890e-acf4-472f-a949-8282e6f583a9 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:42:18.825452 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-5853890e-acf4-472f-a949-8282e6f583a9 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:42:19.051740 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-5853890e-acf4-472f-a949-8282e6f583a9 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5e06990f874a099eb9f92dde95e85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c610ba775aca44aa85aaf415f96bb37e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:42:19.065714 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-5853890e-acf4-472f-a949-8282e6f583a9 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "GET /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455" status: 200 len: 1721 microversion: 2.1 time: 0.255770 Nov 23 13:42:19.066276 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1053/2111] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:42:18 2021] GET /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455 => generated 1721 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:42:20.085119 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-8b37692f-a337-479a-a386-748f88e4897a tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:42:20.085998 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-8b37692f-a337-479a-a386-748f88e4897a tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:42:20.094343 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8b37692f-a337-479a-a386-748f88e4897a tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:42:20.094800 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8b37692f-a337-479a-a386-748f88e4897a tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:42:20.095648 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8b37692f-a337-479a-a386-748f88e4897a tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:42:20.096169 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8b37692f-a337-479a-a386-748f88e4897a tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:42:20.316435 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-8b37692f-a337-479a-a386-748f88e4897a tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5e06990f874a099eb9f92dde95e85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c610ba775aca44aa85aaf415f96bb37e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:42:20.326428 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-8b37692f-a337-479a-a386-748f88e4897a tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "GET /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455" status: 200 len: 1721 microversion: 2.1 time: 0.246507 Nov 23 13:42:20.326997 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1059/2112] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:42:20 2021] GET /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455 => generated 1721 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:42:21.345368 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-267b45de-8725-44d1-9408-452e4ac07d43 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:42:21.346042 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-267b45de-8725-44d1-9408-452e4ac07d43 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:42:21.355025 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-267b45de-8725-44d1-9408-452e4ac07d43 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:42:21.355528 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-267b45de-8725-44d1-9408-452e4ac07d43 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:42:21.356437 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-267b45de-8725-44d1-9408-452e4ac07d43 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:42:21.356925 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-267b45de-8725-44d1-9408-452e4ac07d43 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:42:21.557795 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-267b45de-8725-44d1-9408-452e4ac07d43 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5e06990f874a099eb9f92dde95e85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c610ba775aca44aa85aaf415f96bb37e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:42:21.570778 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-267b45de-8725-44d1-9408-452e4ac07d43 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "GET /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455" status: 200 len: 1721 microversion: 2.1 time: 0.229390 Nov 23 13:42:21.571450 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1054/2113] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:42:21 2021] GET /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455 => generated 1721 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:42:22.598830 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-8cc88fe6-be2b-4ace-851b-478deeda8f4c tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:42:22.599774 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-8cc88fe6-be2b-4ace-851b-478deeda8f4c tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:42:22.608735 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8cc88fe6-be2b-4ace-851b-478deeda8f4c tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:42:22.609189 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8cc88fe6-be2b-4ace-851b-478deeda8f4c tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:42:22.609956 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8cc88fe6-be2b-4ace-851b-478deeda8f4c tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:42:22.610387 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8cc88fe6-be2b-4ace-851b-478deeda8f4c tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:42:22.820772 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-8cc88fe6-be2b-4ace-851b-478deeda8f4c tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5e06990f874a099eb9f92dde95e85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c610ba775aca44aa85aaf415f96bb37e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:42:22.829883 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-8cc88fe6-be2b-4ace-851b-478deeda8f4c tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "GET /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455" status: 200 len: 1721 microversion: 2.1 time: 0.237583 Nov 23 13:42:22.830445 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1060/2114] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:42:22 2021] GET /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455 => generated 1721 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:42:23.848289 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-2b030393-f46b-4298-b597-1cdcd42f2a94 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:42:23.848922 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-2b030393-f46b-4298-b597-1cdcd42f2a94 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:42:23.857122 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-2b030393-f46b-4298-b597-1cdcd42f2a94 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:42:23.857568 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-2b030393-f46b-4298-b597-1cdcd42f2a94 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:42:23.858320 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-2b030393-f46b-4298-b597-1cdcd42f2a94 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:42:23.858743 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-2b030393-f46b-4298-b597-1cdcd42f2a94 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:42:24.073012 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-2b030393-f46b-4298-b597-1cdcd42f2a94 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5e06990f874a099eb9f92dde95e85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c610ba775aca44aa85aaf415f96bb37e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:42:24.081794 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-2b030393-f46b-4298-b597-1cdcd42f2a94 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "GET /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455" status: 200 len: 1721 microversion: 2.1 time: 0.237445 Nov 23 13:42:24.082359 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1055/2115] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:42:23 2021] GET /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455 => generated 1721 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:42:25.105175 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-68ee670c-2683-476d-a5bc-989ba05900bd tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:42:25.106132 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-68ee670c-2683-476d-a5bc-989ba05900bd tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:42:25.118518 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-68ee670c-2683-476d-a5bc-989ba05900bd tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:42:25.118970 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-68ee670c-2683-476d-a5bc-989ba05900bd tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:42:25.119807 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-68ee670c-2683-476d-a5bc-989ba05900bd tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:42:25.120174 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-68ee670c-2683-476d-a5bc-989ba05900bd tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:42:25.424001 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-68ee670c-2683-476d-a5bc-989ba05900bd tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5e06990f874a099eb9f92dde95e85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c610ba775aca44aa85aaf415f96bb37e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:42:25.433522 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-68ee670c-2683-476d-a5bc-989ba05900bd tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "GET /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455" status: 200 len: 1721 microversion: 2.1 time: 0.335131 Nov 23 13:42:25.434068 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1061/2116] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:42:25 2021] GET /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455 => generated 1721 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:42:26.455519 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-15505c4e-50ee-491b-bd5f-77664ce87357 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:42:26.456533 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-15505c4e-50ee-491b-bd5f-77664ce87357 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:42:26.469591 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-15505c4e-50ee-491b-bd5f-77664ce87357 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:42:26.470235 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-15505c4e-50ee-491b-bd5f-77664ce87357 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:42:26.471482 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-15505c4e-50ee-491b-bd5f-77664ce87357 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:42:26.472313 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-15505c4e-50ee-491b-bd5f-77664ce87357 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:42:26.710307 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-15505c4e-50ee-491b-bd5f-77664ce87357 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5e06990f874a099eb9f92dde95e85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c610ba775aca44aa85aaf415f96bb37e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:42:26.719585 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-15505c4e-50ee-491b-bd5f-77664ce87357 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "GET /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455" status: 200 len: 1721 microversion: 2.1 time: 0.270757 Nov 23 13:42:26.720306 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1056/2117] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:42:26 2021] GET /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455 => generated 1721 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:42:27.741803 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-a92bcafa-4433-4e28-8432-503b650a7137 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:42:27.746201 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-a92bcafa-4433-4e28-8432-503b650a7137 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:42:27.755354 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a92bcafa-4433-4e28-8432-503b650a7137 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:42:27.756078 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a92bcafa-4433-4e28-8432-503b650a7137 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:42:27.757387 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a92bcafa-4433-4e28-8432-503b650a7137 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:42:27.758095 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a92bcafa-4433-4e28-8432-503b650a7137 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:42:27.967318 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-a92bcafa-4433-4e28-8432-503b650a7137 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5e06990f874a099eb9f92dde95e85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c610ba775aca44aa85aaf415f96bb37e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:42:27.976868 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-a92bcafa-4433-4e28-8432-503b650a7137 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "GET /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455" status: 200 len: 1721 microversion: 2.1 time: 0.241389 Nov 23 13:42:27.977424 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1062/2118] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:42:27 2021] GET /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455 => generated 1721 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:42:28.996998 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-c3eeb74e-9afc-43b4-9fc5-adafc41fbab6 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:42:28.997768 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-c3eeb74e-9afc-43b4-9fc5-adafc41fbab6 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:42:29.007738 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c3eeb74e-9afc-43b4-9fc5-adafc41fbab6 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:42:29.008349 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c3eeb74e-9afc-43b4-9fc5-adafc41fbab6 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:42:29.009499 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c3eeb74e-9afc-43b4-9fc5-adafc41fbab6 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:42:29.010057 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c3eeb74e-9afc-43b4-9fc5-adafc41fbab6 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:42:29.228820 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-c3eeb74e-9afc-43b4-9fc5-adafc41fbab6 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5e06990f874a099eb9f92dde95e85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c610ba775aca44aa85aaf415f96bb37e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:42:29.239034 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-c3eeb74e-9afc-43b4-9fc5-adafc41fbab6 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "GET /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455" status: 200 len: 1721 microversion: 2.1 time: 0.247334 Nov 23 13:42:29.239621 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1057/2119] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:42:28 2021] GET /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455 => generated 1721 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:42:30.258584 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-019c5f3c-7f67-4c50-a5be-1b8ed0fb3fe6 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:42:30.259372 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-019c5f3c-7f67-4c50-a5be-1b8ed0fb3fe6 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:42:30.269391 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-019c5f3c-7f67-4c50-a5be-1b8ed0fb3fe6 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:42:30.270001 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-019c5f3c-7f67-4c50-a5be-1b8ed0fb3fe6 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:42:30.271032 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-019c5f3c-7f67-4c50-a5be-1b8ed0fb3fe6 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:42:30.271596 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-019c5f3c-7f67-4c50-a5be-1b8ed0fb3fe6 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:42:30.485083 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-019c5f3c-7f67-4c50-a5be-1b8ed0fb3fe6 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5e06990f874a099eb9f92dde95e85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c610ba775aca44aa85aaf415f96bb37e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:42:30.494585 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-019c5f3c-7f67-4c50-a5be-1b8ed0fb3fe6 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "GET /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455" status: 200 len: 1721 microversion: 2.1 time: 0.241035 Nov 23 13:42:30.495334 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1063/2120] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:42:30 2021] GET /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455 => generated 1721 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:42:31.515411 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-20e68f71-76bc-4b24-9478-45be42d2ea78 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:42:31.516059 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-20e68f71-76bc-4b24-9478-45be42d2ea78 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:42:31.523801 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-20e68f71-76bc-4b24-9478-45be42d2ea78 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:42:31.524283 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-20e68f71-76bc-4b24-9478-45be42d2ea78 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:42:31.525081 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-20e68f71-76bc-4b24-9478-45be42d2ea78 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:42:31.525515 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-20e68f71-76bc-4b24-9478-45be42d2ea78 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:42:31.754985 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-20e68f71-76bc-4b24-9478-45be42d2ea78 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5e06990f874a099eb9f92dde95e85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c610ba775aca44aa85aaf415f96bb37e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:42:31.769868 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-20e68f71-76bc-4b24-9478-45be42d2ea78 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "GET /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455" status: 200 len: 1721 microversion: 2.1 time: 0.259257 Nov 23 13:42:31.770735 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1058/2121] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:42:31 2021] GET /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455 => generated 1721 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:42:32.792583 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-2d3c2292-b9c3-4201-ab5c-728ab1146932 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:42:32.793397 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-2d3c2292-b9c3-4201-ab5c-728ab1146932 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:42:32.807444 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2d3c2292-b9c3-4201-ab5c-728ab1146932 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:42:32.807444 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2d3c2292-b9c3-4201-ab5c-728ab1146932 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:42:32.807444 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2d3c2292-b9c3-4201-ab5c-728ab1146932 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:42:32.807444 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2d3c2292-b9c3-4201-ab5c-728ab1146932 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:42:33.021345 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-2d3c2292-b9c3-4201-ab5c-728ab1146932 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5e06990f874a099eb9f92dde95e85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c610ba775aca44aa85aaf415f96bb37e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:42:33.034770 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-2d3c2292-b9c3-4201-ab5c-728ab1146932 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "GET /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455" status: 200 len: 1721 microversion: 2.1 time: 0.247051 Nov 23 13:42:33.035498 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1064/2122] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:42:32 2021] GET /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455 => generated 1721 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:42:34.056964 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-a97cd757-c3ab-453d-9314-dce51a2a356a tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:42:34.057791 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-a97cd757-c3ab-453d-9314-dce51a2a356a tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:42:34.066744 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a97cd757-c3ab-453d-9314-dce51a2a356a tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:42:34.067367 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a97cd757-c3ab-453d-9314-dce51a2a356a tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:42:34.068501 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a97cd757-c3ab-453d-9314-dce51a2a356a tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:42:34.068995 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a97cd757-c3ab-453d-9314-dce51a2a356a tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:42:34.443804 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-a97cd757-c3ab-453d-9314-dce51a2a356a tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5e06990f874a099eb9f92dde95e85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c610ba775aca44aa85aaf415f96bb37e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:42:34.452949 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-a97cd757-c3ab-453d-9314-dce51a2a356a tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "GET /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455" status: 200 len: 1721 microversion: 2.1 time: 0.401042 Nov 23 13:42:34.453511 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1059/2123] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:42:34 2021] GET /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455 => generated 1721 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:42:35.471705 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-57bbd957-1d29-47d9-b6cc-46796498cc9c tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:42:35.472397 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-57bbd957-1d29-47d9-b6cc-46796498cc9c tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:42:35.479830 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-57bbd957-1d29-47d9-b6cc-46796498cc9c tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:42:35.480301 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-57bbd957-1d29-47d9-b6cc-46796498cc9c tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:42:35.481080 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-57bbd957-1d29-47d9-b6cc-46796498cc9c tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:42:35.481513 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-57bbd957-1d29-47d9-b6cc-46796498cc9c tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:42:35.689443 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-57bbd957-1d29-47d9-b6cc-46796498cc9c tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5e06990f874a099eb9f92dde95e85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c610ba775aca44aa85aaf415f96bb37e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:42:35.703433 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-57bbd957-1d29-47d9-b6cc-46796498cc9c tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "GET /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455" status: 200 len: 1721 microversion: 2.1 time: 0.235401 Nov 23 13:42:35.704265 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1065/2124] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:42:35 2021] GET /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455 => generated 1721 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:42:36.724328 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-2c2e0810-7d0e-4582-b8c3-8b78e0986863 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:42:36.724986 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-2c2e0810-7d0e-4582-b8c3-8b78e0986863 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:42:36.734766 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-2c2e0810-7d0e-4582-b8c3-8b78e0986863 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:42:36.735211 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-2c2e0810-7d0e-4582-b8c3-8b78e0986863 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:42:36.735968 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-2c2e0810-7d0e-4582-b8c3-8b78e0986863 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:42:36.736446 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-2c2e0810-7d0e-4582-b8c3-8b78e0986863 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:42:36.944492 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-2c2e0810-7d0e-4582-b8c3-8b78e0986863 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5e06990f874a099eb9f92dde95e85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c610ba775aca44aa85aaf415f96bb37e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:42:36.953550 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-2c2e0810-7d0e-4582-b8c3-8b78e0986863 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "GET /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455" status: 200 len: 1698 microversion: 2.1 time: 0.235274 Nov 23 13:42:36.954097 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1060/2125] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:42:36 2021] GET /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455 => generated 1698 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:42:36.975504 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-a56b49c9-7c2b-4f07-aa73-9d062d3f5e62 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:42:36.983459 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a56b49c9-7c2b-4f07-aa73-9d062d3f5e62 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:42:36.983874 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a56b49c9-7c2b-4f07-aa73-9d062d3f5e62 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:42:37.041021 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-a56b49c9-7c2b-4f07-aa73-9d062d3f5e62 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Going to try to start instance {{(pid=100974) start /opt/stack/nova/nova/compute/api.py:2625}} Nov 23 13:42:37.123728 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-a56b49c9-7c2b-4f07-aa73-9d062d3f5e62 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action" status: 202 len: 0 microversion: 2.1 time: 0.151655 Nov 23 13:42:37.124467 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1066/2126] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:42:36 2021] POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:42:37.132778 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-24ef6898-a89e-4f74-926f-81600a909078 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:42:37.133402 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-24ef6898-a89e-4f74-926f-81600a909078 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:42:37.141838 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-24ef6898-a89e-4f74-926f-81600a909078 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:42:37.142294 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-24ef6898-a89e-4f74-926f-81600a909078 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:42:37.143204 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-24ef6898-a89e-4f74-926f-81600a909078 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:42:37.143633 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-24ef6898-a89e-4f74-926f-81600a909078 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:42:37.355471 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-24ef6898-a89e-4f74-926f-81600a909078 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5e06990f874a099eb9f92dde95e85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c610ba775aca44aa85aaf415f96bb37e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:42:37.364497 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-24ef6898-a89e-4f74-926f-81600a909078 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "GET /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455" status: 200 len: 1707 microversion: 2.1 time: 0.235564 Nov 23 13:42:37.365046 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1061/2127] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:42:37 2021] GET /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455 => generated 1707 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:42:38.387165 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-db37c903-e947-487b-bfb3-c0dc96d00c03 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:42:38.387846 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-db37c903-e947-487b-bfb3-c0dc96d00c03 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:42:38.395981 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-db37c903-e947-487b-bfb3-c0dc96d00c03 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:42:38.396438 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-db37c903-e947-487b-bfb3-c0dc96d00c03 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:42:38.397190 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-db37c903-e947-487b-bfb3-c0dc96d00c03 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:42:38.397610 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-db37c903-e947-487b-bfb3-c0dc96d00c03 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:42:38.597847 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-db37c903-e947-487b-bfb3-c0dc96d00c03 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5e06990f874a099eb9f92dde95e85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c610ba775aca44aa85aaf415f96bb37e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:42:38.606647 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-db37c903-e947-487b-bfb3-c0dc96d00c03 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "GET /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455" status: 200 len: 1707 microversion: 2.1 time: 0.226359 Nov 23 13:42:38.607382 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1067/2128] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:42:38 2021] GET /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455 => generated 1707 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:42:39.628697 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-0d78a144-d519-4461-9bc6-77c41a175db0 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:42:39.629551 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-0d78a144-d519-4461-9bc6-77c41a175db0 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:42:39.638609 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0d78a144-d519-4461-9bc6-77c41a175db0 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:42:39.639269 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0d78a144-d519-4461-9bc6-77c41a175db0 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:42:39.640076 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0d78a144-d519-4461-9bc6-77c41a175db0 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:42:39.640544 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0d78a144-d519-4461-9bc6-77c41a175db0 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:42:39.856119 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-0d78a144-d519-4461-9bc6-77c41a175db0 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5e06990f874a099eb9f92dde95e85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c610ba775aca44aa85aaf415f96bb37e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:42:39.865472 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-0d78a144-d519-4461-9bc6-77c41a175db0 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "GET /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455" status: 200 len: 1711 microversion: 2.1 time: 0.241531 Nov 23 13:42:39.866044 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1062/2129] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:42:39 2021] GET /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455 => generated 1711 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:42:45.170861 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 13:42:45.171979 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: Tue Nov 23 13:42:45 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 23 13:42:48.693010 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 13:42:48.694074 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: Tue Nov 23 13:42:48 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 23 13:43:35.281517 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-07d13cfb-edfe-48cd-995e-14eb4b3d8ca2 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:43:35.282272 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-07d13cfb-edfe-48cd-995e-14eb4b3d8ca2 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:43:35.291578 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-07d13cfb-edfe-48cd-995e-14eb4b3d8ca2 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:43:35.292012 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-07d13cfb-edfe-48cd-995e-14eb4b3d8ca2 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:43:35.292808 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-07d13cfb-edfe-48cd-995e-14eb4b3d8ca2 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:43:35.293233 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-07d13cfb-edfe-48cd-995e-14eb4b3d8ca2 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:43:35.471995 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.objects.instance [None req-07d13cfb-edfe-48cd-995e-14eb4b3d8ca2 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lazy-loading 'services' on Instance uuid 932d4c6a-60ed-44a3-b9af-627f70d7f455 {{(pid=100974) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 23 13:43:35.617326 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-07d13cfb-edfe-48cd-995e-14eb4b3d8ca2 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "DELETE /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/os-volume_attachments/38d1d5d6-79f5-4d23-abfa-c21062c7b63d" status: 202 len: 0 microversion: 2.1 time: 0.340768 Nov 23 13:43:35.617912 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1068/2130] 10.222.0.60 () {58 vars in 1415 bytes} [Tue Nov 23 13:43:35 2021] DELETE /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/os-volume_attachments/38d1d5d6-79f5-4d23-abfa-c21062c7b63d => generated 0 bytes in 343 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:43:36.961175 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-2138525f-aa89-48d2-9427-8f4d76dd6933 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:43:36.968832 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-2138525f-aa89-48d2-9427-8f4d76dd6933 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:43:36.969274 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-2138525f-aa89-48d2-9427-8f4d76dd6933 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:43:37.024965 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-2138525f-aa89-48d2-9427-8f4d76dd6933 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Going to try to stop instance {{(pid=100973) force_stop /opt/stack/nova/nova/compute/api.py:2602}} Nov 23 13:43:37.105369 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-2138525f-aa89-48d2-9427-8f4d76dd6933 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action" status: 202 len: 0 microversion: 2.1 time: 0.148336 Nov 23 13:43:37.106286 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1063/2131] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:43:36 2021] POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:43:37.118461 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-345ffcb8-c172-413c-bf64-8573d82d44e7 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:43:37.119598 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-345ffcb8-c172-413c-bf64-8573d82d44e7 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:43:37.128514 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-345ffcb8-c172-413c-bf64-8573d82d44e7 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:43:37.128956 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-345ffcb8-c172-413c-bf64-8573d82d44e7 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:43:37.129727 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-345ffcb8-c172-413c-bf64-8573d82d44e7 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:43:37.130156 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-345ffcb8-c172-413c-bf64-8573d82d44e7 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:43:37.345794 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-345ffcb8-c172-413c-bf64-8573d82d44e7 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5e06990f874a099eb9f92dde95e85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c610ba775aca44aa85aaf415f96bb37e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:43:37.355100 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-345ffcb8-c172-413c-bf64-8573d82d44e7 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "GET /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455" status: 200 len: 1675 microversion: 2.1 time: 0.243129 Nov 23 13:43:37.355607 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1069/2132] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:43:37 2021] GET /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455 => generated 1675 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:43:38.373937 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-df33536f-17fc-4913-b9bb-f39afd6a6f14 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:43:38.374815 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-df33536f-17fc-4913-b9bb-f39afd6a6f14 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:43:38.382460 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-df33536f-17fc-4913-b9bb-f39afd6a6f14 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:43:38.382890 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-df33536f-17fc-4913-b9bb-f39afd6a6f14 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:43:38.383722 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-df33536f-17fc-4913-b9bb-f39afd6a6f14 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:43:38.384147 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-df33536f-17fc-4913-b9bb-f39afd6a6f14 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:43:38.606949 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-df33536f-17fc-4913-b9bb-f39afd6a6f14 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5e06990f874a099eb9f92dde95e85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c610ba775aca44aa85aaf415f96bb37e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:43:38.616154 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-df33536f-17fc-4913-b9bb-f39afd6a6f14 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "GET /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455" status: 200 len: 1675 microversion: 2.1 time: 0.246567 Nov 23 13:43:38.616780 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1064/2133] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:43:38 2021] GET /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455 => generated 1675 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:43:39.634513 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-420c6335-7b15-456b-a7fe-2b3b155e63be tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:43:39.635134 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-420c6335-7b15-456b-a7fe-2b3b155e63be tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:43:39.643721 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-420c6335-7b15-456b-a7fe-2b3b155e63be tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:43:39.644341 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-420c6335-7b15-456b-a7fe-2b3b155e63be tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:43:39.645183 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-420c6335-7b15-456b-a7fe-2b3b155e63be tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:43:39.645767 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-420c6335-7b15-456b-a7fe-2b3b155e63be tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:43:39.880333 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-420c6335-7b15-456b-a7fe-2b3b155e63be tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5e06990f874a099eb9f92dde95e85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c610ba775aca44aa85aaf415f96bb37e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:43:39.893122 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-420c6335-7b15-456b-a7fe-2b3b155e63be tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "GET /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455" status: 200 len: 1675 microversion: 2.1 time: 0.262305 Nov 23 13:43:39.893720 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1070/2134] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:43:39 2021] GET /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455 => generated 1675 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:43:40.911667 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-63db8fac-0ddf-4f9b-a335-490d2e17febe tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:43:40.912264 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-63db8fac-0ddf-4f9b-a335-490d2e17febe tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:43:40.920035 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-63db8fac-0ddf-4f9b-a335-490d2e17febe tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:43:40.920526 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-63db8fac-0ddf-4f9b-a335-490d2e17febe tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:43:40.921796 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-63db8fac-0ddf-4f9b-a335-490d2e17febe tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:43:40.922247 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-63db8fac-0ddf-4f9b-a335-490d2e17febe tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:43:41.125984 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-63db8fac-0ddf-4f9b-a335-490d2e17febe tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5e06990f874a099eb9f92dde95e85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c610ba775aca44aa85aaf415f96bb37e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:43:41.134810 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-63db8fac-0ddf-4f9b-a335-490d2e17febe tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "GET /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455" status: 200 len: 1675 microversion: 2.1 time: 0.227040 Nov 23 13:43:41.135352 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1065/2135] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:43:40 2021] GET /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455 => generated 1675 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:43:42.152947 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-a43c5635-7cfc-4edd-a109-991c28f7cbf9 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:43:42.153484 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-a43c5635-7cfc-4edd-a109-991c28f7cbf9 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:43:42.161761 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a43c5635-7cfc-4edd-a109-991c28f7cbf9 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:43:42.162208 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a43c5635-7cfc-4edd-a109-991c28f7cbf9 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:43:42.162991 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a43c5635-7cfc-4edd-a109-991c28f7cbf9 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:43:42.163418 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a43c5635-7cfc-4edd-a109-991c28f7cbf9 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:43:42.371077 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-a43c5635-7cfc-4edd-a109-991c28f7cbf9 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5e06990f874a099eb9f92dde95e85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c610ba775aca44aa85aaf415f96bb37e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:43:42.380210 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-a43c5635-7cfc-4edd-a109-991c28f7cbf9 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "GET /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455" status: 200 len: 1675 microversion: 2.1 time: 0.231149 Nov 23 13:43:42.380813 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1071/2136] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:43:42 2021] GET /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455 => generated 1675 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:43:43.398758 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-2ed67aae-a195-4511-bb76-71edc8d90687 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:43:43.399381 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-2ed67aae-a195-4511-bb76-71edc8d90687 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:43:43.407497 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-2ed67aae-a195-4511-bb76-71edc8d90687 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:43:43.407944 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-2ed67aae-a195-4511-bb76-71edc8d90687 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:43:43.408752 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-2ed67aae-a195-4511-bb76-71edc8d90687 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:43:43.409180 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-2ed67aae-a195-4511-bb76-71edc8d90687 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:43:43.629355 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-2ed67aae-a195-4511-bb76-71edc8d90687 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5e06990f874a099eb9f92dde95e85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c610ba775aca44aa85aaf415f96bb37e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:43:43.637935 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-2ed67aae-a195-4511-bb76-71edc8d90687 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "GET /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455" status: 200 len: 1675 microversion: 2.1 time: 0.242950 Nov 23 13:43:43.638511 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1066/2137] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:43:43 2021] GET /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455 => generated 1675 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:43:44.656718 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-634db66d-ea58-4d60-87f0-763e0c5766d2 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:43:44.657422 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-634db66d-ea58-4d60-87f0-763e0c5766d2 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:43:44.666603 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-634db66d-ea58-4d60-87f0-763e0c5766d2 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:43:44.667047 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-634db66d-ea58-4d60-87f0-763e0c5766d2 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:43:44.667815 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-634db66d-ea58-4d60-87f0-763e0c5766d2 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:43:44.668262 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-634db66d-ea58-4d60-87f0-763e0c5766d2 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:43:44.894841 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-634db66d-ea58-4d60-87f0-763e0c5766d2 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5e06990f874a099eb9f92dde95e85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c610ba775aca44aa85aaf415f96bb37e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:43:44.903953 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-634db66d-ea58-4d60-87f0-763e0c5766d2 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "GET /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455" status: 200 len: 1675 microversion: 2.1 time: 0.251430 Nov 23 13:43:44.904608 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1072/2138] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:43:44 2021] GET /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455 => generated 1675 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:43:45.923123 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-6e85573f-071f-434d-ba01-9e6a0cc477cc tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:43:45.923733 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-6e85573f-071f-434d-ba01-9e6a0cc477cc tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:43:45.933991 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6e85573f-071f-434d-ba01-9e6a0cc477cc tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:43:45.934442 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6e85573f-071f-434d-ba01-9e6a0cc477cc tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:43:45.935274 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6e85573f-071f-434d-ba01-9e6a0cc477cc tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:43:45.935698 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6e85573f-071f-434d-ba01-9e6a0cc477cc tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:43:46.168959 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-6e85573f-071f-434d-ba01-9e6a0cc477cc tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5e06990f874a099eb9f92dde95e85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c610ba775aca44aa85aaf415f96bb37e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:43:46.178561 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-6e85573f-071f-434d-ba01-9e6a0cc477cc tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "GET /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455" status: 200 len: 1675 microversion: 2.1 time: 0.259384 Nov 23 13:43:46.179150 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1067/2139] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:43:45 2021] GET /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455 => generated 1675 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:43:47.197325 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-5a9c675a-38b4-43c1-9fa8-c1f0b8670a41 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:43:47.197834 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-5a9c675a-38b4-43c1-9fa8-c1f0b8670a41 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:43:47.205655 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5a9c675a-38b4-43c1-9fa8-c1f0b8670a41 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:43:47.206105 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5a9c675a-38b4-43c1-9fa8-c1f0b8670a41 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:43:47.206866 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5a9c675a-38b4-43c1-9fa8-c1f0b8670a41 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:43:47.207319 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5a9c675a-38b4-43c1-9fa8-c1f0b8670a41 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:43:47.426870 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-5a9c675a-38b4-43c1-9fa8-c1f0b8670a41 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5e06990f874a099eb9f92dde95e85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c610ba775aca44aa85aaf415f96bb37e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:43:47.435234 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-5a9c675a-38b4-43c1-9fa8-c1f0b8670a41 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "GET /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455" status: 200 len: 1675 microversion: 2.1 time: 0.241928 Nov 23 13:43:47.435799 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1073/2140] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:43:47 2021] GET /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455 => generated 1675 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:43:48.454955 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-a1ce7e95-ae05-46f2-a7f8-d4a37614b131 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:43:48.455708 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-a1ce7e95-ae05-46f2-a7f8-d4a37614b131 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:43:48.465376 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a1ce7e95-ae05-46f2-a7f8-d4a37614b131 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:43:48.465840 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a1ce7e95-ae05-46f2-a7f8-d4a37614b131 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:43:48.466722 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a1ce7e95-ae05-46f2-a7f8-d4a37614b131 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:43:48.467174 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-a1ce7e95-ae05-46f2-a7f8-d4a37614b131 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:43:48.706051 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-a1ce7e95-ae05-46f2-a7f8-d4a37614b131 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5e06990f874a099eb9f92dde95e85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c610ba775aca44aa85aaf415f96bb37e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:43:48.721099 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-a1ce7e95-ae05-46f2-a7f8-d4a37614b131 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "GET /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455" status: 200 len: 1675 microversion: 2.1 time: 0.271393 Nov 23 13:43:48.722006 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1068/2141] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:43:48 2021] GET /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455 => generated 1675 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:43:49.742343 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-a10ea525-a9a1-4b7e-ad03-a2edcdeb1c39 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:43:49.742953 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-a10ea525-a9a1-4b7e-ad03-a2edcdeb1c39 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:43:49.751549 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a10ea525-a9a1-4b7e-ad03-a2edcdeb1c39 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:43:49.752104 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a10ea525-a9a1-4b7e-ad03-a2edcdeb1c39 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:43:49.753098 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a10ea525-a9a1-4b7e-ad03-a2edcdeb1c39 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:43:49.753586 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a10ea525-a9a1-4b7e-ad03-a2edcdeb1c39 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:43:49.994355 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-a10ea525-a9a1-4b7e-ad03-a2edcdeb1c39 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5e06990f874a099eb9f92dde95e85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c610ba775aca44aa85aaf415f96bb37e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:43:50.005815 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-a10ea525-a9a1-4b7e-ad03-a2edcdeb1c39 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "GET /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455" status: 200 len: 1675 microversion: 2.1 time: 0.268549 Nov 23 13:43:50.006398 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1074/2142] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:43:49 2021] GET /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455 => generated 1675 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:43:50.543988 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 13:43:50.544209 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: Tue Nov 23 13:43:50 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 23 13:43:51.026757 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-46b99028-0534-4fdc-87b8-389627f55d54 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:43:51.027370 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-46b99028-0534-4fdc-87b8-389627f55d54 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:43:51.038001 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-46b99028-0534-4fdc-87b8-389627f55d54 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:43:51.038440 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-46b99028-0534-4fdc-87b8-389627f55d54 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:43:51.039218 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-46b99028-0534-4fdc-87b8-389627f55d54 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:43:51.039646 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-46b99028-0534-4fdc-87b8-389627f55d54 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:43:51.240589 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-46b99028-0534-4fdc-87b8-389627f55d54 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5e06990f874a099eb9f92dde95e85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c610ba775aca44aa85aaf415f96bb37e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:43:51.249464 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-46b99028-0534-4fdc-87b8-389627f55d54 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "GET /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455" status: 200 len: 1675 microversion: 2.1 time: 0.228776 Nov 23 13:43:51.250032 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1069/2143] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:43:51 2021] GET /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455 => generated 1675 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:43:52.267382 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-a6fb1baf-5fee-4e7f-8f13-d4a4cd5687bc tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:43:52.267989 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-a6fb1baf-5fee-4e7f-8f13-d4a4cd5687bc tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:43:52.276546 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a6fb1baf-5fee-4e7f-8f13-d4a4cd5687bc tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:43:52.276997 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a6fb1baf-5fee-4e7f-8f13-d4a4cd5687bc tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:43:52.277768 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a6fb1baf-5fee-4e7f-8f13-d4a4cd5687bc tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:43:52.278199 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-a6fb1baf-5fee-4e7f-8f13-d4a4cd5687bc tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:43:52.484689 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-a6fb1baf-5fee-4e7f-8f13-d4a4cd5687bc tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5e06990f874a099eb9f92dde95e85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c610ba775aca44aa85aaf415f96bb37e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:43:52.493258 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-a6fb1baf-5fee-4e7f-8f13-d4a4cd5687bc tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "GET /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455" status: 200 len: 1675 microversion: 2.1 time: 0.229702 Nov 23 13:43:52.493838 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1075/2144] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:43:52 2021] GET /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455 => generated 1675 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:43:53.511264 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-8d51d411-7712-4d40-9b82-ee6b28b158a9 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:43:53.511860 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-8d51d411-7712-4d40-9b82-ee6b28b158a9 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:43:53.520276 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8d51d411-7712-4d40-9b82-ee6b28b158a9 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:43:53.520745 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8d51d411-7712-4d40-9b82-ee6b28b158a9 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:43:53.521540 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8d51d411-7712-4d40-9b82-ee6b28b158a9 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:43:53.521963 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8d51d411-7712-4d40-9b82-ee6b28b158a9 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:43:53.744698 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-8d51d411-7712-4d40-9b82-ee6b28b158a9 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5e06990f874a099eb9f92dde95e85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c610ba775aca44aa85aaf415f96bb37e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:43:53.757030 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-8d51d411-7712-4d40-9b82-ee6b28b158a9 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "GET /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455" status: 200 len: 1652 microversion: 2.1 time: 0.248986 Nov 23 13:43:53.758105 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1070/2145] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:43:53 2021] GET /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455 => generated 1652 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:43:53.778147 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-c973727d-103c-4dee-b978-c219d1b79418 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:43:53.788217 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c973727d-103c-4dee-b978-c219d1b79418 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:43:53.788706 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c973727d-103c-4dee-b978-c219d1b79418 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:43:53.844847 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-c973727d-103c-4dee-b978-c219d1b79418 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Going to try to start instance {{(pid=100974) start /opt/stack/nova/nova/compute/api.py:2625}} Nov 23 13:43:53.928629 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-c973727d-103c-4dee-b978-c219d1b79418 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action" status: 202 len: 0 microversion: 2.1 time: 0.157334 Nov 23 13:43:53.929234 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1076/2146] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:43:53 2021] POST /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/action => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:43:53.940265 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-161bb897-5c53-45a4-a895-dd455e47f2cd tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:43:53.941287 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-161bb897-5c53-45a4-a895-dd455e47f2cd tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:43:53.949601 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-161bb897-5c53-45a4-a895-dd455e47f2cd tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:43:53.950139 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-161bb897-5c53-45a4-a895-dd455e47f2cd tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:43:53.951013 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-161bb897-5c53-45a4-a895-dd455e47f2cd tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:43:53.951470 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-161bb897-5c53-45a4-a895-dd455e47f2cd tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:43:54.281796 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-161bb897-5c53-45a4-a895-dd455e47f2cd tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5e06990f874a099eb9f92dde95e85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c610ba775aca44aa85aaf415f96bb37e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:43:54.290898 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-161bb897-5c53-45a4-a895-dd455e47f2cd tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "GET /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455" status: 200 len: 1661 microversion: 2.1 time: 0.356519 Nov 23 13:43:54.291579 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1071/2147] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:43:53 2021] GET /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455 => generated 1661 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 13:43:55.312750 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-aa09b95d-bfb9-4ae7-9d47-557997451eae tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:43:55.313462 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-aa09b95d-bfb9-4ae7-9d47-557997451eae tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:43:55.322386 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-aa09b95d-bfb9-4ae7-9d47-557997451eae tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:43:55.322863 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-aa09b95d-bfb9-4ae7-9d47-557997451eae tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:43:55.323647 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-aa09b95d-bfb9-4ae7-9d47-557997451eae tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:43:55.324055 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-aa09b95d-bfb9-4ae7-9d47-557997451eae tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:43:55.533890 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-aa09b95d-bfb9-4ae7-9d47-557997451eae tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5e06990f874a099eb9f92dde95e85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c610ba775aca44aa85aaf415f96bb37e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:43:55.542753 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-aa09b95d-bfb9-4ae7-9d47-557997451eae tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "GET /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455" status: 200 len: 1661 microversion: 2.1 time: 0.236809 Nov 23 13:43:55.543334 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1077/2148] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:43:55 2021] GET /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455 => generated 1661 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:43:56.560520 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-78889068-2da9-4cba-be34-617040a196d1 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:43:56.561099 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-78889068-2da9-4cba-be34-617040a196d1 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:43:56.569119 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-78889068-2da9-4cba-be34-617040a196d1 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:43:56.569562 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-78889068-2da9-4cba-be34-617040a196d1 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:43:56.570323 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-78889068-2da9-4cba-be34-617040a196d1 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:43:56.570749 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-78889068-2da9-4cba-be34-617040a196d1 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:43:56.773447 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-78889068-2da9-4cba-be34-617040a196d1 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5e06990f874a099eb9f92dde95e85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c610ba775aca44aa85aaf415f96bb37e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:43:56.782266 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-78889068-2da9-4cba-be34-617040a196d1 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "GET /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455" status: 200 len: 1665 microversion: 2.1 time: 0.225471 Nov 23 13:43:56.782830 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1072/2149] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:43:56 2021] GET /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455 => generated 1665 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:45:00.227985 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a7b7a666-a1ad-48b3-bbff-ac4178364592] AMQP server on 10.222.0.60:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 23 13:45:00.231414 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-fc25900b-c08c-4a8d-91fe-5b7473ccd9e8 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:45:00.232424 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-fc25900b-c08c-4a8d-91fe-5b7473ccd9e8 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:45:00.240175 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-fc25900b-c08c-4a8d-91fe-5b7473ccd9e8 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:45:00.240660 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-fc25900b-c08c-4a8d-91fe-5b7473ccd9e8 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:45:00.241445 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-fc25900b-c08c-4a8d-91fe-5b7473ccd9e8 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:45:00.241878 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-fc25900b-c08c-4a8d-91fe-5b7473ccd9e8 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:45:00.305765 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-fc25900b-c08c-4a8d-91fe-5b7473ccd9e8 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "GET /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.079120 Nov 23 13:45:00.306339 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1078/2150] 10.222.0.60 () {58 vars in 1301 bytes} [Tue Nov 23 13:45:00 2021] GET /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455/os-volume_attachments => generated 25 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 13:45:00.404630 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-ad5af977-586b-4b9b-8343-c7b615b42ba1 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:45:00.405162 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-ad5af977-586b-4b9b-8343-c7b615b42ba1 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:45:00.408767 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8c3a1481-9693-4499-8478-a55e09a5b02f] AMQP server on 10.222.0.60:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 23 13:45:00.413879 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ad5af977-586b-4b9b-8343-c7b615b42ba1 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:45:00.414332 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ad5af977-586b-4b9b-8343-c7b615b42ba1 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:45:00.415105 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ad5af977-586b-4b9b-8343-c7b615b42ba1 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:45:00.415535 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ad5af977-586b-4b9b-8343-c7b615b42ba1 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:45:00.478903 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-ad5af977-586b-4b9b-8343-c7b615b42ba1 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Going to try to terminate instance {{(pid=100973) delete /opt/stack/nova/nova/compute/api.py:2562}} Nov 23 13:45:00.611403 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-ad5af977-586b-4b9b-8343-c7b615b42ba1 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "DELETE /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455" status: 204 len: 0 microversion: 2.1 time: 0.210353 Nov 23 13:45:00.611985 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1073/2151] 10.222.0.60 () {58 vars in 1238 bytes} [Tue Nov 23 13:45:00 2021] DELETE /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 23 13:45:00.621602 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-c174a726-7dcf-4205-a476-c3786d07b1b8 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:45:00.622364 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-c174a726-7dcf-4205-a476-c3786d07b1b8 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:45:00.629911 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c174a726-7dcf-4205-a476-c3786d07b1b8 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:45:00.630358 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c174a726-7dcf-4205-a476-c3786d07b1b8 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:45:00.631127 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c174a726-7dcf-4205-a476-c3786d07b1b8 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:45:00.631547 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c174a726-7dcf-4205-a476-c3786d07b1b8 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:45:00.836582 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-c174a726-7dcf-4205-a476-c3786d07b1b8 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5e06990f874a099eb9f92dde95e85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c610ba775aca44aa85aaf415f96bb37e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:45:00.845184 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-c174a726-7dcf-4205-a476-c3786d07b1b8 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "GET /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455" status: 200 len: 1671 microversion: 2.1 time: 0.227898 Nov 23 13:45:00.845733 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1079/2152] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:45:00 2021] GET /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455 => generated 1671 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:45:01.864856 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-c02ea53b-81f0-4d52-83d5-93359e17446c tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:45:01.865939 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-c02ea53b-81f0-4d52-83d5-93359e17446c tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:45:01.887928 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c02ea53b-81f0-4d52-83d5-93359e17446c tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:45:01.888400 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c02ea53b-81f0-4d52-83d5-93359e17446c tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:45:01.889154 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c02ea53b-81f0-4d52-83d5-93359e17446c tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:45:01.889575 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c02ea53b-81f0-4d52-83d5-93359e17446c tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:45:01.922178 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO oslo.messaging._drivers.impl_rabbit [-] [8c3a1481-9693-4499-8478-a55e09a5b02f] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 57216. Nov 23 13:45:02.106400 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-c02ea53b-81f0-4d52-83d5-93359e17446c tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5e06990f874a099eb9f92dde95e85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c610ba775aca44aa85aaf415f96bb37e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:45:02.117222 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-c02ea53b-81f0-4d52-83d5-93359e17446c tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "GET /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455" status: 200 len: 1671 microversion: 2.1 time: 0.257440 Nov 23 13:45:02.117728 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1074/2153] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:45:01 2021] GET /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455 => generated 1671 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:45:03.138231 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-bdc04b6a-67dd-4ee4-b877-0b192a665a07 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:45:03.138865 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-bdc04b6a-67dd-4ee4-b877-0b192a665a07 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:45:03.157026 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-bdc04b6a-67dd-4ee4-b877-0b192a665a07 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:45:03.157478 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-bdc04b6a-67dd-4ee4-b877-0b192a665a07 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:45:03.158403 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-bdc04b6a-67dd-4ee4-b877-0b192a665a07 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:45:03.158854 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-bdc04b6a-67dd-4ee4-b877-0b192a665a07 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:45:03.216229 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO oslo.messaging._drivers.impl_rabbit [-] [a7b7a666-a1ad-48b3-bbff-ac4178364592] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 57220. Nov 23 13:45:03.556327 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-bdc04b6a-67dd-4ee4-b877-0b192a665a07 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5e06990f874a099eb9f92dde95e85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c610ba775aca44aa85aaf415f96bb37e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:45:03.565004 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-bdc04b6a-67dd-4ee4-b877-0b192a665a07 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "GET /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455" status: 200 len: 1671 microversion: 2.1 time: 0.430428 Nov 23 13:45:03.565599 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1080/2154] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:45:03 2021] GET /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455 => generated 1671 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:45:04.583011 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-00804a81-5cd1-4389-8bab-c776be3371b7 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:45:04.583597 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-00804a81-5cd1-4389-8bab-c776be3371b7 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:45:04.591484 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-00804a81-5cd1-4389-8bab-c776be3371b7 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:45:04.591914 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-00804a81-5cd1-4389-8bab-c776be3371b7 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:45:04.592709 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-00804a81-5cd1-4389-8bab-c776be3371b7 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:45:04.593134 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-00804a81-5cd1-4389-8bab-c776be3371b7 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:45:04.674325 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [req-63b8cbc3-c5b5-43a4-8095-b6fb32d126aa req-1f8f6085-ed2b-4f89-854b-de89c196f82b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "932d4c6a-60ed-44a3-b9af-627f70d7f455", "name": "network-vif-deleted", "tag": "15ea991a-b6b7-4ecc-ba66-da81571f3429"}]} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:45:04.682461 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 13:45:04.682461 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: warnings.warn(msg) Nov 23 13:45:04.694848 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [req-63b8cbc3-c5b5-43a4-8095-b6fb32d126aa req-1f8f6085-ed2b-4f89-854b-de89c196f82b service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:45:04.704765 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [req-63b8cbc3-c5b5-43a4-8095-b6fb32d126aa req-1f8f6085-ed2b-4f89-854b-de89c196f82b service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:45:04.734089 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.compute.server_external_events [req-63b8cbc3-c5b5-43a4-8095-b6fb32d126aa req-1f8f6085-ed2b-4f89-854b-de89c196f82b service nova] Creating event network-vif-deleted:15ea991a-b6b7-4ecc-ba66-da81571f3429 for instance 932d4c6a-60ed-44a3-b9af-627f70d7f455 on hv-cinder-81888 Nov 23 13:45:04.747064 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [req-63b8cbc3-c5b5-43a4-8095-b6fb32d126aa req-1f8f6085-ed2b-4f89-854b-de89c196f82b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085346 Nov 23 13:45:04.747180 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-00804a81-5cd1-4389-8bab-c776be3371b7 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5e06990f874a099eb9f92dde95e85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c610ba775aca44aa85aaf415f96bb37e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:45:04.748391 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1081/2155] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Nov 23 13:45:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 13:45:04.756601 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-00804a81-5cd1-4389-8bab-c776be3371b7 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "GET /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455" status: 200 len: 1604 microversion: 2.1 time: 0.177570 Nov 23 13:45:04.765031 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1075/2156] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:45:04 2021] GET /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455 => generated 1604 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:45:05.775548 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-e7bafaa6-bae7-4adc-9b38-effb10046cdf tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:45:05.776278 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-e7bafaa6-bae7-4adc-9b38-effb10046cdf tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:45:05.784666 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e7bafaa6-bae7-4adc-9b38-effb10046cdf tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:45:05.785123 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e7bafaa6-bae7-4adc-9b38-effb10046cdf tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:45:05.785910 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e7bafaa6-bae7-4adc-9b38-effb10046cdf tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:45:05.786355 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e7bafaa6-bae7-4adc-9b38-effb10046cdf tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:45:05.849907 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.wsgi [None req-e7bafaa6-bae7-4adc-9b38-effb10046cdf tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] HTTP exception thrown: Instance 932d4c6a-60ed-44a3-b9af-627f70d7f455 could not be found. Nov 23 13:45:05.850507 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-e7bafaa6-bae7-4adc-9b38-effb10046cdf tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Returning 404 to user: Instance 932d4c6a-60ed-44a3-b9af-627f70d7f455 could not be found. {{(pid=100974) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Nov 23 13:45:05.851355 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-e7bafaa6-bae7-4adc-9b38-effb10046cdf tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "GET /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455" status: 404 len: 111 microversion: 2.1 time: 0.080077 Nov 23 13:45:05.851910 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1082/2157] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:45:05 2021] GET /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 13:45:05.860455 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-06e5225a-50ac-4d8c-813a-6c6bd145a194 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Calling method '.version_select at 0x7f18704bd160>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:45:05.885405 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-06e5225a-50ac-4d8c-813a-6c6bd145a194 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-356432591" status: 202 len: 0 microversion: 2.1 time: 0.028656 Nov 23 13:45:05.886523 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1076/2158] 10.222.0.60 () {58 vars in 1217 bytes} [Tue Nov 23 13:45:05 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-356432591 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:45:07.092220 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-839c4428-43c4-440e-a0f8-ec789b3af76b tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'create', calling method: .version_select at 0x7f1870eb8670>, body: {"keypair": {"name": "tempest-keypair-597685985"}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:45:07.120025 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.quota [None req-839c4428-43c4-440e-a0f8-ec789b3af76b tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Getting quotas for project c610ba775aca44aa85aaf415f96bb37e. Resources: {'key_pairs'} {{(pid=100974) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 13:45:07.124795 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.quota [None req-839c4428-43c4-440e-a0f8-ec789b3af76b tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Getting quotas for user 5e5e06990f874a099eb9f92dde95e85d and project c610ba775aca44aa85aaf415f96bb37e. Resources: {'key_pairs'} {{(pid=100974) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 13:45:07.491169 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.quota [None req-839c4428-43c4-440e-a0f8-ec789b3af76b tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Getting quotas for project c610ba775aca44aa85aaf415f96bb37e. Resources: {'key_pairs'} {{(pid=100974) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 13:45:07.495713 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.quota [None req-839c4428-43c4-440e-a0f8-ec789b3af76b tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Getting quotas for user 5e5e06990f874a099eb9f92dde95e85d and project c610ba775aca44aa85aaf415f96bb37e. Resources: {'key_pairs'} {{(pid=100974) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 13:45:07.509965 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-839c4428-43c4-440e-a0f8-ec789b3af76b tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.422289 Nov 23 13:45:07.510572 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1083/2159] 10.222.0.60 () {60 vars in 1157 bytes} [Tue Nov 23 13:45:07 2021] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:45:09.315371 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-4fe7848c-9303-49c5-a9eb-3b09d421dfa4 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2038984480", "imageRef": "d01e1b62-4f14-4f64-9d63-d155732e33e8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6ce3e0b3-e6c6-467a-9ba7-e43df6950165"}], "security_groups": [{"name": "tempest-securitygroup--1398855810"}], "key_name": "tempest-keypair-597685985", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:45:09.456108 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.network.neutron [None req-4fe7848c-9303-49c5-a9eb-3b09d421dfa4 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] validate_networks() for [('6ce3e0b3-e6c6-467a-9ba7-e43df6950165', None, None, None)] {{(pid=100973) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Nov 23 13:45:10.098305 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.virt.hardware [None req-4fe7848c-9303-49c5-a9eb-3b09d421dfa4 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Flavor limits 0:0:0 {{(pid=100973) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 23 13:45:10.098740 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.virt.hardware [None req-4fe7848c-9303-49c5-a9eb-3b09d421dfa4 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Image limits 0:0:0 {{(pid=100973) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 23 13:45:10.099209 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.virt.hardware [None req-4fe7848c-9303-49c5-a9eb-3b09d421dfa4 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Flavor pref 0:0:0 {{(pid=100973) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 23 13:45:10.099610 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.virt.hardware [None req-4fe7848c-9303-49c5-a9eb-3b09d421dfa4 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Image pref 0:0:0 {{(pid=100973) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 23 13:45:10.100016 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.virt.hardware [None req-4fe7848c-9303-49c5-a9eb-3b09d421dfa4 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100973) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 23 13:45:10.109438 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4fe7848c-9303-49c5-a9eb-3b09d421dfa4 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:45:10.109875 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4fe7848c-9303-49c5-a9eb-3b09d421dfa4 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:45:10.110655 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4fe7848c-9303-49c5-a9eb-3b09d421dfa4 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:45:10.111102 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4fe7848c-9303-49c5-a9eb-3b09d421dfa4 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:45:10.132350 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.quota [None req-4fe7848c-9303-49c5-a9eb-3b09d421dfa4 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Getting quotas for project c610ba775aca44aa85aaf415f96bb37e. Resources: {'ram', 'cores', 'instances'} {{(pid=100973) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 13:45:10.136795 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.quota [None req-4fe7848c-9303-49c5-a9eb-3b09d421dfa4 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Getting quotas for user 5e5e06990f874a099eb9f92dde95e85d and project c610ba775aca44aa85aaf415f96bb37e. Resources: {'ram', 'cores', 'instances'} {{(pid=100973) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 13:45:10.148784 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-4fe7848c-9303-49c5-a9eb-3b09d421dfa4 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Going to run 1 instances... {{(pid=100973) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Nov 23 13:45:10.151092 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-4fe7848c-9303-49c5-a9eb-3b09d421dfa4 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: efc6fa5e-050a-42ad-b79d-29fad30bb4a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d01e1b62-4f14-4f64-9d63-d155732e33e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100973) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Nov 23 13:45:10.198750 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-4fe7848c-9303-49c5-a9eb-3b09d421dfa4 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.887864 Nov 23 13:45:10.199432 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1077/2160] 10.222.0.60 () {60 vars in 1146 bytes} [Tue Nov 23 13:45:09 2021] POST /compute/v2.1/servers => generated 402 bytes in 889 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 23 13:45:10.210001 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-f33ea69e-0042-49c0-b9e0-72cfe751f24c tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:45:10.210587 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-f33ea69e-0042-49c0-b9e0-72cfe751f24c tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: efc6fa5e-050a-42ad-b79d-29fad30bb4a5] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:45:10.299930 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-f33ea69e-0042-49c0-b9e0-72cfe751f24c tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5e06990f874a099eb9f92dde95e85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c610ba775aca44aa85aaf415f96bb37e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:45:10.308376 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-f33ea69e-0042-49c0-b9e0-72cfe751f24c tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "GET /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5" status: 200 len: 1237 microversion: 2.1 time: 0.102473 Nov 23 13:45:10.309032 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1084/2161] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:45:10 2021] GET /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5 => generated 1237 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:45:11.325913 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-97c522ec-fe71-4b72-b734-e3c204898189 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:45:11.326797 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-97c522ec-fe71-4b72-b734-e3c204898189 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: efc6fa5e-050a-42ad-b79d-29fad30bb4a5] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:45:11.335713 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-97c522ec-fe71-4b72-b734-e3c204898189 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:45:11.336163 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-97c522ec-fe71-4b72-b734-e3c204898189 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:45:11.337406 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-97c522ec-fe71-4b72-b734-e3c204898189 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:45:11.337879 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-97c522ec-fe71-4b72-b734-e3c204898189 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:45:11.485435 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-97c522ec-fe71-4b72-b734-e3c204898189 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5e06990f874a099eb9f92dde95e85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c610ba775aca44aa85aaf415f96bb37e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:45:11.495782 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-97c522ec-fe71-4b72-b734-e3c204898189 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "GET /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5" status: 200 len: 1307 microversion: 2.1 time: 0.173951 Nov 23 13:45:11.496391 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1078/2162] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:45:11 2021] GET /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5 => generated 1307 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:45:12.513902 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-9dc59184-7b98-41f8-af48-b1db362a9c9a tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:45:12.514506 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-9dc59184-7b98-41f8-af48-b1db362a9c9a tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: efc6fa5e-050a-42ad-b79d-29fad30bb4a5] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:45:12.522089 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-9dc59184-7b98-41f8-af48-b1db362a9c9a tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:45:12.522518 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-9dc59184-7b98-41f8-af48-b1db362a9c9a tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:45:12.523333 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-9dc59184-7b98-41f8-af48-b1db362a9c9a tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:45:12.523859 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-9dc59184-7b98-41f8-af48-b1db362a9c9a tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:45:13.074788 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-9dc59184-7b98-41f8-af48-b1db362a9c9a tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5e06990f874a099eb9f92dde95e85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c610ba775aca44aa85aaf415f96bb37e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:45:13.084769 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-9dc59184-7b98-41f8-af48-b1db362a9c9a tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "GET /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5" status: 200 len: 1363 microversion: 2.1 time: 0.574265 Nov 23 13:45:13.085385 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1085/2163] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:45:12 2021] GET /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5 => generated 1363 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:45:13.478832 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [req-dd15e01c-bd0a-44b6-8c42-31d8b80ec742 req-6b534cb1-0701-4925-8198-8e6f8a0511b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efc6fa5e-050a-42ad-b79d-29fad30bb4a5", "tag": "826971fe-33b4-4eee-b07e-22c99da90d19"}]} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:45:13.481129 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 13:45:13.481129 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: warnings.warn(msg) Nov 23 13:45:13.493574 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [req-dd15e01c-bd0a-44b6-8c42-31d8b80ec742 req-6b534cb1-0701-4925-8198-8e6f8a0511b5 service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:45:13.494311 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [req-dd15e01c-bd0a-44b6-8c42-31d8b80ec742 req-6b534cb1-0701-4925-8198-8e6f8a0511b5 service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:45:13.512714 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.compute.server_external_events [req-dd15e01c-bd0a-44b6-8c42-31d8b80ec742 req-6b534cb1-0701-4925-8198-8e6f8a0511b5 service nova] Creating event network-changed:826971fe-33b4-4eee-b07e-22c99da90d19 for instance efc6fa5e-050a-42ad-b79d-29fad30bb4a5 on hv-cinder-81888 Nov 23 13:45:13.518255 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [req-dd15e01c-bd0a-44b6-8c42-31d8b80ec742 req-6b534cb1-0701-4925-8198-8e6f8a0511b5 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043515 Nov 23 13:45:13.519208 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1079/2164] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Nov 23 13:45:13 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 13:45:14.104093 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-3c80a2e6-75c4-4966-8846-2813b6aa0359 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:45:14.104704 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-3c80a2e6-75c4-4966-8846-2813b6aa0359 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: efc6fa5e-050a-42ad-b79d-29fad30bb4a5] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:45:14.112823 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3c80a2e6-75c4-4966-8846-2813b6aa0359 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:45:14.113271 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3c80a2e6-75c4-4966-8846-2813b6aa0359 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:45:14.114258 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3c80a2e6-75c4-4966-8846-2813b6aa0359 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:45:14.114690 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3c80a2e6-75c4-4966-8846-2813b6aa0359 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:45:14.403757 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-3c80a2e6-75c4-4966-8846-2813b6aa0359 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5e06990f874a099eb9f92dde95e85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c610ba775aca44aa85aaf415f96bb37e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:45:14.412891 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-3c80a2e6-75c4-4966-8846-2813b6aa0359 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "GET /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5" status: 200 len: 1363 microversion: 2.1 time: 0.313053 Nov 23 13:45:14.413478 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1086/2165] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:45:14 2021] GET /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5 => generated 1363 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:45:15.430594 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-3ecc0cd2-d0dc-4d41-8885-bbf6a6659abf tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:45:15.431586 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-3ecc0cd2-d0dc-4d41-8885-bbf6a6659abf tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: efc6fa5e-050a-42ad-b79d-29fad30bb4a5] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:45:15.445679 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-3ecc0cd2-d0dc-4d41-8885-bbf6a6659abf tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:45:15.446122 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-3ecc0cd2-d0dc-4d41-8885-bbf6a6659abf tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:45:15.446886 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-3ecc0cd2-d0dc-4d41-8885-bbf6a6659abf tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:45:15.447308 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-3ecc0cd2-d0dc-4d41-8885-bbf6a6659abf tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:45:15.657472 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-3ecc0cd2-d0dc-4d41-8885-bbf6a6659abf tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5e06990f874a099eb9f92dde95e85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c610ba775aca44aa85aaf415f96bb37e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:45:15.673719 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-3ecc0cd2-d0dc-4d41-8885-bbf6a6659abf tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "GET /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5" status: 200 len: 1363 microversion: 2.1 time: 0.247325 Nov 23 13:45:15.674683 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1080/2166] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:45:15 2021] GET /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5 => generated 1363 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:45:16.691603 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-f69bdbfc-9bc5-42ca-8832-b6d5348c81fa tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:45:16.692125 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-f69bdbfc-9bc5-42ca-8832-b6d5348c81fa tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: efc6fa5e-050a-42ad-b79d-29fad30bb4a5] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:45:16.701690 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f69bdbfc-9bc5-42ca-8832-b6d5348c81fa tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:45:16.702347 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f69bdbfc-9bc5-42ca-8832-b6d5348c81fa tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:45:16.703428 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f69bdbfc-9bc5-42ca-8832-b6d5348c81fa tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:45:16.703864 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f69bdbfc-9bc5-42ca-8832-b6d5348c81fa tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:45:16.911059 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-f69bdbfc-9bc5-42ca-8832-b6d5348c81fa tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5e06990f874a099eb9f92dde95e85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c610ba775aca44aa85aaf415f96bb37e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:45:16.919649 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-f69bdbfc-9bc5-42ca-8832-b6d5348c81fa tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "GET /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5" status: 200 len: 1363 microversion: 2.1 time: 0.232243 Nov 23 13:45:16.920199 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1087/2167] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:45:16 2021] GET /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5 => generated 1363 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:45:17.937272 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-3ce7b6b1-56a4-4ea2-ae89-efeaa9e1546c tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:45:17.937839 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-3ce7b6b1-56a4-4ea2-ae89-efeaa9e1546c tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: efc6fa5e-050a-42ad-b79d-29fad30bb4a5] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:45:17.946066 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-3ce7b6b1-56a4-4ea2-ae89-efeaa9e1546c tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:45:17.946505 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-3ce7b6b1-56a4-4ea2-ae89-efeaa9e1546c tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:45:17.947270 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-3ce7b6b1-56a4-4ea2-ae89-efeaa9e1546c tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:45:17.947699 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-3ce7b6b1-56a4-4ea2-ae89-efeaa9e1546c tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:45:18.166530 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-3ce7b6b1-56a4-4ea2-ae89-efeaa9e1546c tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5e06990f874a099eb9f92dde95e85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c610ba775aca44aa85aaf415f96bb37e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:45:18.179502 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-3ce7b6b1-56a4-4ea2-ae89-efeaa9e1546c tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "GET /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5" status: 200 len: 1363 microversion: 2.1 time: 0.245656 Nov 23 13:45:18.180368 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1081/2168] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:45:17 2021] GET /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5 => generated 1363 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:45:19.199193 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-e002317f-cdbf-4845-b4cb-c36d97e664d2 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:45:19.200286 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-e002317f-cdbf-4845-b4cb-c36d97e664d2 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: efc6fa5e-050a-42ad-b79d-29fad30bb4a5] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:45:19.213594 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e002317f-cdbf-4845-b4cb-c36d97e664d2 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:45:19.214336 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e002317f-cdbf-4845-b4cb-c36d97e664d2 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:45:19.215598 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e002317f-cdbf-4845-b4cb-c36d97e664d2 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:45:19.216305 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e002317f-cdbf-4845-b4cb-c36d97e664d2 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:45:19.423326 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-e002317f-cdbf-4845-b4cb-c36d97e664d2 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5e06990f874a099eb9f92dde95e85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c610ba775aca44aa85aaf415f96bb37e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:45:19.432194 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-e002317f-cdbf-4845-b4cb-c36d97e664d2 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "GET /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5" status: 200 len: 1363 microversion: 2.1 time: 0.238478 Nov 23 13:45:19.432790 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1088/2169] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:45:19 2021] GET /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5 => generated 1363 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:45:19.462508 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [req-4c4fc9f8-bf56-4b50-8141-505fafba6be5 req-a40f3370-d18d-47f4-bd91-726eceb2a289 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efc6fa5e-050a-42ad-b79d-29fad30bb4a5", "name": "network-vif-plugged", "status": "completed", "tag": "826971fe-33b4-4eee-b07e-22c99da90d19"}]} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:45:19.464123 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 13:45:19.464123 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: warnings.warn(msg) Nov 23 13:45:19.472776 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [req-4c4fc9f8-bf56-4b50-8141-505fafba6be5 req-a40f3370-d18d-47f4-bd91-726eceb2a289 service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:45:19.473207 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [req-4c4fc9f8-bf56-4b50-8141-505fafba6be5 req-a40f3370-d18d-47f4-bd91-726eceb2a289 service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:45:19.489460 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.compute.server_external_events [req-4c4fc9f8-bf56-4b50-8141-505fafba6be5 req-a40f3370-d18d-47f4-bd91-726eceb2a289 service nova] Creating event network-vif-plugged:826971fe-33b4-4eee-b07e-22c99da90d19 for instance efc6fa5e-050a-42ad-b79d-29fad30bb4a5 on hv-cinder-81888 Nov 23 13:45:19.494447 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [req-4c4fc9f8-bf56-4b50-8141-505fafba6be5 req-a40f3370-d18d-47f4-bd91-726eceb2a289 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036190 Nov 23 13:45:19.495154 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1082/2170] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Nov 23 13:45:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 13:45:20.449711 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-3fb4d7e2-e77b-4510-98ae-8cb7f4842eeb tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:45:20.450280 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-3fb4d7e2-e77b-4510-98ae-8cb7f4842eeb tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: efc6fa5e-050a-42ad-b79d-29fad30bb4a5] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:45:20.458036 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3fb4d7e2-e77b-4510-98ae-8cb7f4842eeb tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:45:20.458475 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3fb4d7e2-e77b-4510-98ae-8cb7f4842eeb tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:45:20.459564 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3fb4d7e2-e77b-4510-98ae-8cb7f4842eeb tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:45:20.459975 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3fb4d7e2-e77b-4510-98ae-8cb7f4842eeb tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:45:20.656265 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-3fb4d7e2-e77b-4510-98ae-8cb7f4842eeb tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5e06990f874a099eb9f92dde95e85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c610ba775aca44aa85aaf415f96bb37e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:45:20.665012 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-3fb4d7e2-e77b-4510-98ae-8cb7f4842eeb tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "GET /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5" status: 200 len: 1363 microversion: 2.1 time: 0.219035 Nov 23 13:45:20.665578 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1089/2171] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:45:20 2021] GET /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5 => generated 1363 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:45:21.684468 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-9748ff46-f8b7-4aee-b84a-94b874dfdbcb tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:45:21.685174 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-9748ff46-f8b7-4aee-b84a-94b874dfdbcb tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: efc6fa5e-050a-42ad-b79d-29fad30bb4a5] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:45:21.695174 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-9748ff46-f8b7-4aee-b84a-94b874dfdbcb tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:45:21.695614 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-9748ff46-f8b7-4aee-b84a-94b874dfdbcb tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:45:21.696485 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-9748ff46-f8b7-4aee-b84a-94b874dfdbcb tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:45:21.696912 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-9748ff46-f8b7-4aee-b84a-94b874dfdbcb tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:45:21.900141 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-9748ff46-f8b7-4aee-b84a-94b874dfdbcb tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5e06990f874a099eb9f92dde95e85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c610ba775aca44aa85aaf415f96bb37e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:45:21.908942 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-9748ff46-f8b7-4aee-b84a-94b874dfdbcb tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "GET /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5" status: 200 len: 1549 microversion: 2.1 time: 0.230060 Nov 23 13:45:21.910441 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1083/2172] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:45:21 2021] GET /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5 => generated 1549 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:45:21.927735 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-4d4e10b2-6630-4735-8b46-c7e9acbacb20 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:45:21.928311 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-4d4e10b2-6630-4735-8b46-c7e9acbacb20 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: efc6fa5e-050a-42ad-b79d-29fad30bb4a5] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:45:21.937026 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-4d4e10b2-6630-4735-8b46-c7e9acbacb20 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:45:21.937667 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-4d4e10b2-6630-4735-8b46-c7e9acbacb20 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:45:21.938590 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-4d4e10b2-6630-4735-8b46-c7e9acbacb20 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:45:21.939112 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-4d4e10b2-6630-4735-8b46-c7e9acbacb20 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:45:22.095113 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-4d4e10b2-6630-4735-8b46-c7e9acbacb20 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "GET /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.172270 Nov 23 13:45:22.095799 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1090/2173] 10.222.0.60 () {58 vars in 1274 bytes} [Tue Nov 23 13:45:21 2021] GET /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/os-interface => generated 284 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 13:45:23.854277 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [req-f6429db8-7496-4706-af18-3efbf6e884d7 req-dd3aa476-8795-478f-86d4-d4bf0455ff88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efc6fa5e-050a-42ad-b79d-29fad30bb4a5", "tag": "826971fe-33b4-4eee-b07e-22c99da90d19"}]} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:45:23.855851 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-ea734384-42c9-4f45-8b79-3d1865bdf435 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:45:23.856811 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-ea734384-42c9-4f45-8b79-3d1865bdf435 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: efc6fa5e-050a-42ad-b79d-29fad30bb4a5] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:45:23.857513 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 13:45:23.857513 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: warnings.warn(msg) Nov 23 13:45:23.865307 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ea734384-42c9-4f45-8b79-3d1865bdf435 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:45:23.865775 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ea734384-42c9-4f45-8b79-3d1865bdf435 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:45:23.866565 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ea734384-42c9-4f45-8b79-3d1865bdf435 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:45:23.866996 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ea734384-42c9-4f45-8b79-3d1865bdf435 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:45:23.867102 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [req-f6429db8-7496-4706-af18-3efbf6e884d7 req-dd3aa476-8795-478f-86d4-d4bf0455ff88 service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:45:23.867455 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [req-f6429db8-7496-4706-af18-3efbf6e884d7 req-dd3aa476-8795-478f-86d4-d4bf0455ff88 service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:45:23.883434 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.compute.server_external_events [req-f6429db8-7496-4706-af18-3efbf6e884d7 req-dd3aa476-8795-478f-86d4-d4bf0455ff88 service nova] Creating event network-changed:826971fe-33b4-4eee-b07e-22c99da90d19 for instance efc6fa5e-050a-42ad-b79d-29fad30bb4a5 on hv-cinder-81888 Nov 23 13:45:23.888599 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [req-f6429db8-7496-4706-af18-3efbf6e884d7 req-dd3aa476-8795-478f-86d4-d4bf0455ff88 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037940 Nov 23 13:45:23.889576 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1091/2174] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Nov 23 13:45:23 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 13:45:23.984641 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-ea734384-42c9-4f45-8b79-3d1865bdf435 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action" status: 200 len: 14 microversion: 2.1 time: 0.135947 Nov 23 13:45:23.988270 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1084/2175] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:45:23 2021] POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action => generated 14 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 13:45:24.995863 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-14317fad-dd36-4a5f-9c09-d347cc828a05 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:45:24.996937 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-14317fad-dd36-4a5f-9c09-d347cc828a05 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: efc6fa5e-050a-42ad-b79d-29fad30bb4a5] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:45:25.005123 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-14317fad-dd36-4a5f-9c09-d347cc828a05 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:45:25.005569 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-14317fad-dd36-4a5f-9c09-d347cc828a05 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:45:25.006344 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-14317fad-dd36-4a5f-9c09-d347cc828a05 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:45:25.006773 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-14317fad-dd36-4a5f-9c09-d347cc828a05 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:45:25.125116 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-14317fad-dd36-4a5f-9c09-d347cc828a05 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action" status: 200 len: 14 microversion: 2.1 time: 0.133307 Nov 23 13:45:25.128273 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1092/2176] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:45:24 2021] POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action => generated 14 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 13:45:26.140751 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-0f07dd79-574b-428e-bded-d34fe894e891 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:45:26.141661 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-0f07dd79-574b-428e-bded-d34fe894e891 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: efc6fa5e-050a-42ad-b79d-29fad30bb4a5] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:45:26.153043 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0f07dd79-574b-428e-bded-d34fe894e891 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:45:26.153482 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0f07dd79-574b-428e-bded-d34fe894e891 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:45:26.154245 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0f07dd79-574b-428e-bded-d34fe894e891 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:45:26.154666 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0f07dd79-574b-428e-bded-d34fe894e891 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:45:26.270630 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-0f07dd79-574b-428e-bded-d34fe894e891 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action" status: 200 len: 14 microversion: 2.1 time: 0.136472 Nov 23 13:45:26.271469 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1085/2177] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:45:26 2021] POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action => generated 14 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 13:45:27.282975 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-40d5a36e-5f4c-4399-bded-4440ba94e099 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:45:27.284044 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-40d5a36e-5f4c-4399-bded-4440ba94e099 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: efc6fa5e-050a-42ad-b79d-29fad30bb4a5] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:45:27.293489 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-40d5a36e-5f4c-4399-bded-4440ba94e099 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:45:27.293925 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-40d5a36e-5f4c-4399-bded-4440ba94e099 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:45:27.294678 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-40d5a36e-5f4c-4399-bded-4440ba94e099 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:45:27.295099 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-40d5a36e-5f4c-4399-bded-4440ba94e099 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:45:27.416851 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-40d5a36e-5f4c-4399-bded-4440ba94e099 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action" status: 200 len: 14 microversion: 2.1 time: 0.138036 Nov 23 13:45:27.417466 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1093/2178] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:45:27 2021] POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action => generated 14 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 13:45:28.485223 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-af49938d-b856-4258-8209-354b35d1a307 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:45:28.486280 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-af49938d-b856-4258-8209-354b35d1a307 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: efc6fa5e-050a-42ad-b79d-29fad30bb4a5] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:45:28.494271 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-af49938d-b856-4258-8209-354b35d1a307 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:45:28.494706 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-af49938d-b856-4258-8209-354b35d1a307 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:45:28.495459 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-af49938d-b856-4258-8209-354b35d1a307 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:45:28.495881 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-af49938d-b856-4258-8209-354b35d1a307 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:45:28.609240 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-af49938d-b856-4258-8209-354b35d1a307 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action" status: 200 len: 14 microversion: 2.1 time: 0.183002 Nov 23 13:45:28.609800 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1086/2179] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:45:28 2021] POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action => generated 14 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 13:45:29.622007 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-5d387888-54af-46d6-b091-c53c8e97fb2a tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:45:29.623028 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-5d387888-54af-46d6-b091-c53c8e97fb2a tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: efc6fa5e-050a-42ad-b79d-29fad30bb4a5] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:45:29.631186 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5d387888-54af-46d6-b091-c53c8e97fb2a tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:45:29.631632 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5d387888-54af-46d6-b091-c53c8e97fb2a tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:45:29.632420 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5d387888-54af-46d6-b091-c53c8e97fb2a tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:45:29.632850 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5d387888-54af-46d6-b091-c53c8e97fb2a tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:45:29.744821 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-5d387888-54af-46d6-b091-c53c8e97fb2a tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action" status: 200 len: 14 microversion: 2.1 time: 0.126488 Nov 23 13:45:29.745831 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1094/2180] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:45:29 2021] POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action => generated 14 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 13:45:30.762283 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-91406128-d6ac-4361-945e-5942db015434 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:45:30.763439 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-91406128-d6ac-4361-945e-5942db015434 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: efc6fa5e-050a-42ad-b79d-29fad30bb4a5] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:45:30.775485 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-91406128-d6ac-4361-945e-5942db015434 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:45:30.775997 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-91406128-d6ac-4361-945e-5942db015434 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:45:30.777226 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-91406128-d6ac-4361-945e-5942db015434 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:45:30.779592 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-91406128-d6ac-4361-945e-5942db015434 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:45:30.905828 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-91406128-d6ac-4361-945e-5942db015434 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action" status: 200 len: 14 microversion: 2.1 time: 0.149393 Nov 23 13:45:30.906611 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1087/2181] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:45:30 2021] POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action => generated 14 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 13:45:31.923759 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-dd3537fb-b483-409c-abd0-29150fbf395b tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:45:31.925413 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-dd3537fb-b483-409c-abd0-29150fbf395b tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: efc6fa5e-050a-42ad-b79d-29fad30bb4a5] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:45:31.936016 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-dd3537fb-b483-409c-abd0-29150fbf395b tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:45:31.936568 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-dd3537fb-b483-409c-abd0-29150fbf395b tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:45:31.937480 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-dd3537fb-b483-409c-abd0-29150fbf395b tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:45:31.937940 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-dd3537fb-b483-409c-abd0-29150fbf395b tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:45:32.056165 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-dd3537fb-b483-409c-abd0-29150fbf395b tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action" status: 200 len: 14 microversion: 2.1 time: 0.139085 Nov 23 13:45:32.058561 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1095/2182] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:45:31 2021] POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action => generated 14 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 13:45:33.071167 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-183b7f14-bec1-492e-8b1c-97ac2cfbfc58 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:45:33.072228 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-183b7f14-bec1-492e-8b1c-97ac2cfbfc58 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: efc6fa5e-050a-42ad-b79d-29fad30bb4a5] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:45:33.080360 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-183b7f14-bec1-492e-8b1c-97ac2cfbfc58 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:45:33.080804 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-183b7f14-bec1-492e-8b1c-97ac2cfbfc58 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:45:33.081610 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-183b7f14-bec1-492e-8b1c-97ac2cfbfc58 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:45:33.082035 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-183b7f14-bec1-492e-8b1c-97ac2cfbfc58 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:45:33.215240 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-183b7f14-bec1-492e-8b1c-97ac2cfbfc58 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action" status: 200 len: 6257 microversion: 2.1 time: 0.148124 Nov 23 13:45:33.215805 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1088/2183] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:45:33 2021] POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action => generated 6257 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:45:34.234420 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-5f57c3a7-f346-4baa-bb4d-b02a88cd9425 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:45:34.235541 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-5f57c3a7-f346-4baa-bb4d-b02a88cd9425 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: efc6fa5e-050a-42ad-b79d-29fad30bb4a5] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:45:34.250233 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5f57c3a7-f346-4baa-bb4d-b02a88cd9425 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:45:34.250674 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5f57c3a7-f346-4baa-bb4d-b02a88cd9425 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:45:34.251445 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5f57c3a7-f346-4baa-bb4d-b02a88cd9425 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:45:34.251879 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5f57c3a7-f346-4baa-bb4d-b02a88cd9425 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:45:34.375376 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-5f57c3a7-f346-4baa-bb4d-b02a88cd9425 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action" status: 200 len: 15025 microversion: 2.1 time: 0.150627 Nov 23 13:45:34.376342 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1096/2184] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:45:34 2021] POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action => generated 15025 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:45:35.392067 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-33de4e2d-68cb-492b-9156-df19332a1b91 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:45:35.393114 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-33de4e2d-68cb-492b-9156-df19332a1b91 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: efc6fa5e-050a-42ad-b79d-29fad30bb4a5] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:45:35.401386 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-33de4e2d-68cb-492b-9156-df19332a1b91 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:45:35.401832 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-33de4e2d-68cb-492b-9156-df19332a1b91 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:45:35.402589 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-33de4e2d-68cb-492b-9156-df19332a1b91 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:45:35.403014 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-33de4e2d-68cb-492b-9156-df19332a1b91 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:45:35.525611 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-33de4e2d-68cb-492b-9156-df19332a1b91 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action" status: 200 len: 18608 microversion: 2.1 time: 0.138258 Nov 23 13:45:35.526248 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1089/2185] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:45:35 2021] POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action => generated 18608 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:45:36.543865 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-0ed6bea0-8b61-403f-8694-3d3818ab01a4 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:45:36.545635 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-0ed6bea0-8b61-403f-8694-3d3818ab01a4 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: efc6fa5e-050a-42ad-b79d-29fad30bb4a5] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:45:36.558693 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0ed6bea0-8b61-403f-8694-3d3818ab01a4 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:45:36.559612 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0ed6bea0-8b61-403f-8694-3d3818ab01a4 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:45:36.560518 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0ed6bea0-8b61-403f-8694-3d3818ab01a4 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:45:36.560929 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0ed6bea0-8b61-403f-8694-3d3818ab01a4 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:45:36.684487 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-0ed6bea0-8b61-403f-8694-3d3818ab01a4 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action" status: 200 len: 20997 microversion: 2.1 time: 0.147066 Nov 23 13:45:36.686278 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1097/2186] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:45:36 2021] POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action => generated 20997 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:45:37.699913 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-2eee64ed-528a-4e07-bee8-320781604466 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:45:37.701039 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-2eee64ed-528a-4e07-bee8-320781604466 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: efc6fa5e-050a-42ad-b79d-29fad30bb4a5] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:45:37.709722 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-2eee64ed-528a-4e07-bee8-320781604466 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:45:37.710143 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-2eee64ed-528a-4e07-bee8-320781604466 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:45:37.710893 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-2eee64ed-528a-4e07-bee8-320781604466 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:45:37.711312 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-2eee64ed-528a-4e07-bee8-320781604466 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:45:37.832469 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-2eee64ed-528a-4e07-bee8-320781604466 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action" status: 200 len: 22981 microversion: 2.1 time: 0.136524 Nov 23 13:45:37.833116 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1090/2187] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:45:37 2021] POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action => generated 22981 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:45:38.845834 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-8139df70-dce1-4b7b-b4bb-2f113bdb5fb2 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:45:38.846856 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-8139df70-dce1-4b7b-b4bb-2f113bdb5fb2 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: efc6fa5e-050a-42ad-b79d-29fad30bb4a5] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:45:38.855239 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8139df70-dce1-4b7b-b4bb-2f113bdb5fb2 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:45:38.855677 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8139df70-dce1-4b7b-b4bb-2f113bdb5fb2 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:45:38.856472 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8139df70-dce1-4b7b-b4bb-2f113bdb5fb2 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:45:38.856897 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8139df70-dce1-4b7b-b4bb-2f113bdb5fb2 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:45:38.986365 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-8139df70-dce1-4b7b-b4bb-2f113bdb5fb2 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action" status: 200 len: 24272 microversion: 2.1 time: 0.144747 Nov 23 13:45:38.986988 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1098/2188] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:45:38 2021] POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action => generated 24272 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:45:40.001429 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-fc6cbb81-2a22-47b0-a190-ad27f21cf5f0 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:45:40.002448 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-fc6cbb81-2a22-47b0-a190-ad27f21cf5f0 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: efc6fa5e-050a-42ad-b79d-29fad30bb4a5] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:45:40.010890 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-fc6cbb81-2a22-47b0-a190-ad27f21cf5f0 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:45:40.011322 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-fc6cbb81-2a22-47b0-a190-ad27f21cf5f0 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:45:40.012086 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-fc6cbb81-2a22-47b0-a190-ad27f21cf5f0 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:45:40.012544 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-fc6cbb81-2a22-47b0-a190-ad27f21cf5f0 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:45:40.142584 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-fc6cbb81-2a22-47b0-a190-ad27f21cf5f0 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action" status: 200 len: 26011 microversion: 2.1 time: 0.145485 Nov 23 13:45:40.143816 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1091/2189] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:45:39 2021] POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action => generated 26011 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:45:41.157219 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-f4c52e88-9c6c-473d-b077-20173f1efeb3 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:45:41.158130 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-f4c52e88-9c6c-473d-b077-20173f1efeb3 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: efc6fa5e-050a-42ad-b79d-29fad30bb4a5] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:45:41.166554 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f4c52e88-9c6c-473d-b077-20173f1efeb3 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:45:41.167005 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f4c52e88-9c6c-473d-b077-20173f1efeb3 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:45:41.167779 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f4c52e88-9c6c-473d-b077-20173f1efeb3 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:45:41.168211 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f4c52e88-9c6c-473d-b077-20173f1efeb3 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:45:41.297739 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-f4c52e88-9c6c-473d-b077-20173f1efeb3 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action" status: 200 len: 27327 microversion: 2.1 time: 0.144508 Nov 23 13:45:41.298619 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1099/2190] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:45:41 2021] POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action => generated 27327 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:45:42.317673 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-946dc2e8-8ea8-40b9-95b2-7777dcd13147 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:45:42.318732 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-946dc2e8-8ea8-40b9-95b2-7777dcd13147 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: efc6fa5e-050a-42ad-b79d-29fad30bb4a5] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:45:42.328255 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-946dc2e8-8ea8-40b9-95b2-7777dcd13147 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:45:42.328759 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-946dc2e8-8ea8-40b9-95b2-7777dcd13147 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:45:42.329672 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-946dc2e8-8ea8-40b9-95b2-7777dcd13147 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:45:42.330124 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-946dc2e8-8ea8-40b9-95b2-7777dcd13147 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:45:42.465564 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-946dc2e8-8ea8-40b9-95b2-7777dcd13147 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action" status: 200 len: 27817 microversion: 2.1 time: 0.154866 Nov 23 13:45:42.466522 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1092/2191] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:45:42 2021] POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action => generated 27817 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:45:43.484398 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-adc3c64c-4d7c-4e9b-907f-aba61390845d tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:45:43.485443 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-adc3c64c-4d7c-4e9b-907f-aba61390845d tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: efc6fa5e-050a-42ad-b79d-29fad30bb4a5] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:45:43.494331 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-adc3c64c-4d7c-4e9b-907f-aba61390845d tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:45:43.494800 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-adc3c64c-4d7c-4e9b-907f-aba61390845d tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:45:43.495596 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-adc3c64c-4d7c-4e9b-907f-aba61390845d tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:45:43.496041 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-adc3c64c-4d7c-4e9b-907f-aba61390845d tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:45:43.633295 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-adc3c64c-4d7c-4e9b-907f-aba61390845d tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action" status: 200 len: 28180 microversion: 2.1 time: 0.155447 Nov 23 13:45:43.634307 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1100/2192] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:45:43 2021] POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action => generated 28180 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:45:44.648936 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-ea27401c-e914-4de6-b349-7655c28becca tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:45:44.649939 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-ea27401c-e914-4de6-b349-7655c28becca tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: efc6fa5e-050a-42ad-b79d-29fad30bb4a5] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:45:44.658854 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ea27401c-e914-4de6-b349-7655c28becca tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:45:44.659300 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ea27401c-e914-4de6-b349-7655c28becca tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:45:44.660053 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ea27401c-e914-4de6-b349-7655c28becca tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:45:44.660520 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ea27401c-e914-4de6-b349-7655c28becca tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:45:44.801302 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-ea27401c-e914-4de6-b349-7655c28becca tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action" status: 200 len: 28180 microversion: 2.1 time: 0.156436 Nov 23 13:45:44.802375 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1093/2193] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:45:44 2021] POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action => generated 28180 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:45:45.820641 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-0b097b50-115b-4731-be9e-228c9809fe42 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:45:45.822420 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-0b097b50-115b-4731-be9e-228c9809fe42 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: efc6fa5e-050a-42ad-b79d-29fad30bb4a5] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:45:45.833366 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0b097b50-115b-4731-be9e-228c9809fe42 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:45:45.833810 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0b097b50-115b-4731-be9e-228c9809fe42 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:45:45.834942 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0b097b50-115b-4731-be9e-228c9809fe42 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:45:45.835374 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0b097b50-115b-4731-be9e-228c9809fe42 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:45:45.962057 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-0b097b50-115b-4731-be9e-228c9809fe42 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action" status: 200 len: 28180 microversion: 2.1 time: 0.148177 Nov 23 13:45:45.963101 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1101/2194] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:45:45 2021] POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action => generated 28180 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:45:46.981639 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-710a4a91-0ba7-4b35-938a-2fd6f67287f2 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:45:46.983344 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-710a4a91-0ba7-4b35-938a-2fd6f67287f2 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: efc6fa5e-050a-42ad-b79d-29fad30bb4a5] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:45:46.997442 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-710a4a91-0ba7-4b35-938a-2fd6f67287f2 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:45:46.998197 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-710a4a91-0ba7-4b35-938a-2fd6f67287f2 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:45:46.999476 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-710a4a91-0ba7-4b35-938a-2fd6f67287f2 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:45:47.000303 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-710a4a91-0ba7-4b35-938a-2fd6f67287f2 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:45:47.148439 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-710a4a91-0ba7-4b35-938a-2fd6f67287f2 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action" status: 200 len: 28180 microversion: 2.1 time: 0.173603 Nov 23 13:45:47.148983 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1094/2195] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:45:46 2021] POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action => generated 28180 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:45:48.161084 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-82c2d8c4-d7d4-4339-95f9-0f94155ca6e5 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:45:48.161978 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-82c2d8c4-d7d4-4339-95f9-0f94155ca6e5 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: efc6fa5e-050a-42ad-b79d-29fad30bb4a5] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:45:48.170486 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-82c2d8c4-d7d4-4339-95f9-0f94155ca6e5 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:45:48.170933 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-82c2d8c4-d7d4-4339-95f9-0f94155ca6e5 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:45:48.171703 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-82c2d8c4-d7d4-4339-95f9-0f94155ca6e5 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:45:48.172159 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-82c2d8c4-d7d4-4339-95f9-0f94155ca6e5 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:45:48.302771 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-82c2d8c4-d7d4-4339-95f9-0f94155ca6e5 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action" status: 200 len: 28180 microversion: 2.1 time: 0.145708 Nov 23 13:45:48.303563 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1102/2196] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:45:48 2021] POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action => generated 28180 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:45:49.317873 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-4b788d9b-f1ab-4390-9a00-6f4d4dc5f360 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:45:49.319182 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-4b788d9b-f1ab-4390-9a00-6f4d4dc5f360 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: efc6fa5e-050a-42ad-b79d-29fad30bb4a5] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:45:49.330919 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4b788d9b-f1ab-4390-9a00-6f4d4dc5f360 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:45:49.331777 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4b788d9b-f1ab-4390-9a00-6f4d4dc5f360 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:45:49.333178 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4b788d9b-f1ab-4390-9a00-6f4d4dc5f360 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:45:49.333855 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4b788d9b-f1ab-4390-9a00-6f4d4dc5f360 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:45:49.454798 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-4b788d9b-f1ab-4390-9a00-6f4d4dc5f360 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action" status: 200 len: 28180 microversion: 2.1 time: 0.141996 Nov 23 13:45:49.455466 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1095/2197] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:45:49 2021] POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action => generated 28180 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:45:50.471619 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-0403fb87-0d56-48a0-b08c-9b914d6cb0e8 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:45:50.473287 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-0403fb87-0d56-48a0-b08c-9b914d6cb0e8 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: efc6fa5e-050a-42ad-b79d-29fad30bb4a5] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:45:50.482576 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0403fb87-0d56-48a0-b08c-9b914d6cb0e8 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:45:50.483024 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0403fb87-0d56-48a0-b08c-9b914d6cb0e8 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:45:50.483787 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0403fb87-0d56-48a0-b08c-9b914d6cb0e8 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:45:50.484218 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0403fb87-0d56-48a0-b08c-9b914d6cb0e8 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:45:50.616063 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-0403fb87-0d56-48a0-b08c-9b914d6cb0e8 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action" status: 200 len: 28180 microversion: 2.1 time: 0.151098 Nov 23 13:45:50.616995 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1103/2198] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:45:50 2021] POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action => generated 28180 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:45:51.632610 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-c9621c86-5984-4907-b861-47a712991096 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:45:51.633872 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-c9621c86-5984-4907-b861-47a712991096 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: efc6fa5e-050a-42ad-b79d-29fad30bb4a5] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:45:51.646253 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c9621c86-5984-4907-b861-47a712991096 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:45:51.646862 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c9621c86-5984-4907-b861-47a712991096 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:45:51.647974 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c9621c86-5984-4907-b861-47a712991096 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:45:51.648638 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c9621c86-5984-4907-b861-47a712991096 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:45:51.771729 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-c9621c86-5984-4907-b861-47a712991096 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action" status: 200 len: 28180 microversion: 2.1 time: 0.145498 Nov 23 13:45:51.772395 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1096/2199] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:45:51 2021] POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action => generated 28180 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:45:52.789569 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-59eec363-44b7-4d5f-be75-e8830c2e3d42 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:45:52.790909 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-59eec363-44b7-4d5f-be75-e8830c2e3d42 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: efc6fa5e-050a-42ad-b79d-29fad30bb4a5] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:45:52.800487 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-59eec363-44b7-4d5f-be75-e8830c2e3d42 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:45:52.801014 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-59eec363-44b7-4d5f-be75-e8830c2e3d42 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:45:52.801835 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-59eec363-44b7-4d5f-be75-e8830c2e3d42 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:45:52.802304 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-59eec363-44b7-4d5f-be75-e8830c2e3d42 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:45:52.927830 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-59eec363-44b7-4d5f-be75-e8830c2e3d42 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action" status: 200 len: 28180 microversion: 2.1 time: 0.144762 Nov 23 13:45:52.928668 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1104/2200] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:45:52 2021] POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action => generated 28180 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:45:53.941944 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-437f2b2b-950a-4495-9178-56679578827c tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:45:53.942969 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-437f2b2b-950a-4495-9178-56679578827c tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: efc6fa5e-050a-42ad-b79d-29fad30bb4a5] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:45:53.951389 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-437f2b2b-950a-4495-9178-56679578827c tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:45:53.951869 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-437f2b2b-950a-4495-9178-56679578827c tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:45:53.952671 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-437f2b2b-950a-4495-9178-56679578827c tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:45:53.953100 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-437f2b2b-950a-4495-9178-56679578827c tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:45:54.070404 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-437f2b2b-950a-4495-9178-56679578827c tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action" status: 200 len: 28180 microversion: 2.1 time: 0.132540 Nov 23 13:45:54.071111 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1097/2201] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:45:53 2021] POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action => generated 28180 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:45:55.088066 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-26102445-c84f-4783-af03-f38e4e6763b8 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:45:55.089396 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-26102445-c84f-4783-af03-f38e4e6763b8 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: efc6fa5e-050a-42ad-b79d-29fad30bb4a5] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:45:55.098997 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-26102445-c84f-4783-af03-f38e4e6763b8 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:45:55.099573 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-26102445-c84f-4783-af03-f38e4e6763b8 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:45:55.100374 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-26102445-c84f-4783-af03-f38e4e6763b8 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:45:55.100816 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-26102445-c84f-4783-af03-f38e4e6763b8 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:45:55.219428 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-26102445-c84f-4783-af03-f38e4e6763b8 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action" status: 200 len: 28180 microversion: 2.1 time: 0.137849 Nov 23 13:45:55.219988 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1105/2202] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:45:55 2021] POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action => generated 28180 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:45:56.233199 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-b315b177-12a5-4fd7-83dc-b01ddcd080b6 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:45:56.234083 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-b315b177-12a5-4fd7-83dc-b01ddcd080b6 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: efc6fa5e-050a-42ad-b79d-29fad30bb4a5] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:45:56.242259 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b315b177-12a5-4fd7-83dc-b01ddcd080b6 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:45:56.242704 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b315b177-12a5-4fd7-83dc-b01ddcd080b6 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:45:56.243463 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b315b177-12a5-4fd7-83dc-b01ddcd080b6 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:45:56.243887 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b315b177-12a5-4fd7-83dc-b01ddcd080b6 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:45:56.383186 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-b315b177-12a5-4fd7-83dc-b01ddcd080b6 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action" status: 200 len: 28212 microversion: 2.1 time: 0.153601 Nov 23 13:45:56.384323 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1098/2203] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:45:56 2021] POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action => generated 28212 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:45:57.399478 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-d2e72f6f-9c2c-4c24-8c32-b2b73597d3a9 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:45:57.400529 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-d2e72f6f-9c2c-4c24-8c32-b2b73597d3a9 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: efc6fa5e-050a-42ad-b79d-29fad30bb4a5] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:45:57.409105 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d2e72f6f-9c2c-4c24-8c32-b2b73597d3a9 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:45:57.409551 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d2e72f6f-9c2c-4c24-8c32-b2b73597d3a9 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:45:57.410311 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d2e72f6f-9c2c-4c24-8c32-b2b73597d3a9 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:45:57.410963 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d2e72f6f-9c2c-4c24-8c32-b2b73597d3a9 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:45:57.537089 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-d2e72f6f-9c2c-4c24-8c32-b2b73597d3a9 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action" status: 200 len: 28471 microversion: 2.1 time: 0.141561 Nov 23 13:45:57.537726 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1106/2204] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:45:57 2021] POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action => generated 28471 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:45:58.552001 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-d564d747-b397-42ca-8398-c7ebc031cdb3 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:45:58.553045 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-d564d747-b397-42ca-8398-c7ebc031cdb3 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: efc6fa5e-050a-42ad-b79d-29fad30bb4a5] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:45:58.561703 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d564d747-b397-42ca-8398-c7ebc031cdb3 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:45:58.562159 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d564d747-b397-42ca-8398-c7ebc031cdb3 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:45:58.562926 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d564d747-b397-42ca-8398-c7ebc031cdb3 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:45:58.563356 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d564d747-b397-42ca-8398-c7ebc031cdb3 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:45:58.686407 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-d564d747-b397-42ca-8398-c7ebc031cdb3 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action" status: 200 len: 28639 microversion: 2.1 time: 0.138392 Nov 23 13:45:58.686971 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1099/2205] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:45:58 2021] POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action => generated 28639 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:45:59.699462 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-47b36705-0a31-4935-bb5a-c63c1058e6cd tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:45:59.700558 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-47b36705-0a31-4935-bb5a-c63c1058e6cd tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: efc6fa5e-050a-42ad-b79d-29fad30bb4a5] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:45:59.709889 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-47b36705-0a31-4935-bb5a-c63c1058e6cd tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:45:59.710326 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-47b36705-0a31-4935-bb5a-c63c1058e6cd tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:45:59.711065 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-47b36705-0a31-4935-bb5a-c63c1058e6cd tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:45:59.711487 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-47b36705-0a31-4935-bb5a-c63c1058e6cd tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:45:59.831312 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-47b36705-0a31-4935-bb5a-c63c1058e6cd tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action" status: 200 len: 28639 microversion: 2.1 time: 0.136097 Nov 23 13:45:59.831966 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1107/2206] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:45:59 2021] POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action => generated 28639 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:46:00.844267 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-aca8feb7-ef4f-459a-925d-adc967f5d31c tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:46:00.845503 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-aca8feb7-ef4f-459a-925d-adc967f5d31c tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: efc6fa5e-050a-42ad-b79d-29fad30bb4a5] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:46:00.854274 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-aca8feb7-ef4f-459a-925d-adc967f5d31c tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:46:00.854804 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-aca8feb7-ef4f-459a-925d-adc967f5d31c tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:46:00.855654 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-aca8feb7-ef4f-459a-925d-adc967f5d31c tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:46:00.856127 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-aca8feb7-ef4f-459a-925d-adc967f5d31c tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:46:00.978043 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-aca8feb7-ef4f-459a-925d-adc967f5d31c tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action" status: 200 len: 28639 microversion: 2.1 time: 0.138073 Nov 23 13:46:00.978717 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1100/2207] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:46:00 2021] POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action => generated 28639 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:46:01.990955 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-2cb7874b-c955-4069-8952-9e3fc35c6718 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:46:01.991982 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-2cb7874b-c955-4069-8952-9e3fc35c6718 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: efc6fa5e-050a-42ad-b79d-29fad30bb4a5] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:46:02.000584 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2cb7874b-c955-4069-8952-9e3fc35c6718 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:46:02.001009 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2cb7874b-c955-4069-8952-9e3fc35c6718 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:46:02.001775 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2cb7874b-c955-4069-8952-9e3fc35c6718 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:46:02.002200 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2cb7874b-c955-4069-8952-9e3fc35c6718 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:46:02.120824 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-2cb7874b-c955-4069-8952-9e3fc35c6718 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action" status: 200 len: 28639 microversion: 2.1 time: 0.133819 Nov 23 13:46:02.121543 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1108/2208] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:46:01 2021] POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action => generated 28639 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:46:03.134928 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-cb7517b7-4175-4868-8a97-084156315b05 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:46:03.135965 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-cb7517b7-4175-4868-8a97-084156315b05 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: efc6fa5e-050a-42ad-b79d-29fad30bb4a5] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:46:03.144632 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-cb7517b7-4175-4868-8a97-084156315b05 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:46:03.145074 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-cb7517b7-4175-4868-8a97-084156315b05 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:46:03.145833 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-cb7517b7-4175-4868-8a97-084156315b05 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:46:03.146254 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-cb7517b7-4175-4868-8a97-084156315b05 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:46:03.269411 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-cb7517b7-4175-4868-8a97-084156315b05 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action" status: 200 len: 28639 microversion: 2.1 time: 0.138654 Nov 23 13:46:03.270399 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1101/2209] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:46:03 2021] POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action => generated 28639 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:46:04.284476 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-f3677f2a-3b0d-4ccd-b81d-5f0f55edf1e7 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:46:04.285506 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-f3677f2a-3b0d-4ccd-b81d-5f0f55edf1e7 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: efc6fa5e-050a-42ad-b79d-29fad30bb4a5] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:46:04.293971 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f3677f2a-3b0d-4ccd-b81d-5f0f55edf1e7 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:46:04.294425 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f3677f2a-3b0d-4ccd-b81d-5f0f55edf1e7 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:46:04.295229 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f3677f2a-3b0d-4ccd-b81d-5f0f55edf1e7 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:46:04.295618 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f3677f2a-3b0d-4ccd-b81d-5f0f55edf1e7 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:46:04.421080 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-f3677f2a-3b0d-4ccd-b81d-5f0f55edf1e7 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action" status: 200 len: 28639 microversion: 2.1 time: 0.140194 Nov 23 13:46:04.421951 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1109/2210] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:46:04 2021] POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action => generated 28639 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:46:05.435475 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-b8384b42-00db-474a-8f9e-a14b5b7fc210 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:46:05.436528 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-b8384b42-00db-474a-8f9e-a14b5b7fc210 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: efc6fa5e-050a-42ad-b79d-29fad30bb4a5] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:46:05.447142 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b8384b42-00db-474a-8f9e-a14b5b7fc210 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:46:05.447904 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b8384b42-00db-474a-8f9e-a14b5b7fc210 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:46:05.449131 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b8384b42-00db-474a-8f9e-a14b5b7fc210 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:46:05.449802 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b8384b42-00db-474a-8f9e-a14b5b7fc210 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:46:05.579195 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-b8384b42-00db-474a-8f9e-a14b5b7fc210 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action" status: 200 len: 28639 microversion: 2.1 time: 0.147388 Nov 23 13:46:05.579926 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1102/2211] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:46:05 2021] POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action => generated 28639 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:46:06.597483 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-09c9235e-d563-40bd-89d6-c7529ba31291 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:46:06.598470 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-09c9235e-d563-40bd-89d6-c7529ba31291 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: efc6fa5e-050a-42ad-b79d-29fad30bb4a5] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:46:06.608818 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-09c9235e-d563-40bd-89d6-c7529ba31291 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:46:06.609276 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-09c9235e-d563-40bd-89d6-c7529ba31291 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:46:06.610066 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-09c9235e-d563-40bd-89d6-c7529ba31291 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:46:06.610497 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-09c9235e-d563-40bd-89d6-c7529ba31291 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:46:06.744212 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-09c9235e-d563-40bd-89d6-c7529ba31291 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action" status: 200 len: 28639 microversion: 2.1 time: 0.152068 Nov 23 13:46:06.746328 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1110/2212] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:46:06 2021] POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action => generated 28639 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:46:07.759380 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-4f84fceb-54cf-4240-8b0b-3d81c28f6733 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:46:07.760404 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-4f84fceb-54cf-4240-8b0b-3d81c28f6733 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: efc6fa5e-050a-42ad-b79d-29fad30bb4a5] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:46:07.770077 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4f84fceb-54cf-4240-8b0b-3d81c28f6733 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:46:07.770860 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4f84fceb-54cf-4240-8b0b-3d81c28f6733 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:46:07.772221 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4f84fceb-54cf-4240-8b0b-3d81c28f6733 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:46:07.773004 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-4f84fceb-54cf-4240-8b0b-3d81c28f6733 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:46:07.898769 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-4f84fceb-54cf-4240-8b0b-3d81c28f6733 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action" status: 200 len: 28639 microversion: 2.1 time: 0.143695 Nov 23 13:46:07.899765 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1103/2213] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:46:07 2021] POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action => generated 28639 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:46:08.085966 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 13:46:08.086697 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: Tue Nov 23 13:46:08 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 23 13:46:08.917599 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-95e3878d-1629-4793-b557-347dd215ce89 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:46:08.919210 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-95e3878d-1629-4793-b557-347dd215ce89 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: efc6fa5e-050a-42ad-b79d-29fad30bb4a5] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:46:08.928796 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-95e3878d-1629-4793-b557-347dd215ce89 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:46:08.929243 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-95e3878d-1629-4793-b557-347dd215ce89 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:46:08.930000 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-95e3878d-1629-4793-b557-347dd215ce89 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:46:08.930430 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-95e3878d-1629-4793-b557-347dd215ce89 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:46:09.049776 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-95e3878d-1629-4793-b557-347dd215ce89 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action" status: 200 len: 28639 microversion: 2.1 time: 0.139070 Nov 23 13:46:09.050402 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1111/2214] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:46:08 2021] POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action => generated 28639 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:46:10.065607 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-ee152452-81a7-4f78-b5d5-3e7a81757413 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:46:10.066618 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-ee152452-81a7-4f78-b5d5-3e7a81757413 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: efc6fa5e-050a-42ad-b79d-29fad30bb4a5] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:46:10.074966 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ee152452-81a7-4f78-b5d5-3e7a81757413 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:46:10.075394 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ee152452-81a7-4f78-b5d5-3e7a81757413 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:46:10.076196 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ee152452-81a7-4f78-b5d5-3e7a81757413 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:46:10.076712 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-ee152452-81a7-4f78-b5d5-3e7a81757413 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:46:10.212349 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-ee152452-81a7-4f78-b5d5-3e7a81757413 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action" status: 200 len: 28639 microversion: 2.1 time: 0.152339 Nov 23 13:46:10.213030 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1104/2215] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:46:10 2021] POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action => generated 28639 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:46:11.229906 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-84ae4645-ebd7-45b1-8f8c-ff5fa50c6b7a tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:46:11.231569 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-84ae4645-ebd7-45b1-8f8c-ff5fa50c6b7a tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: efc6fa5e-050a-42ad-b79d-29fad30bb4a5] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:46:11.242616 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-84ae4645-ebd7-45b1-8f8c-ff5fa50c6b7a tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:46:11.243071 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-84ae4645-ebd7-45b1-8f8c-ff5fa50c6b7a tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:46:11.243841 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-84ae4645-ebd7-45b1-8f8c-ff5fa50c6b7a tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:46:11.244269 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-84ae4645-ebd7-45b1-8f8c-ff5fa50c6b7a tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:46:11.358893 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-84ae4645-ebd7-45b1-8f8c-ff5fa50c6b7a tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action" status: 200 len: 28639 microversion: 2.1 time: 0.136250 Nov 23 13:46:11.359593 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1112/2216] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:46:11 2021] POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action => generated 28639 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:46:12.375663 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-2b403289-a5bd-47b3-9633-2c24f6d8fee1 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:46:12.377018 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-2b403289-a5bd-47b3-9633-2c24f6d8fee1 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: efc6fa5e-050a-42ad-b79d-29fad30bb4a5] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:46:12.386135 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-2b403289-a5bd-47b3-9633-2c24f6d8fee1 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:46:12.386579 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-2b403289-a5bd-47b3-9633-2c24f6d8fee1 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:46:12.387349 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-2b403289-a5bd-47b3-9633-2c24f6d8fee1 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:46:12.387781 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-2b403289-a5bd-47b3-9633-2c24f6d8fee1 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:46:12.531963 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-2b403289-a5bd-47b3-9633-2c24f6d8fee1 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action" status: 200 len: 28639 microversion: 2.1 time: 0.162304 Nov 23 13:46:12.533056 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1105/2217] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:46:12 2021] POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action => generated 28639 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:46:13.551799 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-2ea168c9-9699-4287-bb88-c600f1005853 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:46:13.553378 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-2ea168c9-9699-4287-bb88-c600f1005853 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: efc6fa5e-050a-42ad-b79d-29fad30bb4a5] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:46:13.562088 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2ea168c9-9699-4287-bb88-c600f1005853 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:46:13.562542 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2ea168c9-9699-4287-bb88-c600f1005853 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:46:13.563315 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2ea168c9-9699-4287-bb88-c600f1005853 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:46:13.563744 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-2ea168c9-9699-4287-bb88-c600f1005853 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:46:13.684165 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-2ea168c9-9699-4287-bb88-c600f1005853 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action" status: 200 len: 28639 microversion: 2.1 time: 0.138843 Nov 23 13:46:13.684951 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1113/2218] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:46:13 2021] POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action => generated 28639 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:46:14.702300 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-c4327db1-13d0-49d5-a71c-08e92e3d3e80 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:46:14.703881 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-c4327db1-13d0-49d5-a71c-08e92e3d3e80 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: efc6fa5e-050a-42ad-b79d-29fad30bb4a5] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:46:14.714539 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c4327db1-13d0-49d5-a71c-08e92e3d3e80 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:46:14.714981 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c4327db1-13d0-49d5-a71c-08e92e3d3e80 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:46:14.715737 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c4327db1-13d0-49d5-a71c-08e92e3d3e80 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:46:14.716163 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c4327db1-13d0-49d5-a71c-08e92e3d3e80 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:46:14.839826 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-c4327db1-13d0-49d5-a71c-08e92e3d3e80 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action" status: 200 len: 28639 microversion: 2.1 time: 0.144438 Nov 23 13:46:14.840505 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1106/2219] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:46:14 2021] POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action => generated 28639 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:46:15.853533 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-0140a480-d6ed-4379-9b2f-a1c323b732ae tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:46:15.854703 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-0140a480-d6ed-4379-9b2f-a1c323b732ae tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: efc6fa5e-050a-42ad-b79d-29fad30bb4a5] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:46:15.862884 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0140a480-d6ed-4379-9b2f-a1c323b732ae tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:46:15.863333 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0140a480-d6ed-4379-9b2f-a1c323b732ae tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:46:15.864129 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0140a480-d6ed-4379-9b2f-a1c323b732ae tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:46:15.865163 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-0140a480-d6ed-4379-9b2f-a1c323b732ae tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:46:16.127622 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-0140a480-d6ed-4379-9b2f-a1c323b732ae tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action" status: 200 len: 28639 microversion: 2.1 time: 0.278630 Nov 23 13:46:16.128145 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1114/2220] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:46:15 2021] POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action => generated 28639 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:46:17.143284 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-1c5dbe0c-c9c8-41e6-8bc6-cb0f6ed3fd1c tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:46:17.144608 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-1c5dbe0c-c9c8-41e6-8bc6-cb0f6ed3fd1c tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: efc6fa5e-050a-42ad-b79d-29fad30bb4a5] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:46:17.154351 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-1c5dbe0c-c9c8-41e6-8bc6-cb0f6ed3fd1c tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:46:17.155302 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-1c5dbe0c-c9c8-41e6-8bc6-cb0f6ed3fd1c tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:46:17.155968 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-1c5dbe0c-c9c8-41e6-8bc6-cb0f6ed3fd1c tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:46:17.156429 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-1c5dbe0c-c9c8-41e6-8bc6-cb0f6ed3fd1c tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:46:17.272711 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-1c5dbe0c-c9c8-41e6-8bc6-cb0f6ed3fd1c tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action" status: 200 len: 28639 microversion: 2.1 time: 0.135269 Nov 23 13:46:17.273710 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1107/2221] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:46:17 2021] POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action => generated 28639 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:46:18.291606 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-d8459b62-5096-45ee-9315-7ec559f8e342 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:46:18.292639 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-d8459b62-5096-45ee-9315-7ec559f8e342 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: efc6fa5e-050a-42ad-b79d-29fad30bb4a5] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:46:18.300993 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d8459b62-5096-45ee-9315-7ec559f8e342 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:46:18.301439 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d8459b62-5096-45ee-9315-7ec559f8e342 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:46:18.302215 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d8459b62-5096-45ee-9315-7ec559f8e342 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:46:18.302644 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d8459b62-5096-45ee-9315-7ec559f8e342 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:46:18.419810 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-d8459b62-5096-45ee-9315-7ec559f8e342 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action" status: 200 len: 28639 microversion: 2.1 time: 0.135034 Nov 23 13:46:18.420566 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1115/2222] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:46:18 2021] POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action => generated 28639 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:46:19.433967 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-d1c0a7f0-ba31-4ec0-b5bc-84e06933a24a tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:46:19.435127 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-d1c0a7f0-ba31-4ec0-b5bc-84e06933a24a tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: efc6fa5e-050a-42ad-b79d-29fad30bb4a5] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:46:19.443282 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d1c0a7f0-ba31-4ec0-b5bc-84e06933a24a tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:46:19.443721 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d1c0a7f0-ba31-4ec0-b5bc-84e06933a24a tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:46:19.444516 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d1c0a7f0-ba31-4ec0-b5bc-84e06933a24a tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:46:19.444963 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-d1c0a7f0-ba31-4ec0-b5bc-84e06933a24a tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:46:19.563233 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-d1c0a7f0-ba31-4ec0-b5bc-84e06933a24a tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action" status: 200 len: 28639 microversion: 2.1 time: 0.133305 Nov 23 13:46:19.563883 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1108/2223] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:46:19 2021] POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action => generated 28639 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:46:20.582453 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-5bd25889-ee73-4acb-8fe2-a0f9e3a64d4e tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:46:20.584954 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-5bd25889-ee73-4acb-8fe2-a0f9e3a64d4e tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: efc6fa5e-050a-42ad-b79d-29fad30bb4a5] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:46:20.598278 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5bd25889-ee73-4acb-8fe2-a0f9e3a64d4e tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:46:20.599032 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5bd25889-ee73-4acb-8fe2-a0f9e3a64d4e tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:46:20.600276 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5bd25889-ee73-4acb-8fe2-a0f9e3a64d4e tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:46:20.601303 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5bd25889-ee73-4acb-8fe2-a0f9e3a64d4e tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:46:20.726578 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-5bd25889-ee73-4acb-8fe2-a0f9e3a64d4e tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action" status: 200 len: 28639 microversion: 2.1 time: 0.151109 Nov 23 13:46:20.727219 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1116/2224] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:46:20 2021] POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action => generated 28639 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:46:21.741907 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-46b85992-18e9-4bb6-b5ac-65e309fe0604 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:46:21.743186 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-46b85992-18e9-4bb6-b5ac-65e309fe0604 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: efc6fa5e-050a-42ad-b79d-29fad30bb4a5] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:46:21.753938 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-46b85992-18e9-4bb6-b5ac-65e309fe0604 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:46:21.754493 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-46b85992-18e9-4bb6-b5ac-65e309fe0604 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:46:21.755438 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-46b85992-18e9-4bb6-b5ac-65e309fe0604 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:46:21.755974 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-46b85992-18e9-4bb6-b5ac-65e309fe0604 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:46:21.876999 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-46b85992-18e9-4bb6-b5ac-65e309fe0604 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action" status: 200 len: 28639 microversion: 2.1 time: 0.139971 Nov 23 13:46:21.878093 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1109/2225] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:46:21 2021] POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action => generated 28639 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:46:22.890543 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-e1c646b6-da9f-49a5-9abd-51dcda7beea1 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:46:22.891537 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-e1c646b6-da9f-49a5-9abd-51dcda7beea1 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: efc6fa5e-050a-42ad-b79d-29fad30bb4a5] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:46:22.899712 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e1c646b6-da9f-49a5-9abd-51dcda7beea1 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:46:22.900152 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e1c646b6-da9f-49a5-9abd-51dcda7beea1 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:46:22.900932 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e1c646b6-da9f-49a5-9abd-51dcda7beea1 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:46:22.901383 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e1c646b6-da9f-49a5-9abd-51dcda7beea1 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:46:23.016220 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-e1c646b6-da9f-49a5-9abd-51dcda7beea1 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action" status: 200 len: 28639 microversion: 2.1 time: 0.129601 Nov 23 13:46:23.016901 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1117/2226] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:46:22 2021] POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action => generated 28639 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:46:24.033251 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-bdebd974-793a-4014-8143-c19d8399043a tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:46:24.034956 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-bdebd974-793a-4014-8143-c19d8399043a tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: efc6fa5e-050a-42ad-b79d-29fad30bb4a5] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:46:24.046403 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-bdebd974-793a-4014-8143-c19d8399043a tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:46:24.046810 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-bdebd974-793a-4014-8143-c19d8399043a tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:46:24.047596 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-bdebd974-793a-4014-8143-c19d8399043a tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:46:24.048017 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-bdebd974-793a-4014-8143-c19d8399043a tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:46:24.167735 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-bdebd974-793a-4014-8143-c19d8399043a tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action" status: 200 len: 28639 microversion: 2.1 time: 0.140745 Nov 23 13:46:24.168321 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1110/2227] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:46:24 2021] POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action => generated 28639 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:46:25.183706 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-945ab12f-7abb-401a-b9c4-4282f4639938 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:46:25.184762 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-945ab12f-7abb-401a-b9c4-4282f4639938 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: efc6fa5e-050a-42ad-b79d-29fad30bb4a5] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:46:25.193346 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-945ab12f-7abb-401a-b9c4-4282f4639938 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:46:25.193792 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-945ab12f-7abb-401a-b9c4-4282f4639938 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:46:25.194571 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-945ab12f-7abb-401a-b9c4-4282f4639938 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:46:25.195125 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-945ab12f-7abb-401a-b9c4-4282f4639938 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:46:25.311715 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-945ab12f-7abb-401a-b9c4-4282f4639938 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action" status: 200 len: 28639 microversion: 2.1 time: 0.134696 Nov 23 13:46:25.312721 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1118/2228] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:46:25 2021] POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action => generated 28639 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:46:26.328275 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-37d6ad4f-c2b1-48eb-8725-942d43290b92 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:46:26.329382 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-37d6ad4f-c2b1-48eb-8725-942d43290b92 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: efc6fa5e-050a-42ad-b79d-29fad30bb4a5] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:46:26.338951 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-37d6ad4f-c2b1-48eb-8725-942d43290b92 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:46:26.340099 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-37d6ad4f-c2b1-48eb-8725-942d43290b92 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:46:26.341002 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-37d6ad4f-c2b1-48eb-8725-942d43290b92 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:46:26.341465 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-37d6ad4f-c2b1-48eb-8725-942d43290b92 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:46:26.460027 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-37d6ad4f-c2b1-48eb-8725-942d43290b92 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action" status: 200 len: 28639 microversion: 2.1 time: 0.137312 Nov 23 13:46:26.460908 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1111/2229] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:46:26 2021] POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action => generated 28639 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:46:27.476768 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-5579ba27-e1ca-465c-a9c8-a1dbdd6c8866 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:46:27.478109 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-5579ba27-e1ca-465c-a9c8-a1dbdd6c8866 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: efc6fa5e-050a-42ad-b79d-29fad30bb4a5] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:46:27.488813 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5579ba27-e1ca-465c-a9c8-a1dbdd6c8866 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:46:27.489323 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5579ba27-e1ca-465c-a9c8-a1dbdd6c8866 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:46:27.490368 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5579ba27-e1ca-465c-a9c8-a1dbdd6c8866 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:46:27.490967 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-5579ba27-e1ca-465c-a9c8-a1dbdd6c8866 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:46:27.609589 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-5579ba27-e1ca-465c-a9c8-a1dbdd6c8866 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action" status: 200 len: 28639 microversion: 2.1 time: 0.138578 Nov 23 13:46:27.610213 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1119/2230] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:46:27 2021] POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action => generated 28639 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:46:28.627570 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-c4a38c01-4cc0-4fa9-9b05-02173cccb2f0 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:46:28.629113 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-c4a38c01-4cc0-4fa9-9b05-02173cccb2f0 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: efc6fa5e-050a-42ad-b79d-29fad30bb4a5] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:46:28.642338 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c4a38c01-4cc0-4fa9-9b05-02173cccb2f0 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:46:28.643122 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c4a38c01-4cc0-4fa9-9b05-02173cccb2f0 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:46:28.644053 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c4a38c01-4cc0-4fa9-9b05-02173cccb2f0 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:46:28.644516 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-c4a38c01-4cc0-4fa9-9b05-02173cccb2f0 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:46:28.780418 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-c4a38c01-4cc0-4fa9-9b05-02173cccb2f0 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action" status: 200 len: 30888 microversion: 2.1 time: 0.159609 Nov 23 13:46:28.781512 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1112/2231] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:46:28 2021] POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action => generated 30888 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:46:29.795998 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-c714add3-bd3f-4d67-bf74-57da71cd4f0b tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:46:29.797215 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-c714add3-bd3f-4d67-bf74-57da71cd4f0b tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: efc6fa5e-050a-42ad-b79d-29fad30bb4a5] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:46:29.806828 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c714add3-bd3f-4d67-bf74-57da71cd4f0b tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:46:29.807268 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c714add3-bd3f-4d67-bf74-57da71cd4f0b tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:46:29.808080 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c714add3-bd3f-4d67-bf74-57da71cd4f0b tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:46:29.808536 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-c714add3-bd3f-4d67-bf74-57da71cd4f0b tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:46:29.943109 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-c714add3-bd3f-4d67-bf74-57da71cd4f0b tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action" status: 200 len: 32933 microversion: 2.1 time: 0.151600 Nov 23 13:46:29.944259 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1120/2232] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:46:29 2021] POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action => generated 32933 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:46:30.958341 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-98f3b9ab-a764-4529-9dd9-c9523dfbd2a1 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:46:30.959703 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-98f3b9ab-a764-4529-9dd9-c9523dfbd2a1 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: efc6fa5e-050a-42ad-b79d-29fad30bb4a5] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:46:30.968412 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-98f3b9ab-a764-4529-9dd9-c9523dfbd2a1 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:46:30.968848 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-98f3b9ab-a764-4529-9dd9-c9523dfbd2a1 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:46:30.969598 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-98f3b9ab-a764-4529-9dd9-c9523dfbd2a1 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:46:30.970019 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-98f3b9ab-a764-4529-9dd9-c9523dfbd2a1 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:46:31.100058 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-98f3b9ab-a764-4529-9dd9-c9523dfbd2a1 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action" status: 200 len: 33955 microversion: 2.1 time: 0.145363 Nov 23 13:46:31.100774 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1113/2233] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:46:30 2021] POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action => generated 33955 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:46:32.113123 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-54abd1c3-d129-42f6-9b66-2e0a000ea83f tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:46:32.114113 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-54abd1c3-d129-42f6-9b66-2e0a000ea83f tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: efc6fa5e-050a-42ad-b79d-29fad30bb4a5] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:46:32.123159 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-54abd1c3-d129-42f6-9b66-2e0a000ea83f tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:46:32.123719 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-54abd1c3-d129-42f6-9b66-2e0a000ea83f tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:46:32.124530 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-54abd1c3-d129-42f6-9b66-2e0a000ea83f tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:46:32.124934 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-54abd1c3-d129-42f6-9b66-2e0a000ea83f tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:46:32.262674 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-54abd1c3-d129-42f6-9b66-2e0a000ea83f tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action" status: 200 len: 35343 microversion: 2.1 time: 0.153503 Nov 23 13:46:32.263334 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1121/2234] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:46:32 2021] POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action => generated 35343 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:46:33.275661 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-437d62f0-d8ff-429a-9ebe-327ce5c05d90 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:46:33.276639 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-437d62f0-d8ff-429a-9ebe-327ce5c05d90 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: efc6fa5e-050a-42ad-b79d-29fad30bb4a5] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:46:33.285221 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-437d62f0-d8ff-429a-9ebe-327ce5c05d90 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:46:33.285670 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-437d62f0-d8ff-429a-9ebe-327ce5c05d90 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:46:33.286435 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-437d62f0-d8ff-429a-9ebe-327ce5c05d90 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:46:33.286865 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-437d62f0-d8ff-429a-9ebe-327ce5c05d90 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:46:33.413230 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-437d62f0-d8ff-429a-9ebe-327ce5c05d90 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action" status: 200 len: 36895 microversion: 2.1 time: 0.141719 Nov 23 13:46:33.414132 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1114/2235] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:46:33 2021] POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action => generated 36895 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:46:34.430279 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-8ab60caf-7fc6-4ddb-90f1-e856b84a7132 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:46:34.431401 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-8ab60caf-7fc6-4ddb-90f1-e856b84a7132 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: efc6fa5e-050a-42ad-b79d-29fad30bb4a5] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:46:34.440135 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8ab60caf-7fc6-4ddb-90f1-e856b84a7132 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:46:34.440629 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8ab60caf-7fc6-4ddb-90f1-e856b84a7132 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:46:34.441398 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8ab60caf-7fc6-4ddb-90f1-e856b84a7132 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:46:34.441832 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-8ab60caf-7fc6-4ddb-90f1-e856b84a7132 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:46:34.571966 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-8ab60caf-7fc6-4ddb-90f1-e856b84a7132 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action" status: 200 len: 38174 microversion: 2.1 time: 0.147588 Nov 23 13:46:34.573130 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1122/2236] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:46:34 2021] POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action => generated 38174 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:46:35.590202 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-b48f102f-c06d-4d02-b51f-4f7e8130555b tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:46:35.591449 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-b48f102f-c06d-4d02-b51f-4f7e8130555b tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: efc6fa5e-050a-42ad-b79d-29fad30bb4a5] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:46:35.599801 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b48f102f-c06d-4d02-b51f-4f7e8130555b tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:46:35.600269 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b48f102f-c06d-4d02-b51f-4f7e8130555b tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:46:35.601035 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b48f102f-c06d-4d02-b51f-4f7e8130555b tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:46:35.601463 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b48f102f-c06d-4d02-b51f-4f7e8130555b tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:46:35.720132 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-b48f102f-c06d-4d02-b51f-4f7e8130555b tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action" status: 200 len: 38174 microversion: 2.1 time: 0.136636 Nov 23 13:46:35.720881 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1115/2237] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:46:35 2021] POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action => generated 38174 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:46:36.733227 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-b4af8a30-995c-40f4-a9fa-1a9f85afe1db tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:46:36.734245 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-b4af8a30-995c-40f4-a9fa-1a9f85afe1db tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: efc6fa5e-050a-42ad-b79d-29fad30bb4a5] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:46:36.742551 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b4af8a30-995c-40f4-a9fa-1a9f85afe1db tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:46:36.742990 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b4af8a30-995c-40f4-a9fa-1a9f85afe1db tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:46:36.743755 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b4af8a30-995c-40f4-a9fa-1a9f85afe1db tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:46:36.744184 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-b4af8a30-995c-40f4-a9fa-1a9f85afe1db tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:46:36.874945 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-b4af8a30-995c-40f4-a9fa-1a9f85afe1db tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action" status: 200 len: 38174 microversion: 2.1 time: 0.146037 Nov 23 13:46:36.875625 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1123/2238] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:46:36 2021] POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action => generated 38174 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 13:46:37.893315 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-2fd2178b-2a26-468b-8777-3670433cedfb tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:46:37.895014 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-2fd2178b-2a26-468b-8777-3670433cedfb tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: efc6fa5e-050a-42ad-b79d-29fad30bb4a5] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:46:37.906554 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-2fd2178b-2a26-468b-8777-3670433cedfb tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:46:37.906995 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-2fd2178b-2a26-468b-8777-3670433cedfb tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:46:37.907762 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-2fd2178b-2a26-468b-8777-3670433cedfb tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:46:37.908221 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-2fd2178b-2a26-468b-8777-3670433cedfb tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:46:38.028476 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-2fd2178b-2a26-468b-8777-3670433cedfb tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action" status: 200 len: 38174 microversion: 2.1 time: 0.142606 Nov 23 13:46:38.029059 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1116/2239] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:46:37 2021] POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action => generated 38174 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:46:39.047148 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-84044944-6fc1-413a-a047-18057e69eebc tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:46:39.048735 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-84044944-6fc1-413a-a047-18057e69eebc tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: efc6fa5e-050a-42ad-b79d-29fad30bb4a5] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:46:39.057370 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-84044944-6fc1-413a-a047-18057e69eebc tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:46:39.057846 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-84044944-6fc1-413a-a047-18057e69eebc tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:46:39.058651 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-84044944-6fc1-413a-a047-18057e69eebc tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:46:39.059107 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-84044944-6fc1-413a-a047-18057e69eebc tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:46:39.195700 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-84044944-6fc1-413a-a047-18057e69eebc tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action" status: 200 len: 38305 microversion: 2.1 time: 0.154969 Nov 23 13:46:39.196527 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1124/2240] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Nov 23 13:46:39 2021] POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/action => generated 38305 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 13:46:39.210075 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-b69789ec-ba8e-44f8-9340-68a48f92d8e6 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:46:39.210608 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-b69789ec-ba8e-44f8-9340-68a48f92d8e6 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: efc6fa5e-050a-42ad-b79d-29fad30bb4a5] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:46:39.219128 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b69789ec-ba8e-44f8-9340-68a48f92d8e6 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:46:39.219577 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b69789ec-ba8e-44f8-9340-68a48f92d8e6 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:46:39.220363 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b69789ec-ba8e-44f8-9340-68a48f92d8e6 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:46:39.220791 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-b69789ec-ba8e-44f8-9340-68a48f92d8e6 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:46:39.277355 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-b69789ec-ba8e-44f8-9340-68a48f92d8e6 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "GET /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/ips" status: 200 len: 146 microversion: 2.1 time: 0.071949 Nov 23 13:46:39.277954 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1117/2241] 10.222.0.60 () {58 vars in 1247 bytes} [Tue Nov 23 13:46:39 2021] GET /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/ips => generated 146 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 13:46:40.808840 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-45df17d8-e0a8-4afe-a385-cdfd40352bea tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e7989bd3-7473-4505-a0e1-0fb45c9a1973"}} {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:46:40.809995 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-45df17d8-e0a8-4afe-a385-cdfd40352bea tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: efc6fa5e-050a-42ad-b79d-29fad30bb4a5] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:46:40.818422 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-45df17d8-e0a8-4afe-a385-cdfd40352bea tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:46:40.818873 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-45df17d8-e0a8-4afe-a385-cdfd40352bea tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:46:40.819639 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-45df17d8-e0a8-4afe-a385-cdfd40352bea tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:46:40.820074 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-45df17d8-e0a8-4afe-a385-cdfd40352bea tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:46:41.392273 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-45df17d8-e0a8-4afe-a385-cdfd40352bea tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.587656 Nov 23 13:46:41.392906 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1125/2242] 10.222.0.60 () {60 vars in 1322 bytes} [Tue Nov 23 13:46:40 2021] POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/os-volume_attachments => generated 194 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 13:46:49.334254 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-0fd9e3df-0809-44ff-b72e-45da9d190016 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:46:49.335167 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-0fd9e3df-0809-44ff-b72e-45da9d190016 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: efc6fa5e-050a-42ad-b79d-29fad30bb4a5] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:46:49.343379 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0fd9e3df-0809-44ff-b72e-45da9d190016 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:46:49.343825 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0fd9e3df-0809-44ff-b72e-45da9d190016 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:46:49.344608 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0fd9e3df-0809-44ff-b72e-45da9d190016 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:46:49.345035 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-0fd9e3df-0809-44ff-b72e-45da9d190016 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:46:49.413358 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-0fd9e3df-0809-44ff-b72e-45da9d190016 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "GET /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083091 Nov 23 13:46:49.413825 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1118/2243] 10.222.0.60 () {58 vars in 1301 bytes} [Tue Nov 23 13:46:49 2021] GET /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 13:46:49.427979 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-d2cfa3c4-4352-4361-8136-6ab843f603a4 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:46:49.428591 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-d2cfa3c4-4352-4361-8136-6ab843f603a4 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: efc6fa5e-050a-42ad-b79d-29fad30bb4a5] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:46:49.438501 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d2cfa3c4-4352-4361-8136-6ab843f603a4 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:46:49.438947 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d2cfa3c4-4352-4361-8136-6ab843f603a4 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:46:49.439738 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d2cfa3c4-4352-4361-8136-6ab843f603a4 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:46:49.440138 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-d2cfa3c4-4352-4361-8136-6ab843f603a4 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:46:49.505654 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-d2cfa3c4-4352-4361-8136-6ab843f603a4 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "GET /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/os-volume_attachments/e7989bd3-7473-4505-a0e1-0fb45c9a1973" status: 200 len: 194 microversion: 2.1 time: 0.084706 Nov 23 13:46:49.506254 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1126/2244] 10.222.0.60 () {58 vars in 1412 bytes} [Tue Nov 23 13:46:49 2021] GET /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/os-volume_attachments/e7989bd3-7473-4505-a0e1-0fb45c9a1973 => generated 194 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 13:46:51.041207 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-99b03aa3-870b-42ea-a928-5c2d3ca109a0 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3e70efcf-ba98-49cc-a8bf-e6500fda3e55"}} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:46:51.042564 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-99b03aa3-870b-42ea-a928-5c2d3ca109a0 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: efc6fa5e-050a-42ad-b79d-29fad30bb4a5] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:46:51.050473 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-99b03aa3-870b-42ea-a928-5c2d3ca109a0 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:46:51.050925 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-99b03aa3-870b-42ea-a928-5c2d3ca109a0 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:46:51.051732 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-99b03aa3-870b-42ea-a928-5c2d3ca109a0 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:46:51.052156 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-99b03aa3-870b-42ea-a928-5c2d3ca109a0 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:46:51.503155 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-99b03aa3-870b-42ea-a928-5c2d3ca109a0 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.468004 Nov 23 13:46:51.503988 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1119/2245] 10.222.0.60 () {60 vars in 1322 bytes} [Tue Nov 23 13:46:51 2021] POST /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/os-volume_attachments => generated 194 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 13:46:59.466368 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-3c2cd320-1329-4cac-8c43-537b70b7f23a tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:46:59.467442 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-3c2cd320-1329-4cac-8c43-537b70b7f23a tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: efc6fa5e-050a-42ad-b79d-29fad30bb4a5] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:46:59.475655 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3c2cd320-1329-4cac-8c43-537b70b7f23a tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:46:59.476108 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3c2cd320-1329-4cac-8c43-537b70b7f23a tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:46:59.476899 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3c2cd320-1329-4cac-8c43-537b70b7f23a tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:46:59.477333 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3c2cd320-1329-4cac-8c43-537b70b7f23a tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:46:59.550587 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-3c2cd320-1329-4cac-8c43-537b70b7f23a tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "GET /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.090786 Nov 23 13:46:59.551146 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1127/2246] 10.222.0.60 () {58 vars in 1301 bytes} [Tue Nov 23 13:46:59 2021] GET /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/os-volume_attachments => generated 371 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 13:47:15.015519 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-f76d6107-6004-44be-81ce-6ee473285f88 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:47:15.016255 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-f76d6107-6004-44be-81ce-6ee473285f88 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: efc6fa5e-050a-42ad-b79d-29fad30bb4a5] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:47:15.025421 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f76d6107-6004-44be-81ce-6ee473285f88 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:47:15.025872 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f76d6107-6004-44be-81ce-6ee473285f88 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:47:15.026655 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f76d6107-6004-44be-81ce-6ee473285f88 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:47:15.027092 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-f76d6107-6004-44be-81ce-6ee473285f88 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:47:15.095822 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-f76d6107-6004-44be-81ce-6ee473285f88 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "GET /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/os-volume_attachments/e7989bd3-7473-4505-a0e1-0fb45c9a1973" status: 200 len: 194 microversion: 2.1 time: 0.084768 Nov 23 13:47:15.096482 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1120/2247] 10.222.0.60 () {58 vars in 1412 bytes} [Tue Nov 23 13:47:15 2021] GET /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/os-volume_attachments/e7989bd3-7473-4505-a0e1-0fb45c9a1973 => generated 194 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 13:47:15.106591 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-6b170f3e-abb7-424a-96ca-936edf702e42 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:47:15.107215 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-6b170f3e-abb7-424a-96ca-936edf702e42 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: efc6fa5e-050a-42ad-b79d-29fad30bb4a5] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:47:15.115364 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-6b170f3e-abb7-424a-96ca-936edf702e42 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:47:15.115776 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-6b170f3e-abb7-424a-96ca-936edf702e42 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:47:15.116574 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-6b170f3e-abb7-424a-96ca-936edf702e42 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:47:15.116983 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-6b170f3e-abb7-424a-96ca-936edf702e42 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:47:15.284179 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.objects.instance [None req-6b170f3e-abb7-424a-96ca-936edf702e42 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lazy-loading 'services' on Instance uuid efc6fa5e-050a-42ad-b79d-29fad30bb4a5 {{(pid=100974) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 23 13:47:15.424799 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-6b170f3e-abb7-424a-96ca-936edf702e42 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "DELETE /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/os-volume_attachments/e7989bd3-7473-4505-a0e1-0fb45c9a1973" status: 202 len: 0 microversion: 2.1 time: 0.321913 Nov 23 13:47:15.425475 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1128/2248] 10.222.0.60 () {58 vars in 1415 bytes} [Tue Nov 23 13:47:15 2021] DELETE /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/os-volume_attachments/e7989bd3-7473-4505-a0e1-0fb45c9a1973 => generated 0 bytes in 324 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:47:17.738944 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-1d52ad37-5471-41f7-84cb-dff4842b2336 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:47:17.739489 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-1d52ad37-5471-41f7-84cb-dff4842b2336 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: efc6fa5e-050a-42ad-b79d-29fad30bb4a5] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:47:17.747612 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-1d52ad37-5471-41f7-84cb-dff4842b2336 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:47:17.748055 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-1d52ad37-5471-41f7-84cb-dff4842b2336 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:47:17.748837 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-1d52ad37-5471-41f7-84cb-dff4842b2336 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:47:17.749263 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-1d52ad37-5471-41f7-84cb-dff4842b2336 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:47:17.812928 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-1d52ad37-5471-41f7-84cb-dff4842b2336 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "GET /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/os-volume_attachments/3e70efcf-ba98-49cc-a8bf-e6500fda3e55" status: 200 len: 194 microversion: 2.1 time: 0.078596 Nov 23 13:47:17.814051 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1121/2249] 10.222.0.60 () {58 vars in 1412 bytes} [Tue Nov 23 13:47:17 2021] GET /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/os-volume_attachments/3e70efcf-ba98-49cc-a8bf-e6500fda3e55 => generated 194 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 13:47:17.824216 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-f68ad029-1ee9-4e26-bf03-326c666d15f0 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:47:17.824819 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-f68ad029-1ee9-4e26-bf03-326c666d15f0 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: efc6fa5e-050a-42ad-b79d-29fad30bb4a5] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:47:17.832839 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f68ad029-1ee9-4e26-bf03-326c666d15f0 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:47:17.833279 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f68ad029-1ee9-4e26-bf03-326c666d15f0 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:47:17.834392 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f68ad029-1ee9-4e26-bf03-326c666d15f0 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:47:17.834817 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f68ad029-1ee9-4e26-bf03-326c666d15f0 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:47:17.998325 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.objects.instance [None req-f68ad029-1ee9-4e26-bf03-326c666d15f0 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lazy-loading 'services' on Instance uuid efc6fa5e-050a-42ad-b79d-29fad30bb4a5 {{(pid=100974) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 23 13:47:18.145166 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-f68ad029-1ee9-4e26-bf03-326c666d15f0 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "DELETE /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/os-volume_attachments/3e70efcf-ba98-49cc-a8bf-e6500fda3e55" status: 202 len: 0 microversion: 2.1 time: 0.324860 Nov 23 13:47:18.145807 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1129/2250] 10.222.0.60 () {58 vars in 1415 bytes} [Tue Nov 23 13:47:17 2021] DELETE /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/os-volume_attachments/3e70efcf-ba98-49cc-a8bf-e6500fda3e55 => generated 0 bytes in 327 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:47:19.450640 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-6c2d68b5-1bb4-4007-a0f3-40bf31a39a4c tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:47:19.451625 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-6c2d68b5-1bb4-4007-a0f3-40bf31a39a4c tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: efc6fa5e-050a-42ad-b79d-29fad30bb4a5] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:47:19.460318 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6c2d68b5-1bb4-4007-a0f3-40bf31a39a4c tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:47:19.460777 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6c2d68b5-1bb4-4007-a0f3-40bf31a39a4c tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:47:19.461546 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6c2d68b5-1bb4-4007-a0f3-40bf31a39a4c tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:47:19.461972 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-6c2d68b5-1bb4-4007-a0f3-40bf31a39a4c tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:47:19.530857 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-6c2d68b5-1bb4-4007-a0f3-40bf31a39a4c tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "GET /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.084267 Nov 23 13:47:19.531430 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1122/2251] 10.222.0.60 () {58 vars in 1301 bytes} [Tue Nov 23 13:47:19 2021] GET /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/os-volume_attachments => generated 25 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 13:47:19.723986 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-34b168c0-b266-49f6-9931-0eb0023fc6b1 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:47:19.725087 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-34b168c0-b266-49f6-9931-0eb0023fc6b1 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: efc6fa5e-050a-42ad-b79d-29fad30bb4a5] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:47:19.732790 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-34b168c0-b266-49f6-9931-0eb0023fc6b1 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:47:19.733193 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-34b168c0-b266-49f6-9931-0eb0023fc6b1 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:47:19.733970 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-34b168c0-b266-49f6-9931-0eb0023fc6b1 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:47:19.734389 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-34b168c0-b266-49f6-9931-0eb0023fc6b1 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:47:19.802825 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-34b168c0-b266-49f6-9931-0eb0023fc6b1 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "GET /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.083603 Nov 23 13:47:19.803485 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1130/2252] 10.222.0.60 () {58 vars in 1301 bytes} [Tue Nov 23 13:47:19 2021] GET /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5/os-volume_attachments => generated 25 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 13:47:19.905601 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-01e9f678-e874-4fb4-8492-70ba3a2aabce tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:47:19.906083 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-01e9f678-e874-4fb4-8492-70ba3a2aabce tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: efc6fa5e-050a-42ad-b79d-29fad30bb4a5] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:47:19.914203 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-01e9f678-e874-4fb4-8492-70ba3a2aabce tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:47:19.914642 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-01e9f678-e874-4fb4-8492-70ba3a2aabce tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:47:19.915391 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-01e9f678-e874-4fb4-8492-70ba3a2aabce tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:47:19.915817 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-01e9f678-e874-4fb4-8492-70ba3a2aabce tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:47:19.978179 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-01e9f678-e874-4fb4-8492-70ba3a2aabce tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: efc6fa5e-050a-42ad-b79d-29fad30bb4a5] Going to try to terminate instance {{(pid=100973) delete /opt/stack/nova/nova/compute/api.py:2562}} Nov 23 13:47:20.097670 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-01e9f678-e874-4fb4-8492-70ba3a2aabce tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "DELETE /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5" status: 204 len: 0 microversion: 2.1 time: 0.194860 Nov 23 13:47:20.099222 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1123/2253] 10.222.0.60 () {58 vars in 1238 bytes} [Tue Nov 23 13:47:19 2021] DELETE /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 23 13:47:20.108970 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-3ce3ec8d-0026-4724-8b28-0d9e5fc03a5f tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:47:20.109575 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-3ce3ec8d-0026-4724-8b28-0d9e5fc03a5f tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: efc6fa5e-050a-42ad-b79d-29fad30bb4a5] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:47:20.117192 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3ce3ec8d-0026-4724-8b28-0d9e5fc03a5f tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:47:20.117674 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3ce3ec8d-0026-4724-8b28-0d9e5fc03a5f tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:47:20.118453 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3ce3ec8d-0026-4724-8b28-0d9e5fc03a5f tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:47:20.118881 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-3ce3ec8d-0026-4724-8b28-0d9e5fc03a5f tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:47:20.328172 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-3ce3ec8d-0026-4724-8b28-0d9e5fc03a5f tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5e06990f874a099eb9f92dde95e85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c610ba775aca44aa85aaf415f96bb37e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:47:20.337394 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-3ce3ec8d-0026-4724-8b28-0d9e5fc03a5f tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "GET /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5" status: 200 len: 1674 microversion: 2.1 time: 0.232254 Nov 23 13:47:20.337969 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1131/2254] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:47:20 2021] GET /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5 => generated 1674 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:47:21.356015 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-38ef3733-a09a-48e8-8108-495448fa909b tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:47:21.356695 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-38ef3733-a09a-48e8-8108-495448fa909b tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: efc6fa5e-050a-42ad-b79d-29fad30bb4a5] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:47:21.364849 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-38ef3733-a09a-48e8-8108-495448fa909b tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:47:21.365328 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-38ef3733-a09a-48e8-8108-495448fa909b tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:47:21.366104 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-38ef3733-a09a-48e8-8108-495448fa909b tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:47:21.366537 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-38ef3733-a09a-48e8-8108-495448fa909b tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:47:21.593979 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.policy [None req-38ef3733-a09a-48e8-8108-495448fa909b tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5e06990f874a099eb9f92dde95e85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c610ba775aca44aa85aaf415f96bb37e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100973) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:47:21.602833 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-38ef3733-a09a-48e8-8108-495448fa909b tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "GET /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5" status: 200 len: 1674 microversion: 2.1 time: 0.251127 Nov 23 13:47:21.603446 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1124/2255] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:47:21 2021] GET /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5 => generated 1674 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:47:22.622791 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-e40db7d4-082e-4b27-b9fb-cb01f9be1dff tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:47:22.623517 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-e40db7d4-082e-4b27-b9fb-cb01f9be1dff tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: efc6fa5e-050a-42ad-b79d-29fad30bb4a5] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:47:22.631932 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e40db7d4-082e-4b27-b9fb-cb01f9be1dff tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:47:22.632411 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e40db7d4-082e-4b27-b9fb-cb01f9be1dff tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:47:22.633147 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e40db7d4-082e-4b27-b9fb-cb01f9be1dff tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:47:22.633596 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-e40db7d4-082e-4b27-b9fb-cb01f9be1dff tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:47:23.188918 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-e40db7d4-082e-4b27-b9fb-cb01f9be1dff tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5e06990f874a099eb9f92dde95e85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c610ba775aca44aa85aaf415f96bb37e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:47:23.197834 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-e40db7d4-082e-4b27-b9fb-cb01f9be1dff tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "GET /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5" status: 200 len: 1674 microversion: 2.1 time: 0.580090 Nov 23 13:47:23.198399 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1132/2256] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:47:22 2021] GET /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5 => generated 1674 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 13:47:24.085180 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [req-be74b894-4a81-4c89-bf1f-71fb7e8d1f0a req-6da873f2-ed7a-429a-90d7-43e7ed8ce55d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efc6fa5e-050a-42ad-b79d-29fad30bb4a5", "name": "network-vif-deleted", "tag": "826971fe-33b4-4eee-b07e-22c99da90d19"}]} {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 13:47:24.086811 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 13:47:24.086811 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: warnings.warn(msg) Nov 23 13:47:24.096122 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [req-be74b894-4a81-4c89-bf1f-71fb7e8d1f0a req-6da873f2-ed7a-429a-90d7-43e7ed8ce55d service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:47:24.096587 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [req-be74b894-4a81-4c89-bf1f-71fb7e8d1f0a req-6da873f2-ed7a-429a-90d7-43e7ed8ce55d service nova] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:47:24.114410 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.compute.server_external_events [req-be74b894-4a81-4c89-bf1f-71fb7e8d1f0a req-6da873f2-ed7a-429a-90d7-43e7ed8ce55d service nova] Creating event network-vif-deleted:826971fe-33b4-4eee-b07e-22c99da90d19 for instance efc6fa5e-050a-42ad-b79d-29fad30bb4a5 on hv-cinder-81888 Nov 23 13:47:24.119661 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [req-be74b894-4a81-4c89-bf1f-71fb7e8d1f0a req-6da873f2-ed7a-429a-90d7-43e7ed8ce55d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147744 Nov 23 13:47:24.120824 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1125/2257] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Nov 23 13:47:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 13:47:24.221214 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-75bb3fbf-a904-4b00-b20e-48d221a7af08 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:47:24.221981 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-75bb3fbf-a904-4b00-b20e-48d221a7af08 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: efc6fa5e-050a-42ad-b79d-29fad30bb4a5] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:47:24.230243 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-75bb3fbf-a904-4b00-b20e-48d221a7af08 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:47:24.231252 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-75bb3fbf-a904-4b00-b20e-48d221a7af08 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:47:24.232483 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-75bb3fbf-a904-4b00-b20e-48d221a7af08 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:47:24.232933 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-75bb3fbf-a904-4b00-b20e-48d221a7af08 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:47:24.307239 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-75bb3fbf-a904-4b00-b20e-48d221a7af08 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:47:24.307668 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-75bb3fbf-a904-4b00-b20e-48d221a7af08 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:47:24.308106 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.objects.instance [None req-75bb3fbf-a904-4b00-b20e-48d221a7af08 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lazy-loading 'fault' on Instance uuid efc6fa5e-050a-42ad-b79d-29fad30bb4a5 {{(pid=100974) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 23 13:47:24.387626 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.policy [None req-75bb3fbf-a904-4b00-b20e-48d221a7af08 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e5e06990f874a099eb9f92dde95e85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c610ba775aca44aa85aaf415f96bb37e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100974) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 13:47:24.396879 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-75bb3fbf-a904-4b00-b20e-48d221a7af08 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "GET /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5" status: 200 len: 1327 microversion: 2.1 time: 0.179726 Nov 23 13:47:24.397559 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1133/2258] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:47:24 2021] GET /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5 => generated 1327 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 13:47:25.419367 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-2e1be478-a6cc-42e1-92b4-8f3cfdf353d3 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:47:25.420045 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-2e1be478-a6cc-42e1-92b4-8f3cfdf353d3 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: efc6fa5e-050a-42ad-b79d-29fad30bb4a5] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:47:25.429172 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-2e1be478-a6cc-42e1-92b4-8f3cfdf353d3 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:47:25.429676 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-2e1be478-a6cc-42e1-92b4-8f3cfdf353d3 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:47:25.430479 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-2e1be478-a6cc-42e1-92b4-8f3cfdf353d3 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:47:25.430973 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-2e1be478-a6cc-42e1-92b4-8f3cfdf353d3 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:47:25.484988 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.wsgi [None req-2e1be478-a6cc-42e1-92b4-8f3cfdf353d3 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] HTTP exception thrown: Instance efc6fa5e-050a-42ad-b79d-29fad30bb4a5 could not be found. Nov 23 13:47:25.485619 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-2e1be478-a6cc-42e1-92b4-8f3cfdf353d3 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Returning 404 to user: Instance efc6fa5e-050a-42ad-b79d-29fad30bb4a5 could not be found. {{(pid=100973) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Nov 23 13:47:25.486473 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-2e1be478-a6cc-42e1-92b4-8f3cfdf353d3 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "GET /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5" status: 404 len: 111 microversion: 2.1 time: 0.072075 Nov 23 13:47:25.487029 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1126/2259] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:47:25 2021] GET /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 23 13:47:25.496835 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-bd9ab984-6b2d-4220-9adb-0ea89859076a tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Calling method '.version_select at 0x7f1870f0c280>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:47:25.516262 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-bd9ab984-6b2d-4220-9adb-0ea89859076a tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-597685985" status: 202 len: 0 microversion: 2.1 time: 0.023275 Nov 23 13:47:25.517011 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1134/2260] 10.222.0.60 () {58 vars in 1217 bytes} [Tue Nov 23 13:47:25 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-597685985 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 13:47:29.204995 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-8c2da490-c7fd-417a-b11b-789d6a12e09f tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:47:29.205693 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-8c2da490-c7fd-417a-b11b-789d6a12e09f tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: efc6fa5e-050a-42ad-b79d-29fad30bb4a5] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:47:29.213540 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8c2da490-c7fd-417a-b11b-789d6a12e09f tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:47:29.213975 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8c2da490-c7fd-417a-b11b-789d6a12e09f tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:47:29.214725 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8c2da490-c7fd-417a-b11b-789d6a12e09f tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:47:29.215149 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-8c2da490-c7fd-417a-b11b-789d6a12e09f tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:47:29.265866 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.wsgi [None req-8c2da490-c7fd-417a-b11b-789d6a12e09f tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] HTTP exception thrown: Instance efc6fa5e-050a-42ad-b79d-29fad30bb4a5 could not be found. Nov 23 13:47:29.266476 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-8c2da490-c7fd-417a-b11b-789d6a12e09f tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Returning 404 to user: Instance efc6fa5e-050a-42ad-b79d-29fad30bb4a5 could not be found. {{(pid=100973) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Nov 23 13:47:29.267518 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-8c2da490-c7fd-417a-b11b-789d6a12e09f tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "DELETE /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5" status: 404 len: 111 microversion: 2.1 time: 0.066374 Nov 23 13:47:29.268350 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1127/2261] 10.222.0.60 () {58 vars in 1238 bytes} [Tue Nov 23 13:47:29 2021] DELETE /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 13:47:29.279029 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-afcbe2e0-47f6-4bfc-baa2-b87be7f6f1e7 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:47:29.279968 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-afcbe2e0-47f6-4bfc-baa2-b87be7f6f1e7 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: efc6fa5e-050a-42ad-b79d-29fad30bb4a5] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:47:29.292330 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-afcbe2e0-47f6-4bfc-baa2-b87be7f6f1e7 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:47:29.293099 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-afcbe2e0-47f6-4bfc-baa2-b87be7f6f1e7 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:47:29.294360 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-afcbe2e0-47f6-4bfc-baa2-b87be7f6f1e7 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:47:29.295066 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-afcbe2e0-47f6-4bfc-baa2-b87be7f6f1e7 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:47:29.346840 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.wsgi [None req-afcbe2e0-47f6-4bfc-baa2-b87be7f6f1e7 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] HTTP exception thrown: Instance efc6fa5e-050a-42ad-b79d-29fad30bb4a5 could not be found. Nov 23 13:47:29.347438 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-afcbe2e0-47f6-4bfc-baa2-b87be7f6f1e7 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Returning 404 to user: Instance efc6fa5e-050a-42ad-b79d-29fad30bb4a5 could not be found. {{(pid=100974) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Nov 23 13:47:29.348274 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-afcbe2e0-47f6-4bfc-baa2-b87be7f6f1e7 tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "GET /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5" status: 404 len: 111 microversion: 2.1 time: 0.075357 Nov 23 13:47:29.348932 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1135/2262] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:47:29 2021] GET /compute/v2.1/servers/efc6fa5e-050a-42ad-b79d-29fad30bb4a5 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 13:47:30.598248 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-53922ab5-5b8f-4518-80ff-52d27a4f0acc tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Calling method '>' {{(pid=100973) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:47:30.598766 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.compute.api [None req-53922ab5-5b8f-4518-80ff-52d27a4f0acc tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100973) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:47:30.606704 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-53922ab5-5b8f-4518-80ff-52d27a4f0acc tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:47:30.607138 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-53922ab5-5b8f-4518-80ff-52d27a4f0acc tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:47:30.607882 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-53922ab5-5b8f-4518-80ff-52d27a4f0acc tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:47:30.608332 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG oslo_concurrency.lockutils [None req-53922ab5-5b8f-4518-80ff-52d27a4f0acc tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:47:30.656483 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.wsgi [None req-53922ab5-5b8f-4518-80ff-52d27a4f0acc tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] HTTP exception thrown: Instance 932d4c6a-60ed-44a3-b9af-627f70d7f455 could not be found. Nov 23 13:47:30.656979 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: DEBUG nova.api.openstack.wsgi [None req-53922ab5-5b8f-4518-80ff-52d27a4f0acc tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Returning 404 to user: Instance 932d4c6a-60ed-44a3-b9af-627f70d7f455 could not be found. {{(pid=100973) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Nov 23 13:47:30.657787 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO nova.api.openstack.requestlog [None req-53922ab5-5b8f-4518-80ff-52d27a4f0acc tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "DELETE /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455" status: 404 len: 111 microversion: 2.1 time: 0.063408 Nov 23 13:47:30.658320 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: [pid: 100973|app: 0|req: 1128/2263] 10.222.0.60 () {58 vars in 1238 bytes} [Tue Nov 23 13:47:30 2021] DELETE /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 13:47:30.669271 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-f5358a9a-e630-4218-b932-4dab915a2b4b tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Calling method '>' {{(pid=100974) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 13:47:30.670004 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.compute.api [None req-f5358a9a-e630-4218-b932-4dab915a2b4b tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] [instance: 932d4c6a-60ed-44a3-b9af-627f70d7f455] Fetching instance by UUID {{(pid=100974) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 23 13:47:30.678795 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f5358a9a-e630-4218-b932-4dab915a2b4b tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:47:30.679244 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f5358a9a-e630-4218-b932-4dab915a2b4b tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:47:30.680003 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f5358a9a-e630-4218-b932-4dab915a2b4b tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 23 13:47:30.680483 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG oslo_concurrency.lockutils [None req-f5358a9a-e630-4218-b932-4dab915a2b4b tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Lock "2fe6e443-f0b5-42cc-9f82-d8ed2ea775ac" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 23 13:47:30.729464 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.wsgi [None req-f5358a9a-e630-4218-b932-4dab915a2b4b tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] HTTP exception thrown: Instance 932d4c6a-60ed-44a3-b9af-627f70d7f455 could not be found. Nov 23 13:47:30.730055 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: DEBUG nova.api.openstack.wsgi [None req-f5358a9a-e630-4218-b932-4dab915a2b4b tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] Returning 404 to user: Instance 932d4c6a-60ed-44a3-b9af-627f70d7f455 could not be found. {{(pid=100974) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Nov 23 13:47:30.730868 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO nova.api.openstack.requestlog [None req-f5358a9a-e630-4218-b932-4dab915a2b4b tempest-AttachVolumeTestJSON-1806861357 tempest-AttachVolumeTestJSON-1806861357-project] 10.222.0.60 "GET /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455" status: 404 len: 111 microversion: 2.1 time: 0.067874 Nov 23 13:47:30.731408 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: [pid: 100974|app: 0|req: 1136/2264] 10.222.0.60 () {58 vars in 1235 bytes} [Tue Nov 23 13:47:30 2021] GET /compute/v2.1/servers/932d4c6a-60ed-44a3-b9af-627f70d7f455 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 13:47:45.194964 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 13:47:45.195544 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: Tue Nov 23 13:47:45 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 23 13:47:48.719225 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 13:47:48.719918 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: Tue Nov 23 13:47:48 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 23 13:49:28.106503 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 13:49:28.107087 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: Tue Nov 23 13:49:28 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 23 13:49:52.331512 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 13:49:52.332333 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: Tue Nov 23 13:49:52 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 23 13:50:30.567600 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 13:50:30.568320 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: Tue Nov 23 13:50:30 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 23 13:51:05.215095 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 13:51:05.215672 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: Tue Nov 23 13:51:05 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 23 13:51:08.739917 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 13:51:08.739917 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: Tue Nov 23 13:51:08 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 23 13:52:48.124713 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 13:52:48.125313 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: Tue Nov 23 13:52:48 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 23 13:53:05.424712 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 13:53:05.424712 dv-cinder-818886-1-iscsi devstack@n-api.service[100973]: Tue Nov 23 13:53:05 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 23 13:53:12.352130 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 13:53:12.352799 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: Tue Nov 23 13:53:12 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 23 13:53:50.587182 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 13:53:50.587804 dv-cinder-818886-1-iscsi devstack@n-api.service[100974]: Tue Nov 23 13:53:50 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!